Top Data Engineer Jobs in Ottawa

Design, build, and maintain SparkSQL/PySpark data pipelines in the central data lake to ingest IoT, product, and unstructured data (video/audio). Produce reliable computed tables for analytics, model training, and dashboards; integrate external datasets; ensure high data quality and uptime; and collaborate with Data Science, ML, and cross-functional teams.

As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.

Build and ship production AI systems across retrieval, knowledge graphs, inference, agentic workflows, and data platforms. Develop customer-context retrieval, scored signals, workflow automation, evaluation, and observability capabilities. Work hands-on with Python, SQL, dbt, lakehouse data, cloud infrastructure, model selection, and inference-cost optimization. Establish reusable engineering patterns and mentor teams through high-quality code and system design.

Design, build, and operate production AI systems and marketing data infrastructure. Develop retrieval pipelines, agent orchestration, CDP integrations, ETL/ELT pipelines, and analytics. Automate workflows with AI, ensure data quality and reliability, partner with stakeholders, ship Python and SQL code, mentor engineers, and drive requirements to production.

Build and operate production machine learning systems for ranking, retrieval, recommendations, search, propensity, churn, LTV, and next-best-action decisioning. Design reliable signal contracts covering freshness, provenance, confidence, eligibility, and calibration. Lead feature pipelines, model serving, experimentation, monitoring, and feedback loops while evaluating fairness, risk, compliance, trust, and long-term customer impact. Collaborate across product, growth, data, platform, modeling, risk, and compliance teams.

Build and operate production machine learning systems for ranking, retrieval, recommendations, search, propensity, churn, lifecycle intelligence, and next-best-action decisioning. Design reliable signal contracts with freshness, provenance, confidence, and calibration guarantees. Lead experimentation, monitoring, feedback loops, and impact evaluation focused on fairness, trust, risk, compliance, and long-term engagement. Partner across product, growth, data, platform, modeling, risk, and compliance teams.

Own Orum’s data platform architecture, roadmap, reliability, and scalability. Build batch and real-time ETL/ELT pipelines using PostgreSQL, event streams, ClickHouse, BigQuery, and dbt. Administer Looker and develop LookML models, dashboards, and a trusted semantic layer. Establish data quality, governance, lineage, observability, and metric standards while partnering with Product, Finance, GTM, and Operations on analytics, AI, and business intelligence initiatives.

Build and operate Block’s data platform, including warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop reliable Python services, developer tools, and Terraform infrastructure for petabyte-scale data. Partner with data practitioners and product teams, establish engineering standards, provide technical direction, and mentor engineers while ensuring security, reliability, observability, usability, and data governance.

Build and operate a scalable data platform supporting warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop Python services, Terraform infrastructure, and developer tools for petabyte-scale data. Partner with data practitioners and product teams, establish security and reliability patterns, set technical direction, improve engineering standards, and mentor engineers.

Build and operate high-volume telemetry and analytics data pipelines supporting real-time monitoring, product decisions, experimentation, and user experience analysis. Design event instrumentation, schemas, quality checks, deduplication, late-event handling, and identity stitching. Partner with data science, product, and SRE teams to shape requirements, and integrate AI tooling into development and data quality workflows.

Design and operate scalable, cloud-native data pipelines and orchestration systems for imaging, biomarker, and healthcare data. Build Databricks and distributed processing workflows, integrate DICOM data into data lakes, and implement validation, observability, monitoring, and fault tolerance. Collaborate with data science, AI, R&D, product, and data management teams to deliver secure, compliant, reliable data for analytics and machine learning.

Design, build, and maintain scalable data ingestion pipelines, databases and data lakes for credit and lending datasets. Ensure accurate data mappings, monitoring and alerting, translate stakeholder requirements into analytical data flows, and integrate APIs to deliver reliable, high-quality data products.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Design, build, optimize, and maintain scalable Databricks data pipelines and ETL/ELT workflows. Manage CI/CD with Azure Pipelines and Azure Key Vault, improve performance and cost efficiency, implement data quality and governance practices, troubleshoot distributed systems, collaborate with stakeholders, and support cloud data platform modernization initiatives.

Design, build, and operate scalable data ingestion, replication, and lakehouse infrastructure to move petabytes of data into a Delta Lake on S3. Improve reliability, observability, security, and developer experience for Spark/Databricks processing. Develop internal libraries and tooling (Go/Python), collaborate with cross-functional teams, and help shape long-term data platform and AI-ready infrastructure.

Design, build, and operate large-scale Spark/PySpark data pipelines and the enterprise data platform. Implement data integrations, transformations (Python/SQL), monitoring, and data quality. Build MCP servers and AI-enabled tooling, optimize performance, mentor engineers, and lead cross-functional data projects to enable analytics and automation.

Build and maintain scalable, reliable ML data platform systems to support dataset generation, model training, analytics, monitoring, and large-scale inference. Collaborate with ML, software, and infrastructure engineers to design cost-efficient data lake and training infrastructure using vendor and open-source tools to enable next-generation ML models.

Lead end-to-end data and ML pipelines for onboarding and fraud decisions: ingest streaming and batch sources, build feature platform and entity resolution, productionize ML models, enforce PII/data governance, and set technical direction while mentoring engineers and ensuring low-latency, reliable serving.

As a Data Analyst, you will analyze user behavior, create interactive dashboards, and collaborate with teams to provide actionable insights for product improvement.

The Guidewire Data Engineer will design schemas in Snowflake, develop ETL processes, optimize SQL queries, and integrate Guidewire with data platforms.

The Data Engineer will analyze and interpret data to drive insights, create dashboards, and enhance product performance, collaborating with cross-functional teams.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Owns the design, delivery, and sustainment of infrastructure, tooling, automation, and CI/CD for Assent’s Data and AI Platform. Builds scalable AWS infrastructure supporting Snowflake, dbt, Airflow, data pipelines, warehousing, orchestration, and AI/ML workloads. Partners with Data Engineering, establishes observability and incident response practices, governs access and security, and guides deployment and infrastructure best practices while contributing to broader DevOps standards.

Design, build, and scale real-time and batch data infrastructure and pipelines (Kafka, Databricks, Snowflake) to power analytics, reporting, and AI-powered data experiences. Drive data modeling, governance, observability, and best practices while partnering with cross-functional teams and mentoring engineers.