Top Data Engineer Jobs in Ottawa

Design, build, and maintain SparkSQL/PySpark data pipelines in the central data lake to ingest IoT, product, and unstructured data (video/audio). Produce reliable computed tables for analytics, model training, and dashboards; integrate external datasets; ensure high data quality and uptime; and collaborate with Data Science, ML, and cross-functional teams.

As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.

Design, build, and operate production AI systems and marketing data infrastructure. Develop retrieval pipelines, agent orchestration, CDP integrations, ETL/ELT pipelines, and analytics. Automate workflows with AI, ensure data quality and reliability, partner with stakeholders, ship Python and SQL code, mentor engineers, and drive requirements to production.

Develop and maintain ETL processes and data pipelines using SSIS and Microsoft Fabric. Design workflows for extracting, transforming, and loading data; ensure data quality, integrity, and availability; collaborate with analysts on modeled data, dashboards, and reports; and troubleshoot existing integrations. The role requires SQL expertise, ETL and data modeling knowledge, analytics collaboration, and eligibility for Controlled Goods and Level II NATO Secret clearance.

Build and operate Block’s data platform, including warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop reliable Python services, developer tools, and Terraform infrastructure for petabyte-scale data. Partner with data practitioners and product teams, establish engineering standards, provide technical direction, and mentor engineers while ensuring security, reliability, observability, usability, and data governance.

Build and operate a scalable data platform supporting warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop Python services, Terraform infrastructure, and developer tools for petabyte-scale data. Partner with data practitioners and product teams, establish security and reliability patterns, set technical direction, improve engineering standards, and mentor engineers.

Design and lead scalable data engineering solutions using Databricks and Azure. Establish enterprise data modeling and engineering standards, architect pipelines and integrations, improve platform reliability and performance, guide modernization and cloud migrations, troubleshoot complex issues, and mentor data engineers while ensuring security, quality, and governance.

Build and operate high-volume telemetry and analytics data pipelines supporting real-time monitoring, product decisions, experimentation, and user experience analysis. Design event instrumentation, schemas, quality checks, deduplication, late-event handling, and identity stitching. Partner with data science, product, and SRE teams to shape requirements, and integrate AI tooling into development and data quality workflows.

Design and operate scalable, cloud-native data pipelines and orchestration systems for imaging, biomarker, and healthcare data. Build Databricks and distributed processing workflows, integrate DICOM data into data lakes, and implement validation, observability, monitoring, and fault tolerance. Collaborate with data science, AI, R&D, product, and data management teams to deliver secure, compliant, reliable data for analytics and machine learning.

Design, build, and maintain scalable data ingestion pipelines, databases and data lakes for credit and lending datasets. Ensure accurate data mappings, monitoring and alerting, translate stakeholder requirements into analytical data flows, and integrate APIs to deliver reliable, high-quality data products.

Design, build, and operate production ML signal systems—ranking, retrieval, recommendations, propensity, and next-best-action—covering feature/candidate generation, serving, experimentation, monitoring, and feedback. Define signal contracts (freshness, provenance, confidence), evaluate long-term impact (trust, fairness, compliance), and partner across product, data, and risk teams to deliver reusable customer-intelligence capabilities.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Lead technical implementation of a market management platform for nodal electricity markets. Design and operate large-scale, data-intensive production systems handling continuously changing data. Make architecture decisions, contribute production software, manage incidents, improve existing systems, and partner with product, engineering, data science, and power-market experts. Lead technical reviews, mentor engineers, and drive optimization, forecasting, and analytical capabilities.

Design, build, and operate scalable data ingestion, replication, and lakehouse infrastructure to move petabytes of data into a Delta Lake on S3. Improve reliability, observability, security, and developer experience for Spark/Databricks processing. Develop internal libraries and tooling (Go/Python), collaborate with cross-functional teams, and help shape long-term data platform and AI-ready infrastructure.

Design, build, and operate large-scale Spark/PySpark data pipelines and the enterprise data platform. Implement data integrations, transformations (Python/SQL), monitoring, and data quality. Build MCP servers and AI-enabled tooling, optimize performance, mentor engineers, and lead cross-functional data projects to enable analytics and automation.

Build and maintain scalable, reliable ML data platform systems to support dataset generation, model training, analytics, monitoring, and large-scale inference. Collaborate with ML, software, and infrastructure engineers to design cost-efficient data lake and training infrastructure using vendor and open-source tools to enable next-generation ML models.

Lead end-to-end data and ML pipelines for onboarding and fraud decisions: ingest streaming and batch sources, build feature platform and entity resolution, productionize ML models, enforce PII/data governance, and set technical direction while mentoring engineers and ensuring low-latency, reliable serving.

As a Data Analyst, you will analyze user behavior, create interactive dashboards, and collaborate with teams to provide actionable insights for product improvement.

The Guidewire Data Engineer will design schemas in Snowflake, develop ETL processes, optimize SQL queries, and integrate Guidewire with data platforms.

Design, build, and operate production ML systems that generate trusted signals for ranking, retrieval, recommendations, propensity/churn/LTV, and next-best-action decisioning. Define signal/data contracts, own feature and candidate generation through serving, experimentation, monitoring, and feedback loops, and evaluate long-term business impact, trust, fairness, and compliance. Partner across product, data, modeling, risk, and compliance and apply AI/agents to accelerate engineering and operations.

The Data Engineer will analyze and interpret data to drive insights, create dashboards, and enhance product performance, collaborating with cross-functional teams.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Owns the design, delivery, and sustainment of infrastructure, tooling, automation, and CI/CD for Assent’s Data and AI Platform. Builds scalable AWS infrastructure supporting Snowflake, dbt, Airflow, data pipelines, warehousing, orchestration, and AI/ML workloads. Partners with Data Engineering, establishes observability and incident response practices, governs access and security, and guides deployment and infrastructure best practices while contributing to broader DevOps standards.

Designs, develops, and implements secure, scalable, high-performing data platforms and workflows. Influences data architecture and technology decisions, establishes coding standards, conducts code reviews, automates processes, and optimizes data delivery. Collaborates with database, software, product, and AI/ML teams to align data initiatives with business goals. Provides mentorship and technical guidance while supporting data quality, governance, modeling, analytics, and operational improvements.