Top Data Engineer Jobs in Ottawa

As a Principal Data Engineer, you will design and implement LLM, AI-powered security data platforms, mentor engineers, and drive the adoption of data solutions across teams.

Design, build, and operate production AI systems and marketing data infrastructure. Develop retrieval pipelines, agent orchestration, CDP integrations, ETL/ELT pipelines, and analytics. Automate workflows with AI, ensure data quality and reliability, partner with stakeholders, ship Python and SQL code, mentor engineers, and drive requirements to production.

Lead design and operation of Block's real-time, event-driven data systems. Build and run high-throughput streaming pipelines, turn Kafka event streams into low-latency data products, improve reliability and observability, mentor engineers, and define platform architecture and standards for projections, third-party data proxy, and graph data capabilities.

Design, build, and operate production ML signal systems—ranking, retrieval, recommendations, propensity, and next-best-action—covering feature/candidate generation, serving, experimentation, monitoring, and feedback. Define signal contracts (freshness, provenance, confidence), evaluate long-term impact (trust, fairness, compliance), and partner across product, data, and risk teams to deliver reusable customer-intelligence capabilities.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Lead technical implementation of a market management platform for nodal electricity markets. Design and operate large-scale, data-intensive production systems handling continuously changing data. Make architecture decisions, contribute production software, manage incidents, improve existing systems, and partner with product, engineering, data science, and power-market experts. Lead technical reviews, mentor engineers, and drive optimization, forecasting, and analytical capabilities.

Design, build, and maintain scalable data ingestion pipelines, databases and data lakes for credit and lending datasets. Ensure accurate data mappings, monitoring and alerting, translate stakeholder requirements into analytical data flows, and integrate APIs to deliver reliable, high-quality data products.

Design, build, and maintain SparkSQL/PySpark data pipelines in the central data lake to ingest IoT, product, and unstructured data (video/audio). Produce reliable computed tables for analytics, model training, and dashboards; integrate external datasets; ensure high data quality and uptime; and collaborate with Data Science, ML, and cross-functional teams.

Design, build, and operate scalable data ingestion, replication, and lakehouse infrastructure to move petabytes of data into a Delta Lake on S3. Improve reliability, observability, security, and developer experience for Spark/Databricks processing. Develop internal libraries and tooling (Go/Python), collaborate with cross-functional teams, and help shape long-term data platform and AI-ready infrastructure.

Design, build, and operate large-scale Spark/PySpark data pipelines and the enterprise data platform. Implement data integrations, transformations (Python/SQL), monitoring, and data quality. Build MCP servers and AI-enabled tooling, optimize performance, mentor engineers, and lead cross-functional data projects to enable analytics and automation.

Build and maintain scalable, reliable ML data platform systems to support dataset generation, model training, analytics, monitoring, and large-scale inference. Collaborate with ML, software, and infrastructure engineers to design cost-efficient data lake and training infrastructure using vendor and open-source tools to enable next-generation ML models.

Lead end-to-end data and ML pipelines for onboarding and fraud decisions: ingest streaming and batch sources, build feature platform and entity resolution, productionize ML models, enforce PII/data governance, and set technical direction while mentoring engineers and ensuring low-latency, reliable serving.

As a Data Analyst, you will analyze user behavior, create interactive dashboards, and collaborate with teams to provide actionable insights for product improvement.

The Guidewire Data Engineer will design schemas in Snowflake, develop ETL processes, optimize SQL queries, and integrate Guidewire with data platforms.

Design, build, and operate production ML systems that generate trusted signals for ranking, retrieval, recommendations, propensity/churn/LTV, and next-best-action decisioning. Define signal/data contracts, own feature and candidate generation through serving, experimentation, monitoring, and feedback loops, and evaluate long-term business impact, trust, fairness, and compliance. Partner across product, data, modeling, risk, and compliance and apply AI/agents to accelerate engineering and operations.

As a Data Engineer, you will develop and manage data pipelines, ensuring reliable data ingestion and delivery while optimizing for simplicity and performance.

Lead design and implementation of a federated Lakehouse data platform, unify data silos, define governance/observability, enable secure AI/ML (RAG/vector readiness), mentor architects/engineers, and present roadmaps to executives.

The Data Engineer will analyze and interpret data to drive insights, create dashboards, and enhance product performance, collaborating with cross-functional teams.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

Design, build, and operate scalable AWS-based data infrastructure, pipelines, warehouses, and ETL processes. Maintain data quality, security, reliability, monitoring, and cost efficiency while supporting analytics, finance, dashboards, and reporting. Translate cross-functional requirements into durable data solutions, troubleshoot complex issues, manage Terraform infrastructure, and establish engineering standards. The role also mentors junior team members and improves data platform capabilities in a remote fintech environment.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Build and operate production-grade data ingestion and transformation pipelines in Databricks using Spark/PySpark, SQL, Delta Lake, and medallion architecture. Manage schemas, data quality, deduplication, API integrations, orchestration, monitoring, alerting, recovery, and performance optimization. Collaborate with data scientists and application teams to provide reliable data for LLM/NLP pipelines. Contribute to CI/CD, documentation, data architecture, and onboarding new data sources.

Design, build, and scale real-time and batch data infrastructure and pipelines (Kafka, Databricks, Snowflake) to power analytics, reporting, and AI-powered data experiences. Drive data modeling, governance, observability, and best practices while partnering with cross-functional teams and mentoring engineers.

Designs, builds, and maintains scalable batch and real-time data pipelines supporting an IoT safety ecosystem. The role manages ETL/ELT processes, data lakes, warehouses, lakehouses, orchestration, monitoring, data quality, and observability. It partners with product, engineering, analytics, and data science teams to deliver reliable data services, productionize models, and shape long-term data platform architecture using AWS and modern infrastructure practices.

Design, build, and optimize Microsoft Fabric-based ingestion, transformation, and curated data layers. Migrate legacy sources, implement business rules, develop API-driven workflows, ensure data quality, security, and monitoring, and support CI/CD and operational delivery for analytics and reporting.