Design, develop, and maintain scalable data pipelines and analytics-ready datasets using the Microsoft Azure data ecosystem. Integrate diverse data sources, implement ETL/ELT processes, and collaborate with stakeholders, architects, and product teams to deliver reliable, production-grade data solutions for analytics and transformation initiatives.
This is a remote position.
We are seeking an experienced Senior Data Engineer to design, develop, and maintain scalable data solutions for a large-scale digital transformation initiative. The successful candidate will work closely with business stakeholders, product owners, data architects, and technical teams to build reliable data pipelines, integrate diverse data sources, and deliver trusted, analytics-ready datasets. The role will focus heavily on the Microsoft Azure data ecosystem, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Python, SQL, and Delta Lake.
Requirements
- Minimum 5 years of hands-on experience with Python and SQL for data engineering.
- Minimum 3 years of experience with Azure services, including Azure Storage, Azure SQL, Azure Synapse, and Azure networking.
- Minimum 3 years of hands-on experience with Azure Databricks and Delta Lake.
- Minimum 3 years of experience designing data solutions and developing trusted, analytics-ready datasets.
- Minimum 4 years of experience using version control systems such as Git.
- Minimum 1 year of experience using AI tools for code generation, data analysis, automation, optimization, or related data engineering activities.
- Strong understanding of data engineering principles, ETL/ELT processes, data integration, and data pipelines.
- Strong SQL development and data transformation skills.
- Experience working with cloud-based data platforms and modern data architectures.
- Strong problem-solving, analytical, and communication skills.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate production AI systems and marketing data infrastructure. Develop retrieval pipelines, agent orchestration, CDP integrations, ETL/ELT pipelines, and analytics. Automate workflows with AI, ensure data quality and reliability, partner with stakeholders, ship Python and SQL code, mentor engineers, and drive requirements to production.
Top Skills:
Agent OrchestrationBigQueryClaude CodeCursorCustomer Data Platform (Cdp)Data WarehouseDatabricksDbtEtl/EltHightouchLlmsMarketing AutomationPythonSalesforceSegmentSnowflakeSQLWeb Analytics
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead design and operation of Block's real-time, event-driven data systems. Build and run high-throughput streaming pipelines, turn Kafka event streams into low-latency data products, improve reliability and observability, mentor engineers, and define platform architecture and standards for projections, third-party data proxy, and graph data capabilities.
Top Skills:
AWSBlock-ForgeCloudeventsDatabricksDatahubDbtFlinkIcebergKafkaKotlinPrefectSnowflakeSparkSpark Structured Streaming
Fintech • Payments • Financial Services
Design and implement automated data quality frameworks and tests for BigQuery-based pipelines. Collaborate with data engineers and product to define data contracts and quality gates, build observability and anomaly detection, validate complex ELT/ETL processes, and integrate data tests into CI/CD workflows. Drive improvements in documentation, governance, and pipeline reliability.
Top Skills:
AirflowBigQueryCi/CdDbtGCPGitGreat ExpectationsMonte CarloPower BIPulumiPythonSQLTerraform
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
