ACD Direct Logo

ACD Direct

Senior Data Engineer

Reposted 20 Hours Ago
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Design, build, and maintain scalable Databricks-based ETL/ELT pipelines and data models optimized for AI/ML. Manage orchestration, data quality, governance, and CI/CD (ADO → GitHub) while collaborating with cross-functional teams in Agile delivery.
The summary above was generated by AI

About ACD

For more than a century, AIA Contract Documents (ACD) has supported architecture, engineering, and construction professionals by delivering a shared industry standard to align parties on a project.

What began in 1888 with the development of standardized construction contracts has evolved into a comprehensive suite of contract tools and foundational workflows that not only shape how the industry works today, but uniquely position ACD to help firms navigate construction’s growing complexity.

In a world driven by scale, fragmentation, and AI-generated decisions that prioritize speed over a clear understanding of risk, ACD serves as a trusted anchor, ensuring project participants can reduce disputes and negotiations, while achieving faster alignment and more predictable outcomes for the future.

AIA Contract Documents is seeking a Senior Data Engineer to support the buildout of data infrastructure powering upcoming AI initiatives. This role will play a critical part in designing and structuring data systems that enable scalable, high-quality inputs for AI and machine learning models.

The ideal candidate brings deep experience in modern data engineering practices, strong familiarity with Databricks, and the ability to operate independently in a fast-evolving environment with limited oversight.

Key Responsibilities

  • Design and implement scalable data models optimized for AI/ML use cases, ensuring data is structured for effective model training and inference

  • Architect and manage data pipelines using Databricks, including orchestration, job scheduling, and workflow optimization

  • Develop and maintain robust ETL/ELT processes to support data ingestion, transformation, and delivery across systems

  • Leverage Databricks Asset Bundles to manage deployment of data assets (pipelines, jobs, notebooks, and files) across environments

  • Collaborate with cross-functional teams to align data architecture with AI initiative requirements and business objectives

  • Ensure data quality, integrity, and governance standards are met across all pipelines and datasets

  • Contribute to CI/CD practices using Azure DevOps (ADO), with a future transition to GitHub-based workflows

  • Participate in Agile development processes, including sprint planning, stand-ups, and iterative delivery

  • Other duties as assigned

Qualifications

  • 5+ years of experience in Data Engineering or related field

  • Strong expertise in Databricks, including pipeline development, orchestration, and data architecture

  • Experience designing data models to support AI/ML applications

  • Proficiency in Python (PySpark) and SQL

  • Hands-on experience with Azure-based data environments

  • Experience with CI/CD tools such as Azure DevOps (ADO)

  • Ability to work independently with minimal oversight and ramp quickly in a fast-paced environment

  • Experience with Databricks Asset Bundles for deployment and environment management, preferred

  • Familiarity with transitioning CI/CD workflows to GitHub, preferred

  • Experience working in Agile development environments, preferred

  • Exposure to AI/ML workflows and data requirements for model development, preferred

What Success Looks Like

  • Efficient, scalable data pipelines supporting AI initiatives

  • Well-structured, high-quality datasets optimized for machine learning

  • Streamlined deployment and orchestration of Databricks assets across environments

  • Strong collaboration with stakeholders to deliver data solutions aligned with business needs

Similar Jobs

21 Hours Ago
In-Office or Remote
CA
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
16 Days Ago
Remote or Hybrid
CA
Senior level
Senior level
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
18 Days Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
eCommerce • Healthtech • Kids + Family • Retail • Social Media
Design, build, and scale Snowflake ingestion pipelines and ML/LLM systems. Create agentic tooling to generate, test, and maintain pipelines. Collaborate with analysts, data scientists, and product teams to deliver reliable, high-performance data infrastructure and operationalize models for an AI-first e-commerce platform.
Top Skills: Agentic WorkflowsAirflowAWSDbtEc2EksLambdaLlmsMcp ServersMl PipelinesPythonRag PipelinesS3Snowflake

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account