The Senior Data Engineer will build and optimize data pipelines, collaborate with engineering teams, and ensure data quality and scalability.
At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently looking for a Business Development Executive to join one of our clients' team. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.
We are looking for a skilled Senior Data Engineer. This role, you will be responsible for building scalable data pipelines, working with large datasets, and optimizing data workflows in a cloud-based environment. You will collaborate closely with data and engineering teams to ensure efficient and reliable data processing.
Key Responsibilities
- Design, build, and maintain robust data pipelines (ETL/ELT)
- Work with Databricks for large-scale data processing using Spark and Delta Lake
- Optimize data workflows, performance, and data storage solutions
- Collaborate with cross-functional teams including data analysts, engineers, and stakeholders
- Ensure data quality, reliability, and scalability across systems
- Contribute to continuous improvement of data architecture and processes
Job requirements
- Strong experience with Databricks (Spark / Delta Lake)
- Proficiency in Python for data processing
- Strong knowledge of SQL
- Hands-on experience with ETL/ELT pipeline development
- Experience with at least one cloud platform (AWS, Azure, or GCP)
- Familiarity with Git and basic CI/CD practices
Nice to Have
- Experience with dbt
- Knowledge of streaming technologies (e.g., Kafka or similar)
- Experience with Terraform or Infrastructure as Code (IaC)
Top Skills
AWS
Azure
Ci/Cd
Databricks
Dbt
Delta Lake
GCP
Git
Kafka
Python
Spark
SQL
Terraform
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
The Senior Data Engineer at Dynatrace will design and build data pipelines for analytics and applications, ensuring data reliability and efficiency across various platforms.
Top Skills:
PythonSnowflakeSQL
Information Technology
The Senior Data Engineer designs and supports databases for a large-scale IVR platform, ensuring data availability, performance, and stability while collaborating with various engineering teams.
Top Skills:
Amazon Aurora MysqlAmazon RedshiftSparkAWSCi/CdCloudFormationDockerGitGitInfrastructure As CodeKafkaKubernetesPostgresPythonSpark StreamingSQLTerraform
Marketing Tech
As a Senior Data Engineer, you will build and optimize data pipelines, enhance AWS data infrastructure, and collaborate with teams to deliver reliable data solutions.
Top Skills:
Apache IcebergAthenaAWSDbtGluePolarsPysparkPythonS3SQL
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
