Provectus Logo

Provectus

Senior Data Engineer/ Tech lead (AWS)

Reposted 11 Days Ago
Hybrid
2 Locations
Senior level
Hybrid
2 Locations
Senior level
The Senior Data Engineer will design and manage data pipelines, work with diverse teams on data solutions, and engage in R&D initiatives.
The summary above was generated by AI
Provectus helps companies adopt ML/AI to transform the ways they operate, compete, and drive value. The focus of the company is on building ML Infrastructure to drive end-to-end AI transformations, assisting businesses in adopting the right AI use cases, and scaling their AI initiatives organization-wide in such industries as Healthcare & Life Sciences, Retail & CPG, Media & Entertainment, Manufacturing, and Internet businesses.

We are seeking a talented and experienced Data Engineer/Tech lead to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and will have the opportunity to contribute to the internal solutions, engage in R&D activities, providing an excellent environment for professional growth.

Requirements:

  •  5+ years of experience in data engineering;
  •  Experience in AWS;
  •  Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.;
  •  Proficiency in programming languages relevant to data engineering, such as Python and SQL;
  •  Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation;
  •  Experience in building scalable APIs;
  •  Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization;
  •  Upper-Intermediate or higher English skills;
  •  Ability to take ownership, solve problems proactively, and collaborate effectively in dynamic settings.

Nice to Have:

  • Experience with Cloud Data Platforms (e.g., Snowflake, Databricks);
  • Experience in building Generative AI Applications (e.g., chatbots, RAG systems);
  • Relevant AWS, GCP, Azure, Databricks certifications;
  • Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.);
  • Experience in building Data Solutions in a Data Mesh architecture.

Responsibilities:

  • Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals;
  •  Collect and manage large volumes of varied data sets;
  •  Work directly with ML Engineers to create robust and resilient data pipelines that feed Data Products;
  •  Define data models that integrate disparate data across the organization;
  •  Design, implement, and maintain ETL/ELT data pipelines;
  •  Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently;
  •  Develop, continuously test, and deploy Data API Products with Python and frameworks like Flask or FastAPI.

What you'll get:

  • Long-term B2B collaboration;
  • Hybrid setup with access to our Wroclaw office;
  • Paid vacations and sick leaves;
  • Public holidays;
  • Medical insurance or sports coverage;
  • External and Internal educational opportunities and AWS certifications;
  • A collaborative local team and international project exposure.

Top Skills

Airflow
Apache Druid
AWS
Aws Cloudformation
Azure
Dagster
Databricks
Dbt
Fastapi
Flask
GCP
Kafka
Python
Snowflake
Spark
SQL
Terraform

Similar Jobs

4 Minutes Ago
Remote or Hybrid
Ottawa, ON, CAN
Mid level
Mid level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
The Government Account Executive will manage growth in assigned government accounts, drive corporate strategies, and develop C-level relationships. Responsibilities include creating strategic plans and executing sales strategies with a virtual team and engaging customers with the Dynatrace platform.
Top Skills: Cloud TechnologiesDavis Hypermodal Ai
22 Minutes Ago
Easy Apply
Hybrid
Toronto, ON, CAN
Easy Apply
Mid level
Mid level
Big Data • Cloud • Software • Database
This role involves content creation, customer communication, and collaboration across teams to modernize solutions for enterprise clients using MongoDB's platform.
Top Skills: Cloud ProvidersData AnalyticsData ScienceDatabase ProgrammingMongoDB
An Hour Ago
Hybrid
13 Locations
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead Varicent implementation projects, leveraging cloud technologies, ensuring timely delivery, coaching teams, and collaborating with clients for successful sales performance solutions.
Top Skills: AWSAzureDatabricksGCPPower BIRedshiftSnowflakeSQLVaricent

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account