Provectus Logo

Provectus

Senior Data Engineer/ Tech lead (AWS)

Reposted 8 Days Ago
Hybrid
2 Locations
Senior level
Hybrid
2 Locations
Senior level
The Senior Data Engineer will design and manage data pipelines, work with diverse teams on data solutions, and engage in R&D initiatives.
The summary above was generated by AI
Provectus helps companies adopt ML/AI to transform the ways they operate, compete, and drive value. The focus of the company is on building ML Infrastructure to drive end-to-end AI transformations, assisting businesses in adopting the right AI use cases, and scaling their AI initiatives organization-wide in such industries as Healthcare & Life Sciences, Retail & CPG, Media & Entertainment, Manufacturing, and Internet businesses.

We are seeking a talented and experienced Data Engineer/Tech lead to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and will have the opportunity to contribute to the internal solutions, engage in R&D activities, providing an excellent environment for professional growth.

Requirements:

  •  5+ years of experience in data engineering;
  •  Experience in AWS;
  •  Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.;
  •  Proficiency in programming languages relevant to data engineering, such as Python and SQL;
  •  Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation;
  •  Experience in building scalable APIs;
  •  Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization;
  •  Upper-Intermediate or higher English skills;
  •  Ability to take ownership, solve problems proactively, and collaborate effectively in dynamic settings.

Nice to Have:

  • Experience with Cloud Data Platforms (e.g., Snowflake, Databricks);
  • Experience in building Generative AI Applications (e.g., chatbots, RAG systems);
  • Relevant AWS, GCP, Azure, Databricks certifications;
  • Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.);
  • Experience in building Data Solutions in a Data Mesh architecture.

Responsibilities:

  • Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals;
  •  Collect and manage large volumes of varied data sets;
  •  Work directly with ML Engineers to create robust and resilient data pipelines that feed Data Products;
  •  Define data models that integrate disparate data across the organization;
  •  Design, implement, and maintain ETL/ELT data pipelines;
  •  Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently;
  •  Develop, continuously test, and deploy Data API Products with Python and frameworks like Flask or FastAPI.

What you'll get:

  • Long-term B2B collaboration;
  • Hybrid setup with access to our Wroclaw office;
  • Paid vacations and sick leaves;
  • Public holidays;
  • Medical insurance or sports coverage;
  • External and Internal educational opportunities and AWS certifications;
  • A collaborative local team and international project exposure.

Top Skills

Airflow
Apache Druid
AWS
Aws Cloudformation
Azure
Dagster
Databricks
Dbt
Fastapi
Flask
GCP
Kafka
Python
Snowflake
Spark
SQL
Terraform

Similar Jobs

5 Hours Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
The role involves creating and animating Bitmoji content, leading projects, mentoring team members, and ensuring quality animation aligned with technical requirements.
Top Skills: Adobe After EffectsAdobe Premiere ProLens StudioMaya
5 Hours Ago
Hybrid
Toronto, ON, CAN
Senior level
Senior level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
The role involves leading 3D modeling projects for Bitmoji avatars, ensuring high-quality artistic output, and mentoring team members.
Top Skills: MayaPhotoshopSubstance PainterZbrush
6 Hours Ago
Hybrid
Ottawa, ON, CAN
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
Lead the compliance program for an investment dealer, oversee regulatory relationships, manage compliance policies, and provide guidance on compliance-related matters.
Top Skills: Anti-Money Laundering Legislation (Pcmltfa)Ciro RulesNational Instruments

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account