The Senior Data Engineer will design and manage data pipelines, work with diverse teams on data solutions, and engage in R&D initiatives.
Provectus helps companies adopt ML/AI to transform the ways they operate, compete, and drive value. The focus of the company is on building ML Infrastructure to drive end-to-end AI transformations, assisting businesses in adopting the right AI use cases, and scaling their AI initiatives organization-wide in such industries as Healthcare & Life Sciences, Retail & CPG, Media & Entertainment, Manufacturing, and Internet businesses.
We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and will have the opportunity to contribute to the internal solutions, engage in R&D activities, providing an excellent environment for professional growth.
Requirements:
- 5+ years of experience in data engineering;
- Experience in AWS;
- Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.;
- Proficiency in programming languages relevant to data engineering, such as Python and SQL;
- Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation;
- Experience in building scalable APIs;
- Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization;
- Upper-Intermediate or higher English skills;
- Ability to take ownership, solve problems proactively, and collaborate effectively in dynamic settings.
Nice to Have:
- Experience with Cloud Data Platforms (e.g., Snowflake, Databricks);
- Experience in building Generative AI Applications (e.g., chatbots, RAG systems);
- Relevant AWS, GCP, Azure, Databricks certifications;
- Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.);
- Experience in building Data Solutions in a Data Mesh architecture.
Responsibilities:
- Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals;
- Collect and manage large volumes of varied data sets;
- Work directly with ML Engineers to create robust and resilient data pipelines that feed Data Products;
- Define data models that integrate disparate data across the organization;
- Design, implement, and maintain ETL/ELT data pipelines;
- Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently;
- Develop, continuously test, and deploy Data API Products with Python and frameworks like Flask or FastAPI.
What you'll get:
- Long-term B2B collaboration;
- Hybrid setup with access to our Wroclaw office;
- Paid vacations and sick leaves;
- Public holidays;
- Medical insurance or sports coverage;
- External and Internal educational opportunities and AWS certifications;
- A collaborative local team and international project exposure.
Top Skills
Airflow
Apache Druid
AWS
Aws Cloudformation
Azure
Dagster
Databricks
Dbt
Fastapi
Flask
GCP
Kafka
Python
Snowflake
Spark
SQL
Terraform
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Senior Technical Consultants design solutions using ServiceNow, guide customers through implementation, and mentor junior staff. They leverage expertise in AI and ITOM modules to improve customer processes.
Top Skills:
AIBacnetDnp3Ethernet/IpHypervisorsIec 60870-5-104ModbusOpc Ua/DaProfinetServicenowSiemens S7Virtualization
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Assist the Human Resources Team with administrative support, onboarding, employee recognition, and communication while maintaining confidentiality and complying with safety regulations.
Top Skills:
Spreadsheet SoftwareWord Processing Software
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
The Quality Engineer manages quality assurance programs, ensures adherence to specifications, oversees cross-functional teams, and leads problem-solving initiatives for quality issues.
Top Skills:
CadGd&TSpcSqc
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.