Position: Cloud Data Engineer
Role Overview
We are seeking an experienced Cloud Data Engineer to design,
build, optimize, and support enterprise-scale cloud data solutions. The
successful candidate will play a key role in developing end-to-end data
pipelines, implementing modern DataOps practices, and enabling scalable cloud-based
data platforms that support business and operational objectives.
This position requires expertise in cloud data engineering,
data migration, ETL/ELT development, automation, data warehousing, and
large-scale data transformation initiatives.
Key Responsibilities
- Design
and develop data pipelines from source systems through to end-user
consumption.
- Optimize
and maintain high-performance data pipelines.
- Develop
and manage cloud-based data platforms, data storage, and data exchange
solutions.
- Build,
orchestrate, deploy, and automate data workflows and pipelines.
- Develop
integrations across multiple platforms using various programming languages
and scripting techniques.
- Apply
DataOps principles, best practices, and Agile delivery methodologies.
- Implement
Continuous Integration and Continuous Deployment (CI/CD) processes and
automation.
- Support
data provisioning, data exchange, and data security initiatives.
- Design
and implement large-scale data migration and transformation solutions
across cloud environments.
- Develop
fact/dimension models, enterprise data warehouses, data lakes, and data
lakehouse architectures.
- Manage
cloud data services including storage repositories, data lakes,
lakehouses, key vaults, virtual machines, and related infrastructure.
- Support
structured, semi-structured, and unstructured data ingestion,
provisioning, and data exchange processes.
- Monitor,
troubleshoot, tune, and optimize DataOps solutions.
- Collaborate
with technical and business stakeholders to deliver scalable data
solutions.
Mandatory Skills & Experience (8+ Years)
- Design,
build, automate, and optimize complex ETL/ELT processes using Databricks,
Delta Live Tables (DLT), or equivalent technologies.
- Development
of unified data platforms using Databricks and Unity Catalog or
equivalent.
- Strong
experience with relational databases including Oracle, MySQL, and SQL
Server.
- Expertise
in relational and dimensional data modeling.
- Advanced
SQL development and query optimization.
- Experience
with data replication and database administration.
- Advanced
SQL skills including PL/SQL and T-SQL.
- Experience
working with Big Data processing frameworks such as PySpark.
- Proficiency
in Azure Data Factory pipeline development.
- Experience
building custom Databricks pipelines integrated with CI/CD processes and
Azure DevOps Git Integration.
- Experience
with data migration and integration across platforms including:
- Oracle
to Azure Data Lake
- Oracle
to Databricks
- Oracle
to Microsoft Fabric
Desired Skills & Experience
- Data
lake and lakehouse architecture design utilizing Medallion Architecture.
- Advanced
experience with Oracle databases, Azure SQL Server, and Azure Data
Factory.
- Experience
with cloud platforms including Azure, AWS, and Google Cloud Platform
(GCP).
- Strong
PL/SQL development skills for ETL solutions.
- Experience
troubleshooting, performance tuning, failover, recovery, and production
support.
- Experience
with Python, Unix Shell Scripting, and Scala.
Additional Information
- Hybrid
work arrangement.
- Candidates
should be available during standard business hours.
- Strong
analytical, problem-solving, communication, and stakeholder management
skills are required.
- Proven
ability to work independently as well as within collaborative project
teams.
- Experience
delivering enterprise data warehouse, data lake, and cloud modernization
initiatives is highly desirable.
About Symbiotic Digital.
Symbiotic Digital provides the IT Experts you need that
solve problems and get things done. See what the top 2% in their field can do
for you. (Symbiotic Digital is a division of Symbiotic Group Inc.)
We serve customers in two ways, we provide:
- Digital
Experts: IT Consulting expertise. Bright Minds That Produce Proven Results
- Recruitment:
Find The Right People You Need
Serving IT & Business leaders, Symbiotic Digital
provides a business system that enable us to provide the Expert Technical staff
needed to solve challenging business and IT problems. IT leaders in the most
reputable organizations in Canada have relied on Symbiotic Digital to help them
staff difficult assignments with proven Experts uniquely evaluated by our
proven QMS- Quality Management System Staff Development Model. We are a 100%
Indigenous owned company.
Learn more online at https://www.symbioticgroup.com/home-sd/.
Please submit your most recent resume to: [email protected]
View All Jobs online at: https://www.symbioticgroup.com/view-jobs/
