The job involves designing, developing, and enhancing the AWS data environment. Responsibilities include setting up AWS Data Platform, building scalable Data Lake solutions, and troubleshooting complex Data Pipelines. It requires expertise in data engineering and leading proofs-of-concept to production.
Company Description
Webtellect is an established software consulting firm. We are equivalent to the finest "custom home builders" as it applies to software. We build software for those companies who have funding but not the resources or for those companies who have the resources but not bandwidth. We analyze, design, develop, test, deploy, maintain, and learn from our engagements to improve for the next. We all share a passion and joy for software excellence. As such, Webtellect consultants are highly coveted.
Job Description
To design, development, and enhancement of our AWS data environment.
Qualifications
- Experience setting up AWS Data Platform – AWS CloudFormation, DevelopmentEndPoints, AWS Glue, EMR and Jupyter/Sagemaker Notebooks, Redshift, S3, and EC2 instances.
- Track record of successfully building scalable Data Lake solutions that connects to distributed data storage using multiple data connectors.
- Must have a background in data engineering – Data Warehouse Development experience would be perfect
- Must have strong skills in SQL, Python, PySpark, and AWS
- Experience in designing, developing, optimizing and troubleshooting complex Data Pipelines using Spark cluster
- Ability to lead proofs-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
- Serve as an expert; envision and integrate emerging data technologies, anticipate new trends to solve complex business and technical problems.
Additional Information
Notes:
- 6 month contract.
- ** No 3rd parties. **
- ** No Visas allowed **
Top Skills
AWS
Pyspark
Python
SQL
Similar Jobs
The AWS/Azure Cloud Data Engineer will work with clients to enhance data loading platforms (ETL/data pipelines) and ensure data quality, implement CI/CD pipelines, and manage data migration using AWS services. Collaboration with the Cloud Data Architect is key as well as problem-solving complex SQL and access management issues in various RDBMS environments.
As a Senior Data Engineer at Arcadia, you will design and develop data pipeline connectors for healthcare data integration, manage technical documentation, participate in team projects, code reviews, and scrum ceremonies, while ensuring timely delivery of solutions and collaborating with various internal teams to enhance analytic capabilities.
Be an Early Applicant
The Data Center Selection Manager will enhance the effectiveness and cost-efficiency of colocation sites/PoPs, managing vendor relationships, negotiating contracts, and working with cross-functional teams to support infrastructure growth. This role requires multitasking across various projects and maintaining strong communication with stakeholders.
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
