The AWS DataHub Developer will design real-time data services, build Kafka streaming pipelines, and integrate AWS data services, focusing on high scalability and resilience.
About the Role
Our client is seeking a Senior AWS DataHub Developer to design and build real-time, event-driven data services on AWS. This role is developer-first (application-side) rather than infrastructure-led. You will architect and deliver Kafka-based streaming pipelines and serverless data applications that ingest, transform, and serve data at scale.
You’ll collaborate with architects, data engineers, and product teams to deliver secure, resilient, observable, and highly scalable solutions that power enterprise-grade analytics and event-driven applications.
What You’ll Do (Key Responsibilities)
- Design & Deliver Event-Driven Pipelines: Build serverless data flows using AWS Lambda, Step Functions, EventBridge, SNS, SQS, API Gateway.
- Real-Time Streaming: Develop Kafka (Apache Kafka/Amazon MSK) consumers/producers for high-throughput, low-latency streaming and decoupled microservices.
- Microservices & APIs: Build and optimize TypeScript (preferred) or Python services/APIs for data ingestion, transformation, and delivery.
- AWS Data Services Integration: Work with S3, DynamoDB, Glue, Athena, CloudWatch for storage, metadata, querying, and observability.
- Quality & Reliability: Implement idempotency, retries, dead-letter queues, exactly-once/at-least-once semantics where appropriate, and schema evolution strategies.
- CI/CD & Testing: Use Git-based workflows and CI/CD (e.g., GitHub Actions, Jenkins) with automated tests (unit/integration/load) and infrastructure deployments.
- IaC (Developer View): Define application-layer infrastructure using AWS CDK, Terraform, or CloudFormation—with strong emphasis on developer productivity and repeatability.
- Agile Collaboration: Contribute to technical design, story sizing, peer reviews, and continuous improvement.
Ideal Candidate Profile
- You are a cloud-native, application-side developer who thinks in events, streams, and services—not servers. You design for resiliency, observability, and scale, and you’re comfortable pairing Kafka with AWS serverless to deliver business outcomes.
Top Skills
AWS
Aws Api Gateway
Aws Athena
Aws Cdk
Aws Cloudwatch
Aws Dynamodb
Aws Eventbridge
Aws Glue
Aws Lambda
Aws S3
Aws Sns
Aws Sqs
Aws Step Functions
CloudFormation
Github Actions
Jenkins
Kafka
Python
Terraform
Typescript
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Customer Success Manager, you will support customers in achieving their business goals with ServiceNow products by providing guidance, ensuring technical health, and fostering product adoption.
Top Skills:
AIServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Customer Success Manager advocates for customers, ensuring they achieve business outcomes, maximize value from ServiceNow products, and manage engagements effectively.
Top Skills:
Ai-Powered ToolsServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Senior Business Process Consultant, you will improve processes, coach junior team members, and leverage ServiceNow ITAM expertise to enhance customer engagements and workflows.
Top Skills:
Hardware Asset Management (Ham)It Asset Management (Itam)ServicenowSoftware Asset Management (Sam)
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
