Develop scalable backend services using Java and Scala, design data pipelines, optimize jobs, and collaborate in Agile environments.
This is a remote position.
Project Description
A high-performance, distributed data processing platform built using Java and Scala to support real-time analytics and large-scale data transformation. The system ingests structured and unstructured data from multiple sources, processes it using scalable frameworks, and delivers insights to downstream applications.
The platform leverages Apache Spark for big data processing and integrates with microservices developed in Java. It is designed with a focus on fault tolerance, scalability, and low-latency processing to support enterprise-grade business intelligence and decision-making.
Roles & Responsibilities
- Develop and maintain scalable backend services using Java and Scala.
- Design and implement data pipelines using Apache Spark (RDD, DataFrame, Dataset APIs).
- Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
- Optimize performance of data processing jobs and ensure efficient memory utilization.
- Build RESTful APIs using Java frameworks like Spring Boot.
- Integrate data pipelines with messaging systems such as Apache Kafka.
- Write clean, modular, and testable code following best practices.
- Participate in code reviews, debugging, and troubleshooting production issues.
- Ensure application reliability through logging, monitoring, and alerting mechanisms.
- Work in Agile/Scrum environments and contribute to sprint planning and delivery.
Technical Requirements
Core Skills
- Strong proficiency in Java (8 or above) and Scala
- Hands-on experience with Apache Spark
- Good understanding of object-oriented and functional programming concepts
Frameworks & Tools
- Experience with Spring Boot / Spring ecosystem
- Knowledge of distributed systems and microservices architecture
- Familiarity with Apache Kafka or similar messaging systems
Data & Cloud
- Experience with SQL and NoSQL databases
- Exposure to big data ecosystems (Hadoop, Hive)
- Cloud platforms like AWS/Azure (preferred)
Other Skills
- Understanding of CI/CD pipelines (Jenkins, Git, etc.)
- Strong problem-solving and debugging skills
- Good communication and teamwork abilities
Nice-to-Have
- Experience with streaming data (Spark Streaming / Kafka Streams)
- Knowledge of containerization tools like Docker & Kubernetes
- Exposure to data warehousing and ETL processes
Similar Jobs
Gaming • Software
The Java Engineer will develop, integrate, and maintain web applications and microservices, while working with Java and various frameworks, responding to customer issues, and refactoring code.
Top Skills:
Apache StrutsApache TomcatApache VelocityAWSDockerJ2EeJava 8JSONKubernetesLinuxNetworking Protocols (HttpSoapSpring BootSpring FrameworkSQLTcpUdp)XML
HR Tech • Other • Professional Services
Train large language models to improve code quality by ranking, repairing, and refactoring code snippets while providing detailed explanations for feedback.
Top Skills:
Java
Artificial Intelligence • Software
The Senior Software Engineer at Behavox drives technical direction, leads architecture, implements Java solutions, and integrates AI-assisted engineering tools.
Top Skills:
Ai Tools (Claude CodeAWSAzureCodex)GCPJavaSpring FrameworkTerraform
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
