Design and architect large-scale distributed Big Data solutions using Java, Spark, and Hadoop/Cloudera. Lead global teams to build high-volume data processing and analytics pipelines, ensure robust testing (JUnit), and apply scripting for automation and data analysis.
Qualifications
- Minimum 15+ years of relevant experience in applications development
- Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics.
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloudera distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
Fintech • Financial Services
In this role, you will analyze portfolio performance, assess risk strategies, and report insights to management, aiding business growth.
Top Skills:
ExcelPythonSQLTableau
Fintech • Financial Services
The Senior Analyst, Portfolio Strategy will provide insights to drive business growth, manage portfolio risk, and analyze pricing and profitability.
Top Skills:
ExcelMicrosoft PowerpointPythonSQLTableau
Fintech • Financial Services
The Sales Development Representative engages with SMB owners to drive lead conversion by addressing their concerns and presenting funding options. They manage high call volumes, track lead activity in Salesforce, and collaborate with other teams to improve the sales funnel.
Top Skills:
DialpadSalesforceTableau
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
