Develop and maintain scalable big data pipelines using Python, PySpark, Spark SQL, and ETL workflows. Process structured and unstructured data across distributed systems and cloud or on-premises environments. Optimize Spark jobs, maintain unit tests, monitor pipeline reliability, troubleshoot issues, and collaborate with engineers, analysts, and stakeholders to deliver efficient data solutions.
JD: Develop and maintain scalable data pipelines using PySpark and Spark SQL for processing large datasets efficiently. Write clean, reusable, and optimized code in Python for data manipulation, analysis, and automation tasks. Design and implement ETL workflows to extract, transform, and load data from various structured and unstructured sources. Collaborate with data engineers, analysts, and stakeholders to understand data requirements and deliver solutions. Optimize Spark jobs for performance tuning, resource utilization, and minimizing execution time. Work with distributed computing frameworks to process and analyze big data in a cloud or on-premises environment. Develop and maintain unit tests to ensure the accuracy and reliability of data pipelines and transformations. Utilize Spark SQL for querying and managing large datasets stored in distributed systems like Hadoop or cloud storage. Monitor and troubleshoot data pipeline issues, ensuring reliability and timely delivery of data. Stay updated with the latest advancements in PySpark, Spark SQL, and big data technologies to improve existing systems.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Develop into an outbound Account Development Representative through structured training and on-the-job learning. Respond to prospective customer inquiries, book product demonstrations, identify new business opportunities, collaborate with ADRs and Account Executives, and maintain accurate lead records in Salesforce. The role requires motivation for target-driven sales, curiosity, strong English proficiency, and a growth mindset. Prior sales or cold-calling experience is beneficial but not required.
Top Skills:
Internet Of Things (Iot)SaaSSalesforce
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Generate and qualify enterprise sales opportunities for Samsara’s IoT and connected operations platform. Responsibilities include researching and mapping accounts, prospecting, making approximately 50 cold calls daily, building demand, engaging executives, learning customer operations, and collaborating with teammates. The role offers a path toward closing sales positions and requires resilience, curiosity, and a growth mindset.
Top Skills:
Artificial Intelligence (Ai)Internet Of Things (Iot)Linkedin Sales NavigatorSaaSSalesforceZoominfo
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Onboard and activate Square sellers by leading scoping calls, delivering tailored training, tracking milestones, resolving blockers, and ensuring timely go-live. Manage 20–30 concurrent onboarding engagements while maintaining product expertise, communicating proactively, escalating complex issues, and contributing to process improvements. Collaborate with sales, account management, product, and marketing teams, use AI to improve workflows, and support sellers across POS, online, and integration products.
Top Skills:
Ai Tools And PlatformsLookerPos SystemsSalesforceSquare
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.
