Allstate Logo

Allstate

Big Data Engineer Senior Consultant II

Reposted 8 Days Ago
Be an Early Applicant
In-Office
Floors, Oakview, MB
Senior level
In-Office
Floors, Oakview, MB
Senior level
Responsible for delivering Big Data solutions, developing data pipelines, ensuring data quality, modernizing architecture, and mentoring team members.
The summary above was generated by AI

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

This role is responsible for driving multiple complex tracks of work to deliver Big Data solutions enabling advanced data science and analytics. This includes working with the team on new and Advanced Data Platforms and systems for analyzing data, Profiling data, coding & development of advanced analytics solutions and Data Pipelines to help business make optimal decisions, The role is responsible for Triaging Incidents, ensuring Data Quality and modernizing the existing Data Architecture. The role is responsible for assisting in the selection and development of other team members.

Job Description

This role is responsible for driving multiple complex tracks of work to deliver Big Data solutions enabling advanced data science and analytics. This includes working with the team on new and Advanced Data Platforms and systems for analyzing data, Profiling data, coding & development of advanced analytics solutions and Data Pipelines to help business make optimal decisions, The role is responsible for Triaging Incidents, ensuring Data Quality and modernizing the existing Data Architecture. The role is responsible for assisting in the selection and development of other team members.

Skills Primarily:

Python & SQL: Strong understanding of python ecosystem and conversant with Data modeling

Scala & Spark: Strong in functional programming and big data processing using Spark.

Strong Data Engineering experience
Good Hands-on with MongoDB

Cloud: Experience working with AWS and Azure
CAAS: Experience with Docker, Kubernetes, and deploying containerized apps.
Tools: Git, CI/CD, JSON, SBT/Maven, Agile methodologies.

Primary Skills

Python, Apache Spark, SQL, Data Engineering, CI/CD, Docker, AWS, Azure, Git, Influencing Others, MongoDB, Multithreading, RESTful APIs, Scala

Key Responsibilities

  • Develops data pipelines that support Real-time Decisions
  • Follows Data Engineering best practices while designing and implementing solutions
  • Participates in the development of complex prototypes and applications that integrate Hybrid Cloud Services
  • Pair closely with team members on solutions for our data science community and analytic users
  • Supports Innovation; regularly provides new ideas to improve our processes, and technology that interact with analytic ecosystem
  • Collaborate with enterprise teams to explore new patterns to solve complex business problems
  • Ensures that the system adheres to agreed SLAs
  • Passionate about learning new tech stack

Primary Skills

Shift Time

Recruiter Info

Sunita M

[email protected]

About Allstate

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger – a winning team making a meaningful impact.

The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.

Learn more about Allstate India here.

Top Skills

AWS
Azure
Ci/Cd
Docker
Git
Kubernetes
MongoDB
Python
Scala
Spark
SQL

Similar Jobs

Yesterday
Easy Apply
Hybrid
7 Locations
Easy Apply
Expert/Leader
Expert/Leader
Big Data • Cloud • Software • Database
Design and build components for a distributed database, enhance user features, collaborate across teams, and mentor new members.
Top Skills: C++JavaScriptPython
Yesterday
Hybrid
2 Locations
Senior level
Senior level
Cloud • Insurance • Professional Services • Analytics • Cybersecurity
The Account Manager, Risk Engineering is responsible for managing complex risk assessments, collaborating with teams, and providing expert risk control guidance.
Top Skills: Microsoft Office SuiteRisk Assessment Tools
2 Days Ago
Remote or Hybrid
6 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves incident response consultations, conducting forensic investigations, and communicating findings to clients. Candidates must manage incidents and utilize advanced forensic techniques.
Top Skills: AWSAzureBro/ZeekGCPSuricata

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account