Scribd Logo

Scribd

Software Engineer II (Backend + Data pipelines)

Reposted 4 Hours Ago
In-Office
23 Locations
Mid level
In-Office
23 Locations
Mid level
The Software Engineer II will design and optimize distributed systems for processing metadata, collaborating closely with cross-functional teams to integrate machine learning models into production pipelines.
The summary above was generated by AI

Scribd, Inc. is on a mission to advance human understanding. Our four products — Scribd®, Slideshare®, Everand™, and Fable — help billions of people across the globe move beyond access and into insight, application, and expertise.

Culture at Scribd, Inc.

We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.

We believe the best work happens when individual flexibility is balanced with meaningful community connection. Scribd Flex empowers employees to choose the workstyle and location that support their best performance, while committing to intentional in-person moments that strengthen collaboration and culture. Occasional in-person attendance is required for all Scribd, Inc. employees, regardless of location.

So what are we looking for in new team members? At Scribd, Inc., we hire for “GRIT.” Traditionally defined as the intersection of passion and perseverance toward long-term goals, GRIT reflects the mindset we expect from every employee. For us, it also serves as a practical framework for how we work: setting and achieving Goals, delivering Results within your role, contributing Innovative ideas and solutions, and strengthening the broader Team through collaboration and attitude.

This posting reflects an approved, open position within the organization.

About the team:

The ML Data Engineering team powers metadata extraction, enrichment, and content understanding across all Scribd brands. We process hundreds of millions of documents, billions of images, and deliver high-quality metadata to enable content discovery and trust for millions of users worldwide.

Our systems operate at massive scale, supporting diverse datasets like user-generated content (UGC), ebooks, audiobooks, and more. We work at the intersection of machine learning, data engineering, and distributed systems, collaborating closely with applied research and product teams to deploy scalable ML and LLM-powered solutions in production.

Role Overview:

We’re seeking a Software Engineer II with strong backend development experience and a passion for solving complex data challenges at scale. In this role, you’ll design, build, and optimize distributed systems that extract, enrich, and process metadata for a wide range of content. You’ll work closely with ML engineers, product managers, and cross-functional partners to integrate machine learning models and LLM-based services into production pipelines and deliver impactful, high-performance solutions. This role offers the opportunity to work on cutting-edge generative AI and metadata enrichment problems at a truly global scale.

Tech Stack:

Our team uses various technologies. The following are the ones that we use on a regular basis: Python, Scala, Ruby on Rails, Airflow, Databricks, Spark, HTTP APIs, AWS (Lambda, ECS, SQS, ElastiCache, Sagemaker, Cloudwatch, Datadog) and Terraform.

Key Responsibilities:

  • Design and build scalable systems to extract, enrich, and process metadata from millions of documents, images, and audio content.

  • Leverage LLMs to integrate capabilities like summarization, classification, extraction, and enrichment into metadata pipelines.

  • Collaborate with cross-functional teams, including ML engineers and product managers, to deliver scalable, efficient, and reliable metadata solutions.

  • Optimize and refactor existing systems for performance, scalability, and reliability.

  • Ensure data accuracy, integrity, and quality through automated validation and monitoring.

  • Participate in code reviews, ensuring best practices are followed and maintaining high-quality standards in the codebase.

  • Manage and maintain data pipelines, security and infrastructure

Requirements:

  • 5+ years of professional software engineering experience

  • Proficiency in Python, Scala, Ruby, or similar languages

  • Experience designing and building distributed systems at scale

  • Hands-on experience building, deploying, and optimizing solutions using ECS, EKS, or AWS Lambda

  • Experience with infrastructure-as-code tools like Terraform (or similar)

  • Experience working with a public cloud provider (AWS, Azure, or Google Cloud)

  • Familiarity with data processing frameworks like Spark or Databricks for large-scale workloads

  • Proven ability to test, profile, and optimize systems for performance, scalability, and reliability

  • Bachelor’s degree in Computer Science or equivalent professional experience

  • Bonus: Experience working with LLMs or integrating ML models into production systems

At Scribd, Inc., your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role, level, and geographic location. San Francisco is our highest geographic market in the United States.

In the state of California, the reasonably expected salary range is between $126,000 [minimum salary in our lowest geographic market within California] to $196,000 [maximum salary in our highest geographic market within California].

In the United States, outside of California, the reasonably expected salary range is between $103,500 [minimum salary in our lowest US geographic market outside of California] to $186,500 [maximum salary in our highest US geographic market outside of California].

In Canada, the reasonably expected salary range is between $131,500 CAD[minimum salary in our lowest geographic market] to $174,500 CAD[maximum salary in our highest geographic market].

We carefully consider a wide range of factors when determining compensation, including but not limited to experience; job-related skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership, and a comprehensive and generous benefits package.

Working at Scribd, Inc.

Are you currently based in a location where Scribd, Inc. can employ you?
Employees must have their primary residence in or near one of the following cities. This includes surrounding metro areas or locations within a typical commuting distance:


United States:

Atlanta | Austin | Boston | Dallas | Denver | Chicago | Houston | Jacksonville | Los Angeles | Miami | New York City | Phoenix | Portland | Sacramento | Salt Lake City | San Diego | San Francisco | Seattle | Washington D.C.

Canada:

Ottawa | Toronto | Vancouver

Mexico:

Mexico City

Benefits at Scribd, Inc.

  • Scribd Flex (flexible work model)

  • Comprehensive health, dental, and vision coverage

  • Mental health support and disability coverage

  • Generous paid time off, including vacation, sick time, holidays, winter break, volunteer time, and sabbaticals

  • Paid parental leave and family support benefits

  • Retirement matching and employee equity

  • Learning and development programs and professional growth opportunities

  • Wellness and home office stipends

  • Complimentary access to the Scribd, Inc. suite of products

  • Enterprise access to leading AI tools

Get to Know Scribd, Inc.
About Scribd, Inc.
Life at Scribd, Inc.

We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing [email protected] about the need for adjustments at any point in the interview process.

Scribd, Inc. is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.

Top Skills

Airflow
AWS
Databricks
Http Apis
Python
Ruby
Scala
Spark
Terraform

Similar Jobs

30 Minutes Ago
Hybrid
14 Locations
Expert/Leader
Expert/Leader
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The Senior Manager oversees AI and GenAI data science teams, driving complex analytics projects, coaching teams, and ensuring high-quality solutions. Responsibilities include managing GenAI development, collaborating with clients, presenting findings, and leading business development activities.
Top Skills: AWSAzureCi/CdGitGCPLangchainNltkNoSQLPandasPythonSemantic KernelSQL
30 Minutes Ago
Hybrid
42 Locations
Senior level
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Senior Developer, you'll lead the development of software solutions, manage a team, and ensure quality deliverables that meet client needs.
Top Skills: .Net/C#Ai PromptingAngularAuthenticationCloud TechnologiesDevOpsMicro Front EndsMicro ServicesRest ApisSQL Server
Mid level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The Safety Modeling Engineer will develop and analyze models to assess collision outcomes and severity for automated driving systems, using statistical and machine learning methods.
Top Skills: Ci/CdDockerGitJenkinsJIRAKubernetesPoetryPythonSQLTerraform

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account