Labelbox Logo

Labelbox

Director of Data Quality, Gen AI

Posted 11 Days Ago
Be an Early Applicant
7 Locations
Senior level
7 Locations
Senior level
As the Director of Data Quality, you will lead and mentor the QA team, implement and optimize QA policies, drive process improvements, and align QA objectives with business strategies to ensure the highest quality training data for generative AI applications.
The summary above was generated by AI

Labelbox is the data factory for generative AI, providing the highest quality training data for frontier and task-specific models. Labelbox’s comprehensive platform combines on-demand labeling services with the industry-leading data labeling platform. The Boost labeling service is powered by the Alignerr community of highly-educated experts, who span all major languages and a diverse range of advanced subjects. They are available on-demand to rapidly generate new data for supervised fine-tuning, RLHF, and more. Labelbox’s software-first approach delivers unmatched control and transparency into the labeling process, leading to the generation of high-quality, consistent data at scale.

Labelbox is backed by leading investors including SoftBank, Andreessen Horowitz, B Capital, Gradient Ventures, Databricks Ventures, and Kleiner Perkins. Our customers include Fortune 500 enterprises and leading AI labs.

Your Day to Day

  • Recruit, train, and mentor a high-performing QA team.

  • Foster a culture of excellence, accountability, and continuous learning.

  • Design, implement, and optimize QA policies and procedures.

  • Apply advanced QC/QA methods, such as consensus scoring and statistical process control, to ensure quality standards. Identify workflow inefficiencies and implement best practices to enhance efficiency and reduce errors.

  • Drive initiatives for process improvements and automation in QA.

  • Develop long-term quality strategies aligned with company goals and industry trends.

  • Align QA objectives with overall business strategy.

  • Work with operations, product, engineering, and client teams to optimize annotation guidelines and processes.

  • Represent the QA function in client meetings and strategy sessions. Analyze quality metrics and KPIs to drive decision-making.

  • Prepare and present detailed reports to senior management.

  • Maintain compliance with industry standards and regulatory requirements. Stay updated on advancements in QA technologies and methodologies.

About You

  • Bachelor’s or Master’s degree in Data Science, Computer Science, Quality Management, or a related field.

  • Minimum of 5 years in quality management, particularly in data annotation or related industries.

  • Proven track record of leading QA teams and scaling processes in fast-paced environments.

  • Expert knowledge of QC/QA methods, including consensus scoring, Inter-Rater Reliability (IRR), and statistical process control.

  • Familiarity with data annotation tools, machine learning workflows, and statistical analysis software.

  • Experience with automation and AI-driven quality assurance tools is a plus.

  • Certifications such as Six Sigma Black Belt or ISO Quality Management are highly desirable.

  • Exceptional leadership, team-building, and communication skills.

  • Strong problem-solving and analytical abilities, with an innovative and data-driven mindset.

  • High adaptability and effectiveness in a fast-paced, client-centric environment.

Labelbox strives to ensure pay parity across the organization and discuss compensation transparently.  The expected annual base salary range for United States-based candidates is below. This range is not inclusive of any potential equity packages or additional benefits. Exact compensation varies based on a variety of factors, including skills and competencies, experience, and geographical location.

Annual base salary range

$195,000$230,000 USD

Your Personal Data Privacy: Any personal information you provide Labelbox as a part of your application will be processed in accordance with Labelbox’s Job Applicant Privacy notice.

Any emails from Labelbox team members will originate from a @labelbox.com email address. If you encounter anything that raises suspicions during your interactions, we encourage you to exercise caution and suspend or discontinue communications.

Top Skills

Computer Science
Data Science

Similar Jobs

Be an Early Applicant
3 Hours Ago
Toronto, ON, CAN
20,000 Employees
Expert/Leader
20,000 Employees
Expert/Leader
Food • Retail • Agriculture • Manufacturing
The Director of Data Platform Governance will lead the development and implementation of a governance strategy for Enterprise data assets, ensuring data quality, privacy, and security. The role involves collaborating with cross-functional teams to drive data governance solutions across McCain's business units and establish metrics for data quality. Additionally, the Director will oversee compliance with relevant regulations and establish frameworks for AI governance.
Be an Early Applicant
4 Hours Ago
8 Locations
Remote
Hybrid
12,000 Employees
Senior level
12,000 Employees
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The Senior Machine Learning Engineer will design and implement ML pipelines and services to combat fraud in Cash App's banking products. This role involves developing next-generation ML solutions and collaborating with data scientists and software engineers to enhance security and user experience across a growing financial service platform.
Be an Early Applicant
4 Hours Ago
Toronto, ON, CAN
Hybrid
90,000 Employees
Entry level
90,000 Employees
Entry level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Cycle Counter / Plant Logistics Analyst ensures accurate inventory records through cycle counting and collaboration with teams. Responsibilities include managing logistics operations, analyzing stock discrepancies, maintaining SAP compliance, and improving inventory management processes. The role requires strong attention to detail and effective communication.

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account