Sully.ai Logo

Sully.ai

Head of Engineering, QA

Reposted 2 Days Ago
In-Office or Remote
8 Locations
Senior level
In-Office or Remote
8 Locations
Senior level
As Head of Engineering, QA, lead the QA strategy, build automation, ensure reliability, and grow a high-performing QA team in an AI healthcare startup.
The summary above was generated by AI

About Us
👏 Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.
🔥 Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
📈 400+ healthcare orgs signed in 16 months.
⚡️ $25M raised from YC, Amity Ventures, Sequoia scouts, and more.
🌎 $1T+ market opportunity. We’re going after all of it.

About the Role
We are seeking a Head of Engineering, QA to build Sully.ai’s QA function from the ground up—owning strategy, automation, and execution. This is a 0→1 role: you’ll set the framework for functional, performance, and compliance testing, scale automation across our stack, and ensure our AI medical employees are safe, reliable, and high-performing. You will also recruit and mentor a team, embedding QA into CI/CD pipelines to enable fast, clinical-grade releases.

Key Responsibilities

  • Own QA strategy, defining frameworks for automation, functional, performance, and compliance testing

  • Build and scale Playwright-based test automation for UI and API coverage

  • Ensure reliability by expanding automation coverage, monitoring dashboards, and resolving test failures quickly

  • Guarantee accuracy, security, and compliance (HIPAA/SOC-2), partnering with Engineering and Clinical teams

  • Recruit, mentor, and lead a high-performing QA team

  • Embed QA into CI/CD pipelines using GitHub Actions and related tooling

Hard Requirements

  • Founder / 0→1 experience — first in function, building QA processes and teams from scratch

  • 6–8+ years in QA with strong expertise in Playwright

  • 3–4+ years of people leadership experience

  • Proven ability to automate functional UI and API test cases

  • Hands-on with QA tools (Playwright, Cypress, PyTest, Postman)

  • Experience scaling test automation and maintaining reliability

  • Highly motivated, driven, and ownership-oriented

Nice-to-Have

  • Experience testing AI/LLM workflows

  • Familiarity with dashboarding and observability tooling

  • GitHub Actions CI/CD integration experience

  • Prior startup or healthcare QA background

First-Month Focus

  • Define Sully.ai’s QA strategy and initial automation framework

  • Implement core Playwright test cases across key workflows

  • Partner with Engineering and Clinical teams to validate compliance needs

Success OKRs (90 Days)

  • Establish automated test coverage across UI and API workflows

  • Integrate QA pipelines into GitHub Actions for reliable CI/CD

  • Deliver measurable improvements in test reliability and release confidence

Culture Fit

  • Persistent, driven problem solver

  • Willing to push back on leadership to defend quality/timelines

  • Thrives in high-ambiguity, fast-paced startup environments

Why Join Sully.ai?
🔥 Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
📈 Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
🌎 Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
💰 Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
🏆 Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment. 

Top Skills

AWS
Azure
Cypress
Docker
GCP
Github Actions
Jmeter
K6
Kubernetes
Locust
Playwright
Pytest

Similar Jobs

20 Minutes Ago
In-Office or Remote
7 Locations
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The Marketing Technology Product Manager will strategize and execute marketing technology tools, ensuring data-driven customer engagement and collaboration across teams.
Top Skills: BrazeCdpsData PipelinesHubspotIterableMarketing AttributionMarketoSalesforce
20 Minutes Ago
In-Office or Remote
7 Locations
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Oversee software project development for Block hardware, manage cross-functional teams, and ensure project delivery aligns with requirements and timelines.
Top Skills: AIAndroidAospBuild ToolsEmbedded SystemsHardware-Software InterfacesSoftware Development
20 Minutes Ago
In-Office or Remote
7 Locations
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The Product Lead for GTM will lead the vision and strategy for the Go-to-Market platform, ensuring efficient integration of marketing and sales systems to enhance customer experience and drive revenue growth.
Top Skills: Cpq ToolsGainsightGongHubspotMarketoOutreachSalesforce

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account