Sully.ai Logo

Sully.ai

Senior Software Engineer, Research

Reposted 2 Months Ago
In-Office or Remote
Hiring Remotely in CA
Senior level
In-Office or Remote
Hiring Remotely in CA
Senior level
Build and scale core research infrastructure and agentic systems across backend, frontend, and model integrations. Own reliability, observability, and performance; ship research-proven features to production rapidly and develop shared tools and SDKs to accelerate Research, QA, and Engineering.
The summary above was generated by AI

About Us
At Sully.ai, We’re Building the Most Impactful Healthcare Company on Earth

We believe that access to a great doctor is a basic human right. Today, that’s not a reality. Delays, misdiagnoses, administrative chaos, and burnout plague the system.

Our Mission
One Human, One Doctor.
We enable our customers to staff 30% of their workforce with AI by creating a shared agent architecture for scale and efficiency. All powered by our own patented, world-class models and deployed in real-world care.

What You’ll Do

Build and optimize core research infrastructure: evaluation pipelines, agent workflows, hallucination detectors, coding benchmarks, and research→production integrations.

Design, implement, and scale agentic systems across backend, frontend, and model integrations, collaborating closely with research and co-founders.

Own reliability, observability, and performance across agents (logging, tracing, instrumentation, safety checks).

Ship research-proven features into production within 7 days, end-to-end.

Develop shared tools, SDKs, and internal products that accelerate iteration across Research, QA, and Engineering.
Hard Requirements

  • Senior-level full-stack engineering experience in React, TypeScript, and Node.js.

  • Proven ability to design, ship, and scale LLM-powered applications.

  • Expertise in API design, streaming, and CI/CD pipelines.

  • Strong cloud infrastructure background (AWS, GCP, or Azure).

  • Track record of building reliable systems with measurable performance and error budgets.

  • First-Month Focus

  • Audit all cross-agent flows for UI/UX consistency, correctness, and performance gaps.

  • Implement shared components, typed schemas, and contract-driven interfaces for reliability.

  • Establish instrumentation for frontend performance, agent consistency, latency, and model round-trip tracing.

  • Improve or replace brittle evaluation or agent pipelines identified during onboarding.

  • Partner with Research to productionize at least one new capability.

  • 90 Day OKRs

  • Deliver production-grade agentic workflows with <5% error rates across evaluation benchmarks.

  • Launch a cross-agent design system + SDK adopted by at least 2 internal teams.

  • Establish a weekly deploy + measure cadence with performance dashboards, latency budgets, and error budgets.

  • Reduce agent latency and failure rates across at least two high-volume workflows.

  • Ship multiple research-to-production integrations with measurable CSAT or accuracy gains.

Key Results (First 90 Days)
  • Deliver production-grade agentic workflows with end-to-end testing.

  • Audit all cross-agent flows for UI/UX consistency, correctness, and performance gaps.

  • Implement shared components, typed schemas, and contract-driven interfaces for reliability.

  • Establish instrumentation for frontend performance, agent consistency, latency, and model round-trip tracing.

  • Partner with Research to productionize at least one new capability.

Why Join Sully.ai?
🔥 Revolutionizing the antiquated $800B+ Healthcare market

🧠 60%+ Ex-founders who have built, scaled, exited. We hire A-players

⚡️ Speed matters: we operate with urgency, autonomy, and ownership

🧪 You’ll work on real, first-of-their-kind problems at the edge of AI and medicine

❤️ Your work directly unlocks doctors to reclaim their time, and patients get better, faster care

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment. 

Similar Jobs

One Month Ago
Remote
CA
Senior level
Senior level
Artificial Intelligence • Cloud • Software
Develop and optimize supply-chain algorithms by translating real-world problems into mathematical models. Lead C++ implementation, investigate heuristics and optimization techniques, and create comprehensive functional, regression, performance, unit, and integration tests. Collaborate with agile teams and stakeholders while improving software quality, development speed, and platform capabilities. Experience with commercial mathematical solvers, data structures, algorithms, and AI-assisted development is valued.
Top Skills: Automated Testing FrameworksC#C++Cloud InfrastructureConfluenceCplexGitGurobiJIRAMaestroMathematical Optimization SolversPythonVirtual InfrastructureVisual StudioXpress
An Hour Ago
Easy Apply
Remote
Canada
Easy Apply
Expert/Leader
Expert/Leader
Big Data • Fintech • Mobile • Payments • Financial Services
Leads Affirm’s zero-to-one product initiatives in partnership with the CEO and executive team. Owns product vision, strategy, roadmaps, customer discovery, prototyping, experimentation, launches, and iteration for new products and platforms. Coordinates engineering, design, data, risk, legal, operations, and revenue teams without direct authority. Defines success metrics, analyzes customer behavior, communicates tradeoffs, and establishes repeatable product development standards.
Top Skills: Ai ToolsExperimentation PlatformsProduct AnalyticsSoftware ProductsUi/Ux Prototyping Tools
3 Hours Ago
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead the AI Quality engineering team while remaining hands-on building evaluation infrastructure, observability tooling, diagnostic systems, datasets, annotation workflows, and CI/CD pipelines for production AI agents. Run experiments across prompts, models, routing, caching, and agent harnesses to improve quality, latency, and cost. Partner with AI Core engineering and manage technical direction and team priorities.
Top Skills: Ai AgentsBraintrustCi/CdLangsmithLlmsPythonRuby On Rails

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account