Milestone Systems Logo

Milestone Systems

AI Harness Engineer

Posted 3 Days Ago
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in Copenhagen, Capital
Senior level
Remote or Hybrid
Hiring Remotely in Copenhagen, Capital
Senior level
Build and own an internal AI engineering platform (model gateway, agents, context handling, tooling, caching, guardrails, secrets, observability). Define standards and reference architectures, operationalize experiments, run evaluations and cost tracking, support on-prem/air-gapped deployments, and help product teams deliver compliant customer-facing AI features while driving adoption and measurable ROI.
The summary above was generated by AI

AI Harness Engineer (Senior/Principal) 

About the role 

We've had real wins with AI at Milestone, but they've mostly stayed inside the teams that found them. We're looking for someone to take what's working and build it into a platform the whole engineering organization can rely on. 

The work sits in the layer around the models: the gateway, agent tooling, context handling, evaluations, guardrails, observability, and cost controls that make AI dependable for real engineering work. You'll own that layer, not just run it, but set the technical standards and reference architectures other teams build against. 

The first phase is our internal development environment. From there, you'll bring the same rigor to the AI features going into our products, working alongside the teams that own them. 

Part of the job is being straight with us about where AI doesn't help, not only where it does. 

On level: we're open at both senior and principal. At senior, we expect you to build and operate this platform. At principal, we additionally expect you to set the technical direction for AI-assisted engineering across the organization — the person other staff and principal engineers argue with and come away convinced by. 

What you'll do 

  • Own the AI engineering platform: the model gateway, agent loops, context handling, tool integrations, caching and guardrails, along with the identity, secrets handling, and audit trails around them. This is production infrastructure serving the whole engineering organization, with the availability and security expectations that implies. 
  • Define the technical standards and reference architectures for AI-assisted development: how teams integrate agents into their workflows, what good looks like for context and evaluation, which patterns we support and which we don't. 
  • Build the observability layer. Trace an agent run end to end, so that when something fails we can say whether it was the model, the context, the tool call, or the code — and act on the answer. 
  • Take the experiments already working somewhere in the company and turn them into something other teams can pick up and run with. 
  • Stand up the evaluations and cost tracking we need to tell whether a given tool is pulling its weight. 
  • Own the build-versus-buy recommendations. We should buy most infrastructure; the parts tied to our products, or to our on-prem and compliance requirements, are where building may make sense. 
  • Make it run where we run. On-prem and air-gapped deployment is a first-class design constraint here, not an edge case. 
  • In the second phase, work with product teams to bring the same approach to customer-facing AI features, inside EU AI Act and GDPR. 
  • Get engineers on board the right way — by showing them, pairing with them, and writing things down — so the change outlasts you. 

What you'll bring 

  • Time spent as a staff engineer or senior IC building and operating distributed production systems: API and service boundaries, failure modes under load, observability, and the security work that comes with handling credentials and sensitive source code. 
  • Real, hands-on familiarity with today's AI coding tools (Claude Code, Cursor, Copilot, Codex and the like) and the craft around them: context engineering, prompting, caching, tool use, memory, and the rest of it. 
  • Experience putting an LLM-based system into production and keeping it there: evaluation, failure modes, latency, cost, and what breaks once real traffic arrives. Internal platforms count as production. 
  • Strong fundamentals. When an agent fails, you can work out why and fix it rather than just file a ticket. 
  • A habit of treating token and compute spend as a real budget, and a sense of how to bring cost-per-task down. 
  • Some history measuring this kind of work — adoption, quality, productivity, or ROI — using frameworks like DX Core 4 or DORA. 
  • The presence to stand in front of experienced, skeptical engineers, have the hard conversation, and still bring them with you. 
  • A view that AI is a powerful tool but that engineering judgment is what makes the difference, plus enough curiosity to keep up as the field shifts. 

Nice to have 

  • You've shipped agentic features in a product customers actually use. 
  • Experience building or operating under EU AI Act or GDPR requirements. 
  • You've run an internal model gateway, LLM monitoring, or evaluation tooling at organizational scale. 
  • Experience with on-prem or air-gapped deployments. 

About the team 

You'll join a new team in the Experience Development Organization, set up to put Milestone on the front edge of AI-assisted development. The team is being built now: you'll work alongside other AI Harness Engineers as it grows, and closely with engineering teams across the organization. [Add current and planned team size, and who the role reports to.] 

What we offer 

  • Individual development plans aligned with your career goals 
  • Access to training, learning resources, certifications, and professional development 
  • Flexible hybrid working arrangements 
  • Supportive leadership and regular feedback 
  • Opportunities for cross-functional and international collaboration 
  • A People First culture built on trust, inclusion, and empowerment 
  • Social activities and spaces to connect with colleagues across the organization 

Practical details 

Please note that applying for this position requires a valid Danish work visa. 

We encourage you to submit your CV in English as soon as possible. Applications will be reviewed on an ongoing basis, and the position will remain open until the right candidate has been identified. 

At Milestone Systems, we are committed to providing an inclusive and unbiased recruitment process where all employment decisions are based on qualifications, experience, and potential. 

Application Process
 Please note that applying for this position requires a valid Danish work visa.
We encourage you to submit your CV in English as soon as possible. Applications will be reviewed on an ongoing basis, and the position will remain open until the right candidate has been identified.
At Milestone Systems, we are committed to providing an inclusive and unbiased recruitment process where all employment decisions are based on qualifications, experience, and potential

About us 

Milestone Systems is a leading provider of data-driven video technology software. Our portfolio includes XProtect video management software, Arcules video surveillance as a service, and BriefCam analytics. We amplify what organizations of any size can see, do, and achieve with video. 

Guided by our People First mindset — freedom, inclusion, and togetherness — we always consider our employees, partners, and communities in everything we do. 

 


Similar Jobs at Milestone Systems

3 Days Ago
Remote or Hybrid
Entry level
Entry level
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Student role supporting EMEA Care team by preparing quotes, managing renewals/reactivations, engaging resellers/distributors, maintaining records in Salesforce, and providing licensing/pricing support to partners.
Top Skills: Salesforce
8 Days Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lead and coordinate complex customer and partner escalations across EMEA, liaising with technical and business stakeholders to drive resolution, run war rooms and executive briefings, perform root cause analysis, recommend improvements, and support major incident and crisis response activities to protect customer trust.
Top Skills: ArculesBriefcamCRMService Management PlatformsSupport Ticketing PlatformsXprotect
8 Days Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lead development of integrations between a VLM-as-a-service platform and Milestone XProtect and other VMSs. Build Smart Client features, backend Python APIs, and .NET components. Own end-to-end delivery, testing, deployment, monitoring, and L2 support. Design modular integration layers, automation, and documentation to improve operator workflows and production reliability.
Top Skills: .NetAngularApi KeysAWSAzureAzure DevopsC#CertificatesClaudeCodexDockerGCPGithub ActionsLlmLoggingMetricsMilestone XprotectMip SdkOauthPythonReactRest ApisSmart ClientTokensTracingTypescriptVlmWindows Services

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account