In All Media Inc Logo

In All Media Inc

2013/2014 Sr QA Automation Engineer - AI First

Posted 27 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Argentina
Senior level
Remote
Hiring Remotely in Argentina
Senior level
Own the automated testing strategy for distributed systems, Python microservices, Kafka pipelines, operational UIs, edge deployments, and agentic AI workflows. Build Playwright, API, contract, integration, and regression suites; enforce CI quality gates; investigate flaky tests; evaluate nondeterministic AI behavior; validate security boundaries; and mentor engineers on test ownership.
The summary above was generated by AI

Position: Senior QA Automation Engineer (AI-First)

Location: Remote

Contract Type: Full-time vendor (Direct contract with Inallmedia.com)

Time Zone Alignment: Central Time (CT) ±2 hours

🧭 About Inallmedia.com

Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams across LATAM. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.

🚀 Project Overview

You will join a forward-thinking engineering team building an innovative data center power management platform designed to optimize energy consumption and relieve grid pressure. As a Senior QA Automation Engineer (AI-First), your primary focus will be designing, building, and enforcing a robust automated testing strategy across distributed systems, Python microservices, event pipelines, and non-deterministic agentic AI workflows.

🔍 Key Responsibilities
  • Comprehensive Test Strategy: Own the automated test strategy across unit, integration, contract, end-to-end, and edge-deployment validation.
  • UI & Workflows: Build and maintain end-to-end test suites in Playwright for operational UIs and human-in-the-loop approval workflows.
  • Backend & Pipeline Coverage: Build API, contract, and integration testing for Python microservices and Kafka event pipelines, including replay and failure-injection scenarios.
  • CI/CD Quality Enforcement: Integrate all test suites into CI as enforced quality gates with strict thresholds rather than advisory reports.
  • Suite Health & Root-Cause Triage: Monitor execution time, flake rate, and critical path coverage; perform root-cause analysis to permanently fix test flakiness rather than relying on simple retries.
  • AI & Agentic Evaluation: Build evaluation suites for agentic AI workflows (validating tool selection, arguments, escalation behavior, and operating envelope limits).
  • Non-Deterministic Testing: Define regression testing for non-deterministic components, including golden-set evaluations, tolerance thresholds, and drift detection post-prompt/model changes.
  • Edge & Boundary Verification: Automate test suites for edge deployments (offline/reconnection scenarios) and verify human-in-the-loop security boundaries under adversarial conditions.
  • Process & Mentorship: Convert operational SOPs and incomplete specs into executable acceptance criteria alongside Technical Business Analysts, and coach engineers on test ownership.
💡 Must-Have Skills
  • Experience Level: 5+ years of hands-on experience owning test automation for distributed systems.
  • Core Automation Stack: Deep production experience with Playwright (fixtures, parallelization, trace analysis, CI integration) and strong proficiency in both Python and TypeScript.
  • Backend & Messaging: Proven experience in API, contract, and integration testing, service virtualization/mocking, and event-driven architectures like Kafka.
  • CI/CD & Infrastructure: Practical experience setting up CI quality gates in GitHub Actions or Azure DevOps, with basic Kubernetes literacy for containerized testing environments.
  • AI & Problem-Solving: Hands-on experience with AI-assisted testing methodologies, critical judgment of AI-generated code/tests, and strong root-cause debugging skills.
  • English Proficiency: Fluent English for daily written and verbal communication.
🌟 Nice-to-Have Skills
  • AI Agents & Automation: Experience with Playwright MCP, AI coding agents running non-interactively in CI, or the Claude Agent SDK.
  • LLM Product Testing: Prior experience testing LLM or agent-based products in production, non-deterministic systems, or building MCP servers for test observability.
  • Resilience & Security Testing: Experience with performance/load testing for high-volume telemetry, chaos/fault-injection, or security testing in CI (dependency scanning/dynamic analysis).
  • Domain Knowledge: Background in energy systems, smart grid technology, industrial operations, or data center environments.
🌐 Time Zone & Collaboration

The role requires collaboration with teams aligned to Central Time (CT). Flexibility to overlap with North America business hours is expected.

💬 Language

All interviews, documentation, and daily communication will be in English.

#LI

Similar Jobs

6 Minutes Ago
Remote
Entry level
Entry level
Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Drive enterprise sales growth across Argentina’s largest farming businesses. Build executive relationships, prospect and manage complex sales cycles, negotiate agreements, expand strategic accounts, forecast revenue, and collaborate cross-functionally on customer success and scalable sales systems. The role requires frequent travel within Argentina, professional English, and strong enterprise sales expertise in agricultural or related markets.
Yesterday
Remote or Hybrid
Mid level
Mid level
Financial Services
Manage technology product initiatives and collaboration solutions, including roadmaps, product overviews, reports, backlogs, and documentation. Coordinate software development activities, track progress, and communicate updates to stakeholders. The role requires strong technology product management experience, knowledge of SDLC and Agile methodologies, stakeholder-management skills, and fluent English. This is a 15-week ReEntry fellowship for professionals returning after an extended career break, with possible permanent placement.
Top Skills: AgileScrumSdlc
Entry level
Financial Services
Supports investment banking and corporate banking teams through financial analysis, company and industry research, valuation modeling, benchmarking, pitch books, marketing materials, and transaction support. Collaborates with global teams, develops industry and client insights, tracks market opportunities, and prepares accurate materials for client meetings and live transactions while meeting compliance and quality standards.
Top Skills: MS Office

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account