Seeking a Senior AI/ML Engineer to design and develop AI-native systems using Generative AI and multi-agent frameworks for real-time networking solutions. Responsibilities include modeling agent behaviors, developing LLM-driven agents, building ML models, and collaborating on AI projects.
At Extreme Networks, we create effortless networking experiences that empower people and organizations to advance. As part of our growing AI Competence Center, we are seeking a Senior AI/ML Engineerwith expertise in Generative AI, multi-agent systems, and LLM-based application development.
In this role, you will help build the next generation of AI-native systems that combine traditional machine learning, generative models, and autonomous agents. Your work will power intelligent, real-time decisions for network design, optimization, security, and support.
Key Responsibilities
- Design and implement the business logic and modeling that governs agent behavior, including decision-making workflows, tool usage, and interaction policies.
- Develop and refine LLM-driven agents using prompt engineering, retrieval-augmented generation (RAG), fine-tuning, or function calling.
- Understand and model the domain knowledge behind each agent: engage with network engineers, learn the operational context, and encode this understanding into effective agent behavior.
- Apply traditional ML modeling techniques (classification, regression, clustering, anomaly detection) to enrich agent capabilities.
- Contribute to the data engineering pipeline that feeds agents, including data extraction, transformation, and semantic chunking.
- Build modular, reusable AI components and integrate them with backend APIs, vector stores, and network telemetry pipelines.
- Collaborate with other AI engineers to create multi-agent workflows, including planning, refinement, execution, and escalation steps.
- Translate GenAI prototypes into production-grade, scalable, and testable services in collaboration with platform and engineering teams.
- Work with frontend developers to design agent experiences and contribute to UX interactions with human-in-the-loop feedback.
- Stay up to date on trends in LLM architectures, agent frameworks, evaluation strategies, and GenAI standards.
Qualifications
- Master’s or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
- 5+ years of experience in ML/AI engineering, including 2+ years working with transformer models or LLM systems.
- Strong knowledge of ML fundamentals, with hands-on experience building and deploying traditional ML models.
- Solid programming skills in Python, with experience integrating AI modules into cloud-native microservices.
- Experience with LLM frameworks (e.g., LangChain, AutoGen, Semantic Kernel, Haystack), and vector databases (e.g., FAISS, Weaviate, Pinecone).
- Familiarity with prompt engineering techniques for system design, memory management, instruction tuning, and tool-use chaining.
- Strong understanding of RAG architectures, including semantic chunking, metadata design, and hybrid retrieval.
- Hands-on experience with data preprocessing, ETL workflows, and embedding generation.
- Proven ability to work with cloud platforms like AWS or Azure for model deployment, data storage, and orchestration.
- Excellent collaboration and communication skills, including cross-functional work with product managers, network engineers, and backend teams.
Nice to Have
- Experience with LLMOps tools, open-source agent frameworks, or orchestration libraries .
- Familiarity with Docker, Docker Compose, and container-based development environments.
- Background in enterprise networking, SD-WAN, or network observability tools.
- Contributions to open-source AI or GenAI libraries.
Top Skills
AWS
Azure
Docker
Genai Standards
Llm Frameworks
Python
Vector Databases
Similar Jobs
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
As a Software Engineer, you'll develop scalable APIs and services, improve code quality, collaborate with teams, and manage AWS infrastructure.
Top Skills:
AWSCassandraDynamoDBGoJavaKotlinPostgresRedisRuby
Gaming • Information Technology • Mobile • Software
Lead the Threat Intelligence Operations, analyze cyber threats, enhance security posture, produce actionable reporting, and mentor junior analysts.
Top Skills:
Cyber Kill ChainDiamond ModelMitre Att&CkPowershellPythonSecurity Information And Event Management SystemsThreat Intelligence Platforms
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Join Samsara as a Full-Stack Software Engineer, developing customer-facing features and maintaining production systems in a platform team, impacting global operations.
Top Skills:
AWSGoGraphQLReactReact NativeTypescript
What you need to know about the Ottawa Tech Scene
The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.



