Boson AI Logo

Boson AI

Network Engineer, AI/ML Infrastructure

Posted Yesterday
Be an Early Applicant
In-Office
Toronto, ON
Mid level
In-Office
Toronto, ON
Mid level
Design and optimize high-performance networking infrastructure for AI/ML with tasks including troubleshooting, performance monitoring, and network upgrades.
The summary above was generated by AI
About The Role

We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, and hundreds of servers.

You'll be hands-on with the full lifecycle of our network infrastructure: planning, building, testing, deploying, and keeping everything running at peak performance. That means troubleshooting issues as they arise, monitoring network performance and throughput, developing automation to streamline operations, and working closely with HPC and ML teams to ensure they have the bandwidth they need. You'll also help us plan for future capacity and evaluate emerging network technologies as we scale to meet increasingly demanding workloads.

Responsibilities

  • Configure and maintain InfiniBand and high-speed Ethernet fabrics
  • Optimize network performance for RDMA, and GPU-to-GPU communication
  • Manage network switches (Mellanox, NVIDIA, Micas Networks)
  • Troubleshoot network bottlenecks and latency issues
  • Plan and execute network upgrades and expansions
  • Network security implementation (firewalls, VLANs, ACLs)
  • Collaborate on storage network optimizationInfrastructure monitoring

Minimum Qualifications

  • 4+ years of network engineering experience in production environments
  • Strong understanding of L2/L3 networking protocols (TCP/IP, BGP, OSPF, VLANs)
  • Hands-on experience with high-speed networking (100Gb+ Ethernet and InfiniBand)
  • Hands-on experience with network security (firewalls, ACLs, network segmentation)
  • Knowledge of HPC network topologies
  • Experience with InfiniBand fabrics including RDMA, RoCE, IPoIB
  • Strong troubleshooting and problem-solving skills

Preferred Qualifications

  • Experience in data center environments or AI/ML infrastructure
  • Hands-on experience with high-performance Ethernet switches (e.g., Broadcom Tomahawk), and latest InfiniBand switches (e.g., Nvidia/Mellanox)
  • Experience optimizing networks for GPU-to-GPU communication
  • Experience with open-source firewall solutions (OPNsense, pfSense, or similar)
  • Experience with network automation tools
  • Understanding of distributed storage networking (Ceph cluster networks)
  • Familiarity with network monitoring and observability tools (Prometheus, Grafana)
  • Knowledge of multi-site network connectivity and WAN optimization
  • Familiarity with cloud networking in at least one platform (AWS, GCP, or Azure) including VPC design, site-to-site VPN configuration, Direct Connect/ExpressRoute/Cloud Interconnect, hybrid cloud connectivity, and cloud-to-datacenter network integration

If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.

Top Skills

A100 Gpus
Acls
AWS
Azure
Bgp
Ceph
Ethernet
Firewalls
GCP
Grafana
Infiniband
Ipoib
L2 Networking
L3 Networking
Mellanox
Network Security
Nvidia H100
Ospf
Prometheus
Rdma
Roce
Tcp/Ip
Vlans
Vlans

Similar Jobs

58 Minutes Ago
In-Office
Toronto, ON, CAN
Senior level
Senior level
Artificial Intelligence • Internet of Things • Semiconductor
As a Security Verification Engineer, you'll develop test plans, testbenches, and verification models for Security IP, mentor team members, and collaborate on design for SoCs.
Top Skills: Arm System ArchitecturesCPerlPythonSystemverilogTclUvmVerilog Hdl
2 Hours Ago
Easy Apply
Hybrid
Toronto, ON, CAN
Easy Apply
Expert/Leader
Expert/Leader
Artificial Intelligence • Marketing Tech • Software
The Vice President of Product Management will execute product strategy and roadmap, leading teams to enhance product management practices and customer satisfaction, while ensuring alignment with corporate objectives and technical excellence.
Top Skills: Agile MethodologiesAi-Driven DecisioningB2C CrmEmail MarketingMobile MarketingPersonalization CapabilitiesSdlc
3 Hours Ago
Hybrid
Toronto, ON, CAN
Internship
Internship
Fintech • Machine Learning • Payments • Software • Financial Services
As an Associate Software Engineer, you will engage in software development, collaborating with teams to deliver solutions and improve user experiences, while engaging in continuous learning.
Top Skills: Android StudioAngularAWSCloudwatchEc2EspressoGoIntellijJavaScriptJenkinsKotlinLambdaMockitojunitrunnerNew RelicNode.jsReactRoute53S3SplunkSwiftTypescriptVisual Studio CodeXcodeXctest

What you need to know about the Ottawa Tech Scene

The capital city of Canada and the nation's fourth-largest urban area, Ottawa has proven a rapidly growing global tech hub. With over 1,800 tech companies, many of which are leaders in their sectors, the city's tech talent now makes up more than 13 percent of its total workforce. This growth is driven not only by the big players like UL Solutions and Dropbox, but also by a thriving startup ecosystem, as new businesses emerge to follow in the footsteps of those that came before them.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account