Overview
We2;re looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters aroundour Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.
Youll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. Youll also help us plan for future capacity and evaluate new technologies as we continue to scale.
Responsibilities
- Manage and optimize HPC cluster operations
- Deploy and maintain infrastructure-as-code solutions
- Support ML/research teams with cluster usage optimization
- Operate, troubleshoot and optimize Ceph storage clusters
- Develop automation and tooling
Minimum Qualifications
- 5+ years of experience in SRE or HPC operations
- Proficiency in Linux systems administration (Ubuntu/Debian)
- Experience with Kubernetes and container orchestration
- Experience with Ceph >1PB deployments and maintenance
- Knowledge of security best practices in multi-tenant environments
- Understanding of L2/L3 networking fundamentals
- Skilled in Python and Bash scripting
Preferred Qualifications
- Experience with infrastructure-as-code tools (Ansible/Terraform)
- Experience with GitOps (Helm, ArgoCD)
- Strong grasp of RDMA, InfiniBand, and GPUDirect technologies
- Familiarity with deep learning frameworks such as PyTorch and TensorFlow
- Familiarity in at least one cloud platform: AWS, Azure or GCP
If youre a natural problem-solver with a passion for continuous learning, wed love to hear from you.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
#J-18808-Ljbffr
Site Reliability Engineer, AI/ML Infrastructure in Toronto employer: Boson AI
At Boson AI, we pride ourselves on being an exceptional employer that fosters innovation and collaboration in the rapidly evolving field of enterprise AI. Our dynamic work culture encourages continuous learning and professional growth, offering employees the chance to tackle complex challenges while contributing to groundbreaking AI solutions. Located in a vibrant tech hub, we provide competitive compensation, comprehensive benefits, and a supportive environment where your contributions truly make a difference.
