Senior NVIDIA LLM Inference Engineer in Toronto

Senior NVIDIA LLM Inference Engineer in Toronto

Toronto Full-Time 135000 - 165000 $ / year (est.) Remote
F

At a Glance

  • Tasks: Deploy cutting-edge LLMs using NVIDIA tech and Kubernetes for innovative clients.
  • Company: Join FullStack, a leader in AI engineering with a collaborative culture.
  • Benefits: Enjoy remote work, competitive salary, and opportunities for professional growth.
  • Other info: Dynamic role with the chance to connect with diverse teams across the US.
  • Why this job: Make an impact by working on advanced AI projects with top-tier technology.
  • Qualifications: 5+ years of experience in AI/ML and strong software engineering skills.

The predicted salary is between 135000 - 165000 $ per year.

Deploy production LLMs remotely with NVIDIA inference technologies, GPU infrastructure, and Kubernetes-based environments for FullStack clients. As a Senior AI Engineer, you will connect with United States clients through FullStack’s talent network. The work involves integrating with client teams on flexible, project-based development assignments. You will apply AI/ML engineering, software engineering, and machine learning infrastructure expertise to complex systems.

Key Responsibilities:

  • Integrate directly into client engineering and design teams
  • Deploy and self-host LLMs on production GPU infrastructure
  • Serve and scale inference workloads across GPU clusters
  • Operate Kubernetes environments using NVIDIA GPU Operator
  • Implement guardrails for production LLM applications

Requirements:

  • Five or more years of relevant professional experience
  • Advanced English and a four-year college degree
  • Hands-on NVIDIA NIM, NeMo, TensorRT-LLM, and Triton experience
  • Understanding of LLM inference optimization and model serving
  • Full-time work authorization without visa sponsorship

Apply NVIDIA inference, LLM deployment, and GPU operations expertise as a remote Senior AI Engineer with FullStack clients.

Senior NVIDIA LLM Inference Engineer in Toronto employer: FullStack

FullStack is an exceptional employer that offers life-changing career opportunities for talented software professionals across Canada. With a strong focus on diversity and inclusion, employees benefit from competitive pay, 100% remote work, and the chance to collaborate with leading startups and Fortune 500 companies. The company fosters a culture of continuous learning and growth, ensuring that every team member can thrive in their career while contributing to impactful AI-driven projects.

F

Contact Details:

FullStack Recruitment Team

We think you need these skills to ace Senior NVIDIA LLM Inference Engineer in Toronto

NVIDIA Inference Technologies
GPU Infrastructure
Kubernetes
AI/ML Engineering
Software Engineering
Machine Learning Infrastructure
LLM Inference Optimization