At a Glance
- Tasks: Build and optimize AI inference systems using cutting-edge tech in a flexible work environment.
- Company: Join Thomson Reuters, a leader in innovative AI solutions.
- Benefits: Enjoy competitive pay, health benefits, and opportunities for remote work.
- Other info: Dynamic role with excellent career growth in a supportive culture.
- Why this job: Make a real impact on AI-driven products and collaborate with top-tier teams.
- Qualifications: 7+ years in machine learning and GPU programming; strong Python and C++ skills.
The predicted salary is between 148500 - 181500 $ per year.
Build production AI inference systems at Thomson Reuters using GPU optimization and Kubernetes across a flexible hybrid working environment. Support reliable services for AI-driven products and enterprise workflows. As a Staff AI Inference Engineer, you will productionize, optimize, and scale classical machine learning, generative AI, and large language model workloads. You will collaborate with Platform Engineering, Product, Data Science, Architecture, Enterprise AI, and cloud engineering teams. The work includes capacity forecasting, model onboarding, production APIs, and multi-cloud infrastructure across AWS, Azure, Google Cloud Platform, and Oracle Cloud Infrastructure.
Key Responsibilities:
- Optimize models through quantization, pruning, distillation, and hardware-specific tuning
- Deploy GPU inference workloads across multi-cloud and Kubernetes environments
- Implement routing and failover for OpenAI, Anthropic, and Vertex AI traffic
- Build containerized inference pipelines and production-grade APIs
- Monitor bottlenecks, latency, utilization, reliability, and model drift
Requirements:
- Seven or more years of relevant experience
- Strong machine learning, large language model, and inference optimization fundamentals
- GPU programming experience; CUDA preferred
- TensorRT, ONNX Runtime, PyTorch, or TensorFlow experience
- Python plus a systems language; C++ strongly preferred
- Apply staff-level inference expertise across GPU systems, Kubernetes, multi-cloud platforms, and enterprise AI reliability at Thomson Reuters.
Staff AI Inference Engineer in Toronto employer: Thomson Reuters
Thomson Reuters is an exceptional employer that fosters a collaborative and innovative work culture, where employees are empowered to take ownership of their projects and contribute to cutting-edge AI solutions. Located in a vibrant tech hub, the company offers competitive benefits, continuous learning opportunities, and a commitment to employee growth, making it an ideal place for those looking to make a meaningful impact in the field of AI.
