Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full-time position. Build dependable serving systems for high request volumes. Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes. Key Responsibilities:
Optimize model serving latency and throughput Containerize models for stable production deployment Profile and tune GPU-based code Design distributed serving across GPUs and nodes Apply quantization, batching, and caching methods Requirements:
Senior-level software or inference engineering experience Production experience with server-side or learning-based software Machine learning inference optimization framework experience C++, CUDA, Rust, or optimized Python proficiency Distributed systems and container orchestration familiarity Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.
#J-18808-Ljbffr
Senior Machine Learning Inference Engineer in Winnipeg employer: Raydar
Our client is an exceptional employer, offering a fully remote work environment that fosters collaboration among a small, senior engineering team across North America. With a strong focus on employee growth, the company provides competitive compensation, comprehensive benefits including medical and wellness stipends, and opportunities to shape the future of AI technology, making it an ideal place for those seeking meaningful and rewarding work in the tech industry.
