CUDA C++ engineers can design GPU kernels at Baseten, optimizing matrix multiplication and attention for production machine learning inference. Work model is not specified. As a GPU Kernel Engineer, you will support Baseten’s Model Performance team and its inference stack. You will write CUDA and PTX code, apply GPU architecture knowledge, and optimize modern AI workloads. The work includes collaboration with research teams and production systems. Key Responsibilities:
Design high-performance kernels for matrix multiplications Optimize attention mechanisms and mixture-of-experts routing Apply memory coalescing and warp-level programming Use tensor cores and compute-memory overlap Contribute to internal and open-source GPU libraries Requirements:
Understand GPU architecture and programming paradigms Know memory hierarchy and thread organization Mitigate race conditions using synchronization techniques Demonstrate C++ proficiency and profiling-tool experience Understand CUDA C++ APIs and bandwidth optimization Build Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
GPU Kernel Engineer CUDA C++ in Montréal employer: Baseten
At Baseten, we pride ourselves on fostering a dynamic work culture that encourages innovation and collaboration. As an Engineering Manager, you'll not only lead a talented team of Forward Deployed Engineers but also have access to exceptional growth opportunities in the rapidly evolving AI landscape. Located in a vibrant tech hub, our employees enjoy a supportive environment that values work-life balance and offers competitive benefits, making Baseten an outstanding employer for those seeking meaningful and rewarding careers.
