At a Glance
- Tasks: Optimize model inference systems and create low-latency serving infrastructure.
- Company: Cohere, a remote-first innovative tech company.
- Benefits: Competitive salary, flexible remote work, and opportunities for professional growth.
- Other info: Collaborative remote culture with a focus on performance optimization.
- Why this job: Join a team driving innovations in backend services and make a real impact.
- Qualifications: 5+ years of backend engineering experience and proficiency in Go, Rust, or C++.
The predicted salary is between 121455 - 148445 $ per year.
Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems.
In this remote-first role, you will create low-latency serving infrastructure for advanced backend services.
Candidates for this position must have over five years of backend engineering experience and strong programming skills in Go, Rust, or C++.
You'll work on building backend services that enhance Cohere's enterprise API, focusing on batching strategies and performance optimization.
Key
Responsibilities
- Establish low-latency serving infrastructure for model inference
- Develop backend services for the enterprise-level API
- Implement batching strategies to maximize throughput efficiency
- Optimize model serving and inference processes
- Collaborate within a remote-first culture
Requirements
- 5+ years of relevant backend engineering experience
- Proficiency in Go, Rust, or C++
- Experience with low-latency and high-throughput systems
- Knowledge of model serving optimization
- Familiarity with g RPC, REST APIs, and microservices
Utilize your expertise in backend engineering to drive innovations in model inference at Cohere. #J-18808-Ljbffr
Backend Engineer for Inference Optimization in Toronto employer: Best AI Tools Wiki
Cohere is an exceptional employer that fosters a remote-first work culture, allowing you to collaborate with talented professionals from around the globe while enjoying the flexibility of working from anywhere. With a strong emphasis on employee growth, Cohere offers opportunities to innovate in model inference optimization, ensuring that your contributions directly impact the enterprise API's performance. Join us to be part of a dynamic team that values creativity and technical excellence in a supportive environment.
