At a Glance
- Tasks: Design and deploy LLM-powered applications using Python in a remote-first environment.
- Company: Join Kake, a global community of 45,000+ engineers creating innovative products.
- Benefits: Competitive pay in USD, fully remote work, and personal growth investment.
- Other info: Collaborate with diverse teams and thrive in a fast-paced, supportive environment.
- Why this job: Make an impact with cutting-edge AI technology while enjoying a flexible work culture.
- Qualifications: Strong Python skills and experience with LLM APIs and backend frameworks.
The predicted salary is between 135000 - 165000 $ per year.
Kake is a remote-first company and a people-first global community of senior engineers. Kake engineers are behind some of the world’s most innovative products, from Fortune 500 to fast-growing companies. We believe it’s not where your table is, but what you bring to the table that matters. Our community spans 45,000+ engineers across 55+ countries; join a culture where great people stay, grow, and thrive.
Senior AI/LLM Engineers with strong Python experience, skilled in designing, building, and productionizing LLM-powered applications and AI systems at scale. It's a great fit for people who enjoy working at the intersection of software engineering and applied AI, and who take ownership from prototyping through production deployment.
What you’ll build and own:
- Design, build, and deploy LLM-powered features and applications using Python.
- Develop and maintain backend services and APIs (e.g., FastAPI) that expose AI/LLM capabilities to other systems.
- Build and optimize RAG pipelines, including embeddings, vector search, and retrieval strategies.
- Design, test, and iterate on prompts, agents, and orchestration flows using frameworks such as LangChain, LlamaIndex, or similar.
- Integrate with LLM providers and APIs (e.g., OpenAI, Anthropic, open-source models) and manage tradeoffs around cost, latency, and quality.
- Evaluate model outputs systematically, building tooling and metrics to test accuracy, safety, and regression across iterations.
- Work with containerized environments and data infrastructure (e.g., PostgreSQL, Redis, vector databases) to support reliable AI systems in production.
- Collaborate with cross-functional stakeholders to translate ambiguous product needs into technically sound AI solutions.
Core Requirements:
- Strong proficiency in Python and experience with FastAPI or similar backend frameworks.
- Experience working with LLM APIs (e.g., OpenAI, Anthropic, or similar) and frameworks such as LangChain or LlamaIndex.
- Experience with RAG architectures, embeddings, and vector databases (e.g., Pinecone, Weaviate, pgvector, or similar).
- Hands-on experience with Docker and containerized development environments.
- Experience working with PostgreSQL, Redis, or similar data stores.
- Strong experience writing functional and integration tests, including evaluation frameworks for AI/LLM output quality.
- Excellent written and verbal communication skills in English.
- Ability to work independently in a remote, fast-paced environment.
Nice-to-Have:
- Experience fine-tuning or evaluating open-source LLMs.
- Familiarity with prompt engineering best practices and agentic workflows.
- Experience with distributed systems, streaming (e.g., Kafka), or large-scale applications.
- Background in machine learning fundamentals (e.g., scikit-learn, PyTorch, or TensorFlow).
- Comfortable working flexible hours to overlap with distributed teams across different time zones.
Why Join Kake?
- Competitive Pay in USD: Work globally, get paid globally.
- Fully Remote: Simply put, we trust you.
- Better Me Fund: We invest in your personal growth and passions.
- Compassion is Badass: Join a community that invests in social good.
Ready for your piece of the Kake? Quick note: Due to the high volume of applications, only shortlisted candidates will be contacted.
Senior AI/LLM Engineer – Remote in Toronto employer: Kake
Kake is an exceptional employer that champions a remote-first culture, allowing you to work from anywhere while being part of a global community. With a strong focus on personal growth through initiatives like the Better Me Fund, competitive pay in USD, and a commitment to social good, Kake fosters an environment where talented individuals can thrive and make a meaningful impact in their careers.
