AI Software Engineer Intern in Markham

At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation.

Your role and responsibilities:

• Build AI for the systems the world relies on.
• Design, build, and test AI-powered features that address real developer and client needs, with guidance from experienced engineers.
• Integrate LLMs, APIs, and enterprise data into applications, exploring agent workflows, tool calling, and retrieval where they fit the problem.
• Write clear specifications and effective prompts, use AI development tools thoughtfully, and review and test the code they produce.
• Evaluate AI behavior with realistic test cases, measure quality and performance, and improve how applications handle incorrect outputs and failures.
• Debug across model interactions, application code, APIs, and underlying systems to understand root causes and build reliable solutions.
• Collaborate through Git, code reviews, and technical discussions; document your work and iterate on feedback.

Program Start Date: May 03, 2027

Program Duration: 12-16 Months

Candidates must be available to participate for the full duration of the internship.

Location Flexibility: By applying to this requisition, you acknowledge and agree to be considered for any of the listed locations associated with this position and are willing to work at the location where you are ultimately assigned.

Required education: High School Diploma/GED

Preferred education: Bachelor's Degree

Required technical and professional expertise:

• Strong software engineering fundamentals, including data structures, algorithms, software design, and testing.
• Proficiency in Python and experience building applications or services that integrate APIs.
• Hands-on experience building an application or working prototype with LLMs.
• A systematic debugging mindset.
• Ability to translate a problem into clear requirements, prompts, and testable acceptance criteria.
• Familiarity with Git, clear technical communication, and the ability to learn quickly and collaborate on a team.

Preferred technical and professional experience:

• Experience in one or more of the following areas is a plus: AI agents and tool or function calling; retrieval-augmented generation (RAG), embeddings, vector databases, or Model Context Protocol (MCP).
• Independent AI projects, open-source contributions, or experiments beyond assigned coursework.
• Operating system concepts such as concurrency, multithreading, and memory management; relational databases and SQL.
• Cloud and container technologies such as Docker, Kubernetes, or OpenShift.
• AI evaluation, anomaly detection, or experience measuring and improving model accuracy, latency, and reliability.

Must have the ability to work in Canada without sponsorship. This role will involve working with technology that is covered by Export Regulations sanctions.

The salary range for the position is based on a full-time schedule. Your ultimate salary within this range may vary depending on your job-related skills and experience for this position.