At a Glance
- Tasks: Validate chatbot responses and create test scenarios for cutting-edge AI technology.
- Company: Join a forward-thinking tech company focused on AI and innovation.
- Benefits: Flexible work arrangement, competitive salary, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on quality and continuous improvement.
- Why this job: Be at the forefront of AI development and enhance user experiences with chatbots.
- Qualifications: 5 years in QA SDET with strong automation skills and experience in AI testing.
The predicted salary is between 90000 - 110000 $ per year.
- Software Development Engineer in Test – Gen AI / LLM
- Role Description
Work Arrangement
1 day onsite per week
Experience Required
- 6–8 years
- Key Roles & Responsibilities
- Validate chatbot responses for accuracy, relevance, completeness, and consistency.
- Create and execute test scenarios, test cases, and regression test suites.
- Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
- Perform chatbot conversation analysis and recommend quality improvements.
- Develop and maintain test automation for chatbot validation where possible.
- Work closely with developers, AI engineers, and content teams to resolve defects.
- Track, document, and report defects, test results, and quality metrics.
- Support UAT, release validation, and production quality monitoring.
- Key Skillsets
- 5 years of strong QA SDET test automation experience.
- Experience testing AI, LLM, Gen AI, chatbots, virtual assistants, or conversational platforms.
- Knowledge of prompt engineering concepts.
- Experience with Jira, Confluence, Git Hub, and Agile delivery.
- Experience with API testing and automation frameworks.
- Strong analytical and troubleshooting skills.
- Experience with Python, Selenium, Playwright, Py Test, or similar tools.
- Strong communication and documentation skills.
Essential Skills
- QA SDET and test automation.
- AI, LLM, Gen AI, chatbots, and conversational platforms.
- Prompt engineering concepts.
- API testing and automation frameworks.
- Python, Selenium, Playwright, or Py Test.
- Jira, Confluence, Git Hub, and Agile delivery.
- Analytical and troubleshooting skills.
- Communication and documentation skills.
Desirable Skills
- Digital: Python
- Digital: Chatbots / Conversational Agents
- Generative AI – Quality Engineering
- #J-18808-Ljbffr
Software Development Engineer in Test – GenAI / LLM in Toronto employer: Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Astra-North Infoteck Inc. is an exceptional employer located in the vibrant city of Toronto, offering a dynamic work culture that fosters innovation and collaboration. Employees benefit from comprehensive growth opportunities, including mentorship programs and access to cutting-edge technology, all while working in a supportive environment that values diversity and creativity. Join us to be part of a forward-thinking team that is shaping the future of cloud-based solutions and AI.
Contact Details:
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision! Recruitment Team
