At a Glance
- Tasks: Own quality for AI agents through Python automation and exploratory testing.
- Company: Join a cutting-edge tech company focused on industrial AI systems.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Dynamic team environment with exciting challenges and career advancement.
- Why this job: Make an impact in the AI field while working with innovative technologies.
- Qualifications: 5+ years in SDET or QA, strong Python skills, and testing experience.
The predicted salary is between 103995 - 127105 $ per year.
Own quality for Nexxa AI agents through Python automation and exploratory testing across industrial systems and operational scenarios. As a Senior or Staff SDET, you will build production-grade evaluation harnesses, simulators, regression suites, and CI/CD quality gates. You will test LLM-based agents across planning, tool selection, execution, recovery, and final outputs. The work combines API, contract, integration, end-to-end, performance, and reliability testing with manual trace review, red-teaming, and release verification.
Key Responsibilities:
- Build evaluation harnesses and regression suites for LLM-based agents
- Integrate automated evaluations into CI/CD quality gates
- Develop simulators, mocks, and sandbox environments for industrial tools
- Review traces, outputs, and agent behavior manually
- Turn failures and attacks into reproducible automated tests
Requirements:
- Five-plus years in SDET, QA, or software engineering
- Strong Python programming and software engineering practices
- Manual and automated testing experience for distributed systems
- Experience with CI/CD, Docker, and Kubernetes
- Experience testing APIs, microservices, and LLM-based products
Apply your automation, evaluation, and exploratory testing expertise to Nexxa’s high-stakes industrial AI systems.
Senior AI Agent Test Automation Engineer in Toronto employer: nexxa
Nexxa.ai is an exceptional employer for Applied AI Engineers, offering a dynamic work culture that fosters innovation and collaboration. With a focus on cutting-edge technologies like Generative AI and Machine Learning, employees are provided with ample opportunities for professional growth and development while working on impactful projects that directly benefit clients. The company's commitment to employee well-being, combined with the chance to travel and engage with diverse industries, makes Nexxa.ai a rewarding place to advance your career.
