At a Glance
- Tasks: Evaluate and improve AI assistants in real-world business workflows.
- Company: Join a forward-thinking team focused on AI innovation.
- Benefits: Flexible remote work, competitive pay, and the chance to shape AI technology.
- Other info: Great opportunity for career growth in a dynamic, tech-driven environment.
- Why this job: Make a real impact by enhancing AI tools that businesses rely on.
- Qualifications: 5+ years in tech-related roles; experience with AI tools like ChatGPT.
The predicted salary is between 40.5 - 49.5 $ per hour.
We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows. You'll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.
Scope of Work
- Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
- Document workflows and identify where AI performance meets or falls short of real business requirements.
- Evaluate AI-generated outputs using defined rubrics and quality criteria.
- Provide clear, actionable feedback to AI research and product teams.
- Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
- Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
- Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.
Preferred Qualifications
- 5+ years of professional experience in any business function involving technology and operational problem-solving.
- Bachelor's degree or higher in any discipline.
- Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
- Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
- Comfortable working with AI tools and common workplace productivity platforms.
- Excellent written English and strong documentation skills.
- Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.
AI Agent Power User – Remote in Toronto employer: YO AI Labs
At YO AI Labs, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to thrive in a remote environment. As a Product Owner, you will have access to continuous learning opportunities and the chance to make a significant impact by shaping AI-enabled products that drive real business value. Join us for a rewarding career where your contributions are valued and recognized, all while enjoying the flexibility of remote work.
