At a Glance
- Tasks: Vibe-code features, analyze AI outputs, and red-team models to ensure quality.
- Company: Join DataAnnotation, a leader in AI training with a collaborative spirit.
- Benefits: Earn up to $150+/hr, flexible remote work, and potential for high annual income.
- Other info: Dynamic projects with opportunities for long-term engagement and growth.
- Why this job: Make a real impact on AI development while honing your coding skills.
- Qualifications: Experience in shipping production code; no degree needed, just talent.
The predicted salary is between 54 - 66 $ per hour.
The newest models can vibe-code a whole feature in minutes. Someone has to check whether that code actually works, and that someone is you.
You'll run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways.
Every failure you document teaches the next generation of coding agents.
What you’ll actually do
Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.
- What we look for
- Professional or serious open-source experience shipping production code.
- Clear written English: your explanations are the training signal.
- No degree required. We care about what you can do, not where you learned it.
Compensation
Up to $150+/hr depending on task difficulty and specialization. Many contributors add $100k–$200k a year; some make it their full-time income.
About Data Annotation
Data Annotation is where 1M+ experts train the world’s leading AI models.
Hundreds of millions paid to contributors to date, and the average contributor stays 5+ years.
Flexible, remote, and always project-available.
#J-18808-Ljbffr
DevOps Engineer in Mississauga employer: DataAnnotation
At DataAnnotation, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to make a real impact in the field of AI and electronics. As an Electrical Engineer AI Evaluator, you will enjoy flexible remote work options, competitive compensation, and opportunities for professional growth, all while contributing to cutting-edge projects that shape the future of technology. Join us to be part of a dynamic team where your expertise is valued and your contributions drive meaningful advancements.