Build Python pipelines for AI evaluation at Turing while shaping preference data and rubric quality in a fully remote environment. Clear technical writing and judgment matter here.
Turing seeks an engineer experienced with preference data, rubric creation, and high-quality evaluation work. You will support frontier AI labs by turning qualitative judgment into scalable processes. The work combines engineering, data review, communication, and collaboration with researchers and engineers.
Key Responsibilities:
- Design and refine rubrics for preference data evaluation
- Review and label data while catching subtle quality issues
- Build pipelines supporting data generation and evaluation workflows
- Synthesize findings into clear updates and recommendations
- Translate qualitative judgment into scalable team processes
Requirements:
- Proficiency in Python for pipelines and infrastructure
- Hands-on preference data or rubric creation experience
- Strong written and verbal communication skills
- Ability to explain why examples demonstrate quality
- Minimum six-hour overlap with Pacific Time preferred
Apply Python engineering, preference data expertise, and high-taste judgment to Turing's remote AI evaluation work.
Remote Python AI Evaluation Engineer in Ottawa employer: Turing
Turing is an exceptional employer for those looking to thrive in the AI landscape, offering a fully remote work environment that fosters innovation and collaboration. Employees have the opportunity to engage with cutting-edge AI projects while enjoying flexible hours and the potential for contract extensions based on performance. With a strong emphasis on professional growth and a supportive culture, Turing empowers its team members to enhance their skills and contribute meaningfully to the future of technology.
