At a Glance
- Tasks: Design and refine evaluation criteria for preference data while collaborating with top researchers.
- Company: Join Turing, a leader in AGI infrastructure and cutting-edge AI projects.
- Benefits: Fully remote work, competitive compensation, and the chance to shape the future of AI.
- Other info: Flexible hours with opportunities for growth in a fast-paced setting.
- Why this job: Make an impact on groundbreaking AI projects and enhance your skills in a dynamic environment.
- Qualifications: Proficiency in Python or Typescript and strong communication skills are essential.
The predicted salary is between 63000 - 77000 $ per year.
Turing is one of the world's leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
About the Role: We're looking for a high-taste engineer with a strong eye for quality — someone who's worked hands‑on with preference data and rubric creation, and knows what separates a good example from a great one. You communicate clearly and can synthesize complex technical work the way a strong MAI dev would: concise, structured, and easy for others to act on. You're comfortable in ambiguous, fast-moving environments and default to shipping over deliberating.
What does day-to-day look like:
- Design, refine, and iterate on rubrics and evaluation criteria for preference data
- Review and label data with a high bar for quality, catching subtle issues others might miss
- Build and maintain pipelines/infra that support data generation, collection, and evaluation workflows
- Synthesize findings from data work into clear write-ups, updates, or recommendations for the team
- Collaborate closely with researchers/engineers to translate qualitative judgment into scalable processes
Required Skills:
- Proficiency in Python (especially building/maintaining pipelines and infra) or Typescript (experience contributing to or navigating large codebases like VSCode a plus)
- Hands‑on experience with preference data collection and/or rubric creation
- Strong written and verbal communication — able to distill technical work into clear, actionable summaries
- Demonstrated high‑taste judgment — able to articulate why something is good, not just that it is.
Perks of Freelancing With Turing:
- Work in a fully remote environment.
- Opportunity to work on cutting‑edge AI projects with leading LLM companies.
- Compensation: Market rate. Please share a specific rate expectation (rather than a range) so we can quickly assess mutual fit
- Availability: 40 hours/week preferred, with a minimum 6‑hour overlap with Pacific Time. If you're unable to commit to 40 hours, please share your available hours and overlap window
- Employment Type: Independent contractor (does not include medical or paid leave benefits)
- Duration: 3 months, with an expected start date as soon as possible
Evaluation Process (approximately 30 mins): One round of interview (30 mins of technical & cultural discussion)
Software Engineer – Remote in Montréal employer: Turing
Turing is an exceptional employer for those looking to thrive in the AI landscape, offering a fully remote work environment that fosters innovation and collaboration. Employees have the opportunity to engage with cutting-edge AI projects while enjoying flexible hours and the potential for contract extensions based on performance. With a strong emphasis on professional growth and a supportive culture, Turing empowers its team members to enhance their skills and contribute meaningfully to the future of technology.
