At a Glance
- Tasks: Evaluate AI-generated responses for accuracy and effectiveness across various topics.
- Company: Join a forward-thinking team focused on AI and language technology.
- Benefits: Competitive pay, remote work flexibility, and opportunities for skill development.
- Other info: Dynamic role with diverse topics and a chance to grow in a tech-driven environment.
- Why this job: Make an impact by shaping the future of AI communication and enhancing user experiences.
- Qualifications: Fluent in French and English with experience in language models and strong writing skills.
The predicted salary is between 36 - 36 $ per hour.
- Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across a wide range of topics.
- Perform fact-checking using reliable public sources and external tools.
- Create high-quality human evaluation data by annotating response strengths, gaps, and factual errors.
- Assess reasoning quality, tone, clarity, and completeness of AI-generated outputs.
- Ensure responses follow expected conversational behavior and system guidelines.
- Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.
Requirements
- Native-level or near-native fluency in French (ILR 5 / CEFR C2) with strong English proficiency.
- Proven experience using large language models and understanding real-world LLM use cases.
- Excellent writing skills with the ability to provide clear, nuanced, and structured feedback.
- Strong attention to detail and analytical thinking.
- Ability to work across multiple topics, domains, and evolving requirements.
- Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering.
- #J-18808-Ljbffr
Writer – Remote employer: Crossing Hurdles
Join a dynamic consulting firm that values innovation and leadership in the rapidly evolving AI landscape. With a flexible work schedule and competitive pay, we foster a collaborative culture that encourages professional growth and empowers our employees to make impactful contributions. Our remote work environment allows you to thrive while working alongside talented professionals dedicated to excellence in the Professional, Scientific, and Technical Services sector.
We think you need these skills to ace Writer – Remote
Fluency in French (ILR 5 / CEFR C2)
Strong English Proficiency
Experience with Large Language Models
Fact-Checking Skills
Writing Skills
Analytical Thinking
Attention to Detail
