At a Glance
- Tasks: Conduct statistical analysis and identify patterns in AI performance failures.
- Company: Join Crossing Hurdles, a partner with leading AI research labs.
- Benefits: $100-$120/hr, flexible hours, and remote work.
- Other info: Short contract duration with potential for growth in the tech field.
- Why this job: Make an impact in AI by improving task design and evaluation criteria.
- Qualifications: Strong stats background, Python or R proficiency, and data analysis experience.
The predicted salary is between 120 - 120 $ per hour.
Join to apply for the Data Scientist role at Crossing Hurdles.
Position Details:
- Position: Data Scientist
- Type: Hourly contract
- Compensation: $100-$120 per hour
- Location: Remote
- Duration: 3–4 weeks
- Commitment: 10‑40 hours/week, flexible and asynchronous
At Crossing Hurdles, we work as a referral partner. We refer candidates to our partner that collaborates with the world’s leading AI research labs to build and train cutting‑edge AI models.
Role Responsibilities (Training support will be provided):
- Conduct statistical failure analysis across finance‑sector AI tasks.
- Identify patterns in AI agent performance failures across task components (e.g., prompts, rubrics, templates).
- Perform root cause analysis to determine if failures stem from task design, rubric clarity, or agent limitations.
- Analyze performance variations across finance sub‑domains, file types, and task categories.
- Create dashboards and reports highlighting failure clusters, edge cases, and areas for improvement.
- Recommend improvements to task design, rubric structure, and evaluation criteria.
- Communicate insights to data labeling experts and technical teams.
Requirements:
- Strong foundation in statistical analysis, hypothesis testing, and pattern recognition.
- Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis.
- Experience with exploratory data analysis and deriving actionable insights from complex datasets.
- Familiarity with LLM evaluation methods and quality metrics.
- Comfortable working with Excel, data visualization tools (Tableau/Looker), and SQL.
Application Process (Takes 20 min):
- Upload resume.
- AI interview based on your resume (15 min).
Seniority level: Mid‑Senior level
Employment type: Contract
Job function: Research and Information Technology
Industries: IT System Data Services
Referrals increase your chances of interviewing at Crossing Hurdles by 2x.
Data Scientist – Remote in Winnipeg employer: Crossing Hurdles
Join a dynamic consulting firm that values innovation and leadership in the rapidly evolving AI landscape. With a flexible work schedule and competitive pay, we foster a collaborative culture that encourages professional growth and empowers our employees to make impactful contributions. Our remote work environment allows you to thrive while working alongside talented professionals dedicated to excellence in the Professional, Scientific, and Technical Services sector.
