Engineer massive text datasets with Python and distributed processing at LawZero in Montreal, supporting Scientist AI training. Shape high-signal data pipelines at scale. As a Senior Machine Learning Data Processing Developer, you will work across data engineering, curation, and machine learning. Build production pipelines for web-scale datasets, with deduplication, quality scoring, filtering, privacy controls, and provenance. Partner with Research, Engineering, and Legal/Governance teams to translate evolving requirements into reliable data systems. Key Responsibilities:
Build and scale pipelines transforming raw web-scale data into training datasets Implement deduplication, scoring, filtering, metadata extraction, and PII scrubbing Monitor quality, guardrails, alerting, leakage, and dataset provenance Acquire text corpora and analyze coverage gaps systematically Develop researcher tools for dataset exploration and querying Requirements:
Computer science, software engineering, or related degree Five-plus years processing massive unstructured text datasets Python proficiency and production-grade data-processing experience Distributed frameworks such as Spark, Ray, or Flink Pipeline orchestration experience with Airflow, Prefect, or Dagster Bring large-scale data processing, machine learning, and quality engineering expertise to LawZero’s Scientist AI data pipeline.
#J-18808-Ljbffr
Senior Machine Learning Data Engineer in Montréal employer: LoiZéro
At LawZero, we pride ourselves on being an exceptional employer dedicated to fostering a collaborative and inclusive work culture in the vibrant Mile-Ex district of Montreal. Our team enjoys comprehensive health benefits, generous vacation time, and unique opportunities for professional growth while contributing to a globally critical initiative in AI safety. Join us to work alongside passionate experts in a mission-driven environment that values diversity and innovation.
