At a Glance
- Tasks: Build reliable data pipelines and ensure high-quality data for researchers.
- Company: Join a cutting-edge datastore focused on innovative data solutions.
- Benefits: Flexible part-time hours, competitive pay, and a collaborative work environment.
- Other info: Work in a dynamic Toronto office with opportunities for growth.
- Why this job: Make a real impact by transforming on-chain history into trustworthy data.
- Qualifications: Experience in data pipeline development with SQL and either Python, Rust, or Go.
The predicted salary is between 90000 - 110000 $ per year.
Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers.
Elevate data correctness and infrastructure while ensuring high quality and accuracy.
As a Data Engineer, you will design and run large-scale decoding pipelines, focusing on Solana and Hyperliquid history.
This role demands significant experience in building production data pipelines, emphasizing SQL alongside either Python, Rust, or Go.
You'll ensure correctness through rigorous validation, checksums, and lineage documentation, addressing customer inquiries about schemas and coverage.
Key
Responsibilities
- Design and implement backfill pipelines at scale
- Model typed schemas for various protocols
- Build validation systems for data correctness
- Maintain accurate versioning and documentation
- Optimize storage layout for fast query performance
Requirements
- Proven experience in production data pipeline development
- Proficiency in SQL plus Python, Rust, or Go
- Familiarity with Parquet and tools like Duck DB
- Strong focus on data correctness and validation
- Willingness to work part-time in Toronto office
Help create a reliable data pipeline that researchers can trust, ensuring high-quality deliveries every time. #J-18808-Ljbffr
Data Engineer for On-Chain Pipelines in Toronto employer: CLR3
At datastore, we pride ourselves on being an exceptional employer that fosters a collaborative and innovative work culture. As a Data Engineer in our Toronto office, you'll not only have the opportunity to work with cutting-edge technologies but also benefit from continuous professional development and a supportive team environment that values your contributions. Join us to make a meaningful impact in the world of data while enjoying a flexible work-life balance and engaging projects that challenge your skills.
