At a Glance
- Tasks: Build and operationalize AI solutions using Python and PySpark.
- Company: Join a leading tech firm focused on innovative data engineering.
- Benefits: Competitive salary, flexible work options, and growth opportunities.
- Other info: Dynamic team environment with a focus on career advancement.
- Why this job: Make an impact in AI and data solutions while working with cutting-edge tech.
- Qualifications: Experience in Data Engineering and proficiency in Python, PySpark, and SQL.
The predicted salary is between 108000 - 132000 $ per year.
Python and PySpark expertise define this Data Engineering role, focused on AI applications, cloud platforms, and production-grade software engineering. Build and operationalize data and AI solutions using Python, PySpark, SQL, REST APIs, and FastAPI. The work spans ETL/ELT, batch and streaming pipelines, data quality, metadata, lineage, observability, and DataOps practices. You will also support MLOps and LLMOps capabilities across delivery and production.
Key Responsibilities:
- Profile unfamiliar client data using Python, pandas, PySpark, and SQL
- Build thin solutions with real client data and APIs
- Implement automated tests, security controls, and error handling
- Create evaluation datasets and measure ML or LLM quality
- Measure adoption and business impact using agreed KPIs
Requirements:
- Experience in Data Engineering and production-grade software engineering
- Hands-on Python, PySpark, SQL, REST APIs, and FastAPI expertise
- Experience with ETL/ELT, streaming pipelines, and data quality
- Knowledge of Git, Docker, Kubernetes, Airflow, and MLflow
- Bachelor's degree in a related discipline
- Apply Python, PySpark, data discovery, and production engineering skills across measurable AI and data solutions.
Senior Python PySpark Data Engineer in Toronto employer: Atlantis IT Group
Join a leading IT company in Toronto that values innovation and collaboration, offering a dynamic work culture where your contributions directly impact the payments domain. With a strong focus on employee growth, we provide ample opportunities for professional development and training in cutting-edge technologies like ISO 20022 and Real-Time APIs. Enjoy a competitive benefits package and the chance to work alongside industry experts in a fast-paced environment that fosters creativity and teamwork.
