At a Glance
- Tasks: Develop and maintain ETL processes using Python and PySpark for data insights.
- Company: Join a government health data organization making a difference.
- Benefits: Competitive pay, flexible hours, and valuable experience in data processing.
- Other info: Collaborative environment with opportunities for professional growth.
- Why this job: Be part of impactful projects that enhance public health through data.
- Qualifications: Experience with Python, PySpark, SQL, and AWS; strong analytical skills.
The predicted salary is between 62100 - 75900 $ per year.
Duration
5 Month contract
Must have
- Python and Py Spark programing languages to manipulate data and draw insights from large datasets
- Experience with AWS EMR, AWS Cloud
- Hands-on programming skills, able to write modular, maintainable code, preferably Python & SQL.
- Good understanding of SQL, dimensional modeling, and analytical big data warehouses
- Experience with Apache Airflow
- Experience with Python, Py Spark programming in the context of data processing / data science applications
- Profound knowledge and experience in shell scripting in Linux/Unix environment.
Experience in creating and maintaining documentation of project ETL design, technical artifacts and ETL environment
Our client...
A government health data organization.
Responsibilities
- Understand systems and Business processes related to the products in their assigned portfolio
- Works closely with client analytical teams to develop, maintain and support products using Python and/or R and Py Spark programming languages.
- Provides support and guidance on creating top-quality clean code and participates in code review.
- Analyses Software deficiencies/problems and support to fix them
- Prepares documentation, reports, and presentations related to projects and activities.
- #J-18808-Ljbffr
Pyspark ETL Developer in Toronto employer: ISG Search Inc
ISG Search Inc is an exceptional employer located in the vibrant city of Toronto, offering a dynamic work culture that fosters innovation and collaboration. With a strong emphasis on employee growth, you will have access to cutting-edge technologies and AI-assisted tools, while enjoying a hybrid work model that promotes work-life balance. Join us to be part of a forward-thinking team dedicated to cloud modernization and enterprise solutions, where your contributions will make a meaningful impact.