- Python and PySpark programing languages to manipulate data and draw insights from large datasets
- Experience with AWS EMR, AWS Cloud
- Hands-on programming skills, able to write modular, maintainable code, preferably Python & SQL. Good understanding of SQL, dimensional modeling, and analytical big data warehouses
- Experience with Apache Airflow
- Experience with Python, PySpark programming in the context of data processing / data science applications
- Profound knowledge and experience in shell scripting in Linux/Unix environment. Experience in creating and maintaining documentation of project ETL design, technical artifacts and ETL environment
Duration:
5 Month contract
Must have:
- Python and PySpark programing languages to manipulate data and draw insights from large datasets
- Experience with AWS EMR, AWS Cloud
- Hands-on programming skills, able to write modular, maintainable code, preferably Python & SQL. Good understanding of SQL, dimensional modeling, and analytical big data warehouses
- Experience with Apache Airflow
- Experience with Python, PySpark programming in the context of data processing / data science applications
- Profound knowledge and experience in shell scripting in Linux/Unix environment. Experience in creating and maintaining documentation of project ETL design, technical artifacts and ETL environment
Our client…
A government health data organization.
Responsibilities:
- Understand systems and Business processes related to the products in their assigned portfolio
- Works closely with client analytical teams to develop, maintain and support products using Python and/or R and PySpark programming languages.
- Provides support and guidance on creating top-quality clean code and participates in code review.
- Analyses Software deficiencies/problems and support to fix them
- Prepares documentation, reports, and presentations related to projects and activities.
#J-18808-Ljbffr
Pyspark ETL Developer employer: isgSearch
As a leading employer in the public sector, we offer a dynamic work environment that fosters collaboration and innovation. Our commitment to employee growth is evident through ongoing training opportunities and a supportive culture that values diverse perspectives. Located in a vibrant community, we provide competitive benefits and a chance to make a meaningful impact on large-scale projects that shape the future of our organization.
