At a Glance
- Tasks: Integrate large datasets and develop an IDE using Jupyter Lab.
- Company: Join a leading tech firm focused on innovative data solutions.
- Benefits: Competitive salary, flexible work options, and opportunities for growth.
- Other info: Collaborative environment with a focus on professional development.
- Why this job: Make a real impact in data engineering with cutting-edge technologies.
- Qualifications: 8+ years in Python and PySpark, AWS expertise required.
The predicted salary is between 108000 - 132000 $ per year.
Project description
The project involves the data engineering organization’s Analytical Work Bench , which is an integrated development environment.
The objective is to rationalize and integrate AWB with another internally developed application.
Additionally, the project includes creating an IDE based on the Jupyter Lab environment using custom code developed by Client.
Responsibilities
- - Integrate large datasets into the research ecosystem via the resource platform.
SKILLS
- Must have
- A university degree in Engineering or Computer Science is preferred. Hard skills:
- Proven experience working with cloud-based technologies, specifically AWS.
- Solid expertise in Big Data solutions utilizing AWS EMR.
- Advanced proficiency in Python Core and Py Spark, with over 8 years of hands-on experience.
- Practical knowledge of Pylint and Pytest for code quality and testing, with at least two years of experience.
- Extensive experience with package management and automation tools such as Py PI and Gulp for over five years.
- Familiarity with continuous integration and continuous delivery pipelines using Jenkins and Urban Code, with more than two years of experience. Soft skills:
- Excellent communication skills demonstrated through collaboration with end users to gather and discuss complex business requirements effectively.
- Nice to have
- UI development with React: Familiarity with building user interfaces using React is advantageous.
- Jupiter
Lab: Experience working with Jupiter Lab is a beneficial asset.
- Data Engineering and/or Data Science experience: Having skills or experience in data engineering or data science is a plus.
- #J-18808-Ljbffr
Senior Python Developer with PySpark and AWS in Toronto employer: Luxoft
At Luxoft, we pride ourselves on fostering a dynamic and inclusive work culture that empowers our employees to thrive. Located in the vibrant city of Toronto, we offer competitive benefits, continuous learning opportunities, and a collaborative environment where innovation is encouraged. Join us to be part of a team that values your contributions and supports your professional growth in the exciting field of software development.
