At a Glance
- Tasks: Design and develop data-driven applications using Python and PySpark.
- Company: Join a leading tech firm focused on innovative data solutions.
- Benefits: Competitive salary, flexible work options, and opportunities for growth.
- Other info: Collaborative Agile environment with great career advancement potential.
- Why this job: Make an impact by building scalable systems with cutting-edge technologies.
- Qualifications: 10+ years in software development, with strong Python and PySpark skills.
The predicted salary is between 121500 - 148500 $ per year.
We are seeking an experienced Python/Py Spark Developer to design, develop, and optimize data-driven applications and solutions.
The ideal candidate will have strong expertise in Python, Py Spark, and Databricks, along with experience in Azure Dev Ops and enterprise data integration.
This role requires a deep understanding of algorithms, data structures, and best practices for building scalable and efficient systems.
Key Responsibilities
- Develop and maintain applications using Python and Py Spark.
- Implement ETL/ELT processes and integrate data pipelines.
- Utilize Databricks for data processing and analytics.
- Perform code testing and analysis using tools such as Pytest and Pylint.
- Collaborate with cross-functional teams to design and deliver high-quality solutions.
- Apply architectural design patterns and best practices throughout the SDLC.
- Consume APIs (REST and others) for data integration.
- Work in an Agile development environment and participate in sprint planning and reviews.
- Use version control, ticketing systems, and CI/CD workflows for efficient development.
- Required Qualifications
- Overall 10+ years of software development experience.
- Minimum 6 years of hands-on Python development experience.
- Strong experience with Py Spark and Databricks.
- Proficiency in Azure Dev Ops and CI/CD practices.
- Experience with Python testing and code analysis tools (Pytest, Pylint).
- At least 4 years of full-time development experience using Python.
- At least 4 years working with T-SQL, XML, and enterprise schedulers.
- Solid understanding of algorithms, data structures, and architectural design patterns.
- Extensive experience in software development and SDLC.
- Familiarity with frameworks such as Django, Flask, Pyramid, or Tornado.
- Integration experience (ETL, ELT) with Python; SSIS knowledge is a plus.
- Strong analytical mindset and ability to create high-level product specifications and design documents.
- Proven collaboration and influencing skills.
- Preferred Qualifications
- Experience with API management and advanced data integration techniques.
- Familiarity with cloud platforms and distributed systems.
- Exposure to Agile methodologies and tools like Jira.
- #J-18808-Ljbffr
Python/PySpark Developer in Mississauga employer: Compunnel Inc.
Join a forward-thinking company in Toronto that prioritizes innovation and employee development. As a Digital Banking Engineering Manager, you'll thrive in a collaborative work culture that values continuous improvement and offers ample opportunities for professional growth. With a focus on modern banking solutions, this role not only allows you to lead a talented team but also empowers you to make a meaningful impact in the digital banking landscape.
