At a Glance
- Tasks: Design and develop scalable data processing applications using Apache Spark and Java.
- Company: Join a leading tech company focused on big data solutions.
- Benefits: Competitive salary, flexible hours, remote work options, and growth opportunities.
- Other info: Collaborative environment with a focus on innovation and career advancement.
- Why this job: Make an impact in the world of big data with cutting-edge technologies.
- Qualifications: Strong Java skills and experience with Apache Spark required.
The predicted salary is between 123750 - 151250 $ per year.
We are seeking a highly skilled
Spark Developer with strong Java expertise to design, develop, and optimize large-scale data processing applications. The ideal candidate will have hands‑on experience with
Apache Spark, Core Java, distributed computing, and big data technologies .
The candidate will work closely with data engineers, architects, and business stakeholders to build scalable and high‑performance data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data processing applications using
Apache Spark and Java .
- Develop batch and near real‑time data pipelines for large datasets.
- Optimize Spark jobs for performance, memory management, and resource utilization.
- Write efficient and reusable code using Java 8/11 features.
- Work with distributed data processing frameworks and big data ecosystems.
- Collaborate with cross‑functional teams to gather requirements and deliver data solutions.
- Troubleshoot production issues and provide performance tuning recommendations.
- Implement best practices for coding, testing, deployment, and monitoring.
- Participate in code reviews and technical design discussions.
- Ensure data quality, reliability, and scalability of applications.
- Required Skills
- Strong programming experience in
Core Java (Java 8 or above) .
- Hands‑on experience with
Apache Spark (Spark Core, Spark SQL, Data Frames, Dataset APIs) .
- Good understanding of distributed computing concepts .
- Experience with
HDFS, Hive, Hadoop Ecosystem .
- Strong SQL skills and experience with relational databases.
- Experience with data ingestion and transformation frameworks.
- Familiarity with Linux/Unix environments.
- Knowledge of REST APIs and microservices architecture.
- Experience with Git and CI/CD processes.
- Preferred Skills
- Experience with
Spark Streaming, Kafka, Scala, or Py Spark .
- Exposure to cloud platforms such as
AWS, Azure, or GCP .
- Experience with Airflow, Oozie, or similar workflow orchestration tools.
- Understanding of Delta Lake, Iceberg, or Data Lake architectures.
- Knowledge of containerization tools such as Docker and Kubernetes.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
- 4+ years of software development experience.
- 2+ years of hands‑on experience developing applications using Apache Spark and Java.
- #J-18808-Ljbffr
Spark Developer in Mississauga employer: Capgemini
Capgemini is an exceptional employer that fosters a dynamic and inclusive work culture, offering employees the chance to lead innovative ADM/AMS solutions in the vibrant Greater Toronto Area. With a strong emphasis on professional growth, extensive training opportunities, and a hybrid work model that promotes work-life balance, Capgemini empowers its team members to thrive while engaging with diverse clients across multiple countries. Join us to be part of a collaborative environment where your expertise in SAP and leadership can make a significant impact.
