Azure Data Factory and Databricks expertise define this senior Toronto position. Build scalable pipelines with PySpark for Wipro Limited's cloud data solutions.
Wipro Limited seeks a Senior/Lead Azure Data Engineer to develop large-scale Microsoft Azure data platforms. The work includes ADF, Azure Databricks, PySpark, Autosys, Python, SQL, and ETL/ELT frameworks. Solutions support analytics, reporting, regulatory, and operational requirements through collaboration with stakeholders and architects.
Key Responsibilities:
- Design scalable ingestion and transformation pipelines using Azure Data Factory
- Build and optimize processing solutions with Azure Databricks and PySpark
- Develop batch and near real-time integration workflows
- Implement data quality, validation, reconciliation, and monitoring frameworks
- Schedule and troubleshoot jobs using Autosys and orchestration tools
Requirements:
- Bachelor's or master's degree in a related field
- Eight or more years in Data Engineering and Data Warehousing
- Five or more years with Azure Data Platform technologies
- Hands-on experience with ADLS, MySQL, PySpark, SQL, and Autosys
- Proficiency in Python, SQL, distributed computing, and Spark architecture
Bring Azure Data Factory, Databricks, PySpark, and enterprise data engineering expertise to Wipro Limited in Toronto.
Senior Azure Data Engineer Toronto employer: Wipro
Wipro in Canada is an exceptional employer that fosters a dynamic work culture focused on innovation and collaboration. With a commitment to employee growth, we offer extensive training programs and career advancement opportunities, ensuring that our team members thrive in their roles. Our location provides a vibrant environment where you can engage with cutting-edge technologies and contribute to meaningful projects that drive transformation across industries.
