At a Glance
- Tasks: Lead the design and implementation of advanced analytics solutions using Azure Databricks.
- Company: Join a forward-thinking tech company focused on innovation and collaboration.
- Benefits: Competitive salary, health benefits, remote work options, and opportunities for professional growth.
- Other info: Fluency in French is mandatory; excellent career advancement opportunities await.
- Why this job: Make a real impact by leveraging cutting-edge technologies in a dynamic environment.
- Qualifications: 12 years of experience in data engineering with strong SQL and Azure Databricks skills.
The predicted salary is between 121500 - 148500 $ per year.
Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks and Microsoft Fabric. Apply deep expertise in big data technologies, data engineering, cloud computing, Azure Databricks, and strong SQL skills to deliver scalable solutions. Work closely with business stakeholders and IT teams to understand requirements and deliver effective, business-aligned solutions. Oversee end-to-end implementation of data solutions, ensuring alignment with business requirements and industry best practices.
Lead the development of data pipelines and ETL processes using Azure Databricks, PySpark, and other relevant tools. Integrate Azure Databricks with Azure services such as Azure Data Lake, Azure Synapse, Azure Data Factory, and on-premises systems. Provide expertise in Spark; Scala experience is an added advantage. Demonstrate strong Microsoft Fabric expertise, including pipeline development, notebook development, semantic modelling, real-time intelligence, and related scenarios.
Provide technical leadership and mentorship to the data engineering team, fostering a culture of continuous learning and improvement. Ensure proper documentation of architecture, processes, and data flows while maintaining compliance with security and governance standards. Promote best practices for code quality, data security, scalability, and maintainability. Stay current with the latest developments in Databricks and associated technologies to support continuous innovation.
Mandatory French-speaking capability.
Strong experience with Azure Databricks, including cluster management, notebook development, and Delta Lake. Proficiency in big data technologies such as Hadoop and Spark, along with data processing frameworks such as PySpark. Experience with Power BI, SSRS, SSAS, and SKU migration from P-SKU to F-SKU. Experience with ETL/ELT processes, data warehousing, and data lake development. Strong SQL skills and familiarity with NoSQL databases. Experience with CI/CD pipelines and version control systems such as Git. Knowledge of cloud security best practices.
Soft Skills
Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. Strong problem-solving skills and a proactive approach to identifying and resolving issues. Leadership skills, with the ability to manage and mentor a team of data engineers.
Nice-to-Have Skills
Power BI experience for dashboarding and reporting. Microsoft Fabric experience for analytics and integration tasks. Spark Streaming experience for processing real-time data streams. Familiarity with Azure Resource Manager templates for infrastructure as code practices.
Experience
Demonstrated expertise of 12 years in developing data ingestion and transformation pipelines using Databricks/Synapse notebooks and Azure Data Factory. Solid understanding and hands-on experience with Delta tables, Delta Lake, and Azure Data Lake Storage Gen2. Experience using Auto Loader and Delta Live Tables for seamless data ingestion and transformation. Proficiency in building and optimizing query layers using Databricks SQL. Demonstrated experience integrating Databricks with Azure Synapse, ADLS Gen2, and Power BI for end-to-end analytics solutions. Prior experience developing, optimizing, and deploying Power BI reports. Familiarity with modern CI/CD practices, especially in the context of Databricks and cloud-native solutions.
11543 in Toronto employer: Maarut
At Maarut, we pride ourselves on being an exceptional employer in Ottawa, offering a dynamic work culture that fosters collaboration and innovation. Our commitment to employee growth is evident through mentorship opportunities and professional development programs tailored for actuarial leaders. With a focus on strategic impact and a supportive environment, we empower our team to make meaningful contributions while enjoying the unique advantages of working in Canada's vibrant capital.
