At a Glance
- Tasks: Design and optimize scalable data pipelines using Azure technologies.
- Company: Join a leading tech firm focused on innovative cloud solutions.
- Benefits: Attractive salary, flexible work options, and opportunities for growth.
- Other info: Collaborative environment with a focus on professional development.
- Why this job: Make an impact by working with cutting-edge data engineering tools.
- Qualifications: 6+ years in data engineering with strong SQL and Python skills.
The predicted salary is between 123750 - 151250 $ per year.
We are looking for a Senior Azure Data Engineer to design, develop, and optimize scalable data pipelines and cloud data solutions.
The role focuses on data engineering, integration, and preparing reliable datasets for analytics and reporting.
Key Responsibilities
Design and maintain scalable ETL/ELT pipelines for batch and real-time data integration.
Develop optimized SQL queries, data models, and curated datasets for analytics.
Build data processing solutions using Python, Py Spark, and distributed processing frameworks.
Implement solutions using Azure Data Factory, Databricks, Azure Data Lake, and Synapse or Microsoft Fabric.
Improve pipeline performance, reliability, data quality, and monitoring.
Implement Data Ops practices and CI/CD pipelines using Azure Dev Ops.
Collaborate with analytics teams to provide trusted datasets for Power BI and other BI platforms.
Required Skills
6+ years of experience in data engineering, including hands-on cloud data platform experience.
Expert-level SQL and strong data modeling skills.
Strong proficiency in Python and Py Spark.
Proven experience building and optimizing large-scale ETL/ELT pipelines.
Hands-on experience with Azure Data Factory, Databricks, and Azure Data Lake.
Experience with Azure Synapse Analytics or Microsoft Fabric.
Strong understanding of Apache Spark, distributed processing, and streaming technologies such as Kafka or Azure Event Hubs.
Experience with Git, Azure Dev Ops, CI/CD, and Data Ops practices.
Understanding of Power BI data integration requirements, including preparing reporting-ready datasets.
Dashboard development is outside the scope of this role.
Nice to Have
Experience integrating data with Domo.
Exposure to Delta Lake, lakehouse architecture, and data governance.
#J-18808-Ljbffr
Cloud Engineer in Brampton employer: TechDoQuest
Join a forward-thinking company that prioritizes innovation and collaboration in the heart of the tech industry. As a Senior Full Stack Developer, you'll benefit from a dynamic work culture that fosters continuous learning and professional growth, with ample opportunities to mentor others and enhance your skills. Enjoy a competitive benefits package, flexible work arrangements, and the chance to work on cutting-edge projects that make a real impact in the cloud and platform engineering space.
