At a Glance
- Tasks: Lead a team to design and optimize data pipelines using Microsoft Fabric and Airflow.
- Company: Join a forward-thinking tech company in Brampton, ON.
- Benefits: Competitive salary, flexible work options, and opportunities for growth.
- Other info: Collaborative environment with a focus on innovation and career advancement.
- Why this job: Make an impact by working with cutting-edge data technologies and mentoring others.
- Qualifications: Strong experience with Data Fabric technologies and cloud storage solutions.
The predicted salary is between 123750 - 151250 $ per year.
- This job posting is for an existing, active vacancy and we are looking to hire
- Microsoft Fabric & Airflow Resource at Brampton, ON . Responsibilities:
Lead the offshore engineering pod, providing mentorship and guidance to team members.
Design, build, and optimize data pipelines in Fabric Data Factory.
Orchestrate workloads using Fabric Airflow to ensure efficient data processing.
Manage Lakehouse and Warehouse items in One Lake, including configuration of shortcuts to various cloud storage solutions.
Implement and maintain Direct Lake semantic model configurations and Oracle mirroring setups.
Utilize Spark, Py Spark, SQL, T SQL, and Delta Lake for data processing and transformation.
Conduct interoperability testing with Databricks and Snowflake to ensure seamless integration.
Utilize Azure Dev Ops and Git for version control and CI/CD of Fabric artifacts.
Monitor consumption using the Fabric Capacity Metrics app and perform disciplined benchmarking.
Document technical processes and maintain clean technical documentation.
Coordinate across time zones with an onsite architect to ensure project alignment.
Mandatory
Skills
Strong experience with Data Fabric technologies.
Proficient in building and tuning pipelines in Fabric Data Factory.
Hands on experience with Fabric Airflow for workload orchestration.
Expertise in managing Lakehouse and Warehouse items in One Lake.
Solid understanding of cloud storage solutions: ADLS Gen2, AWS S3, and GCP Cloud Storage.
Proficient in Spark, Py Spark, SQL, T SQL, and Delta Lake.
Experience with Direct Lake semantic model configuration and Oracle mirroring setup.
Familiarity with Databricks and Snowflake for interoperability testing.
Fluency in Azure Dev Ops and Git for version control and CI/CD.
Experience using the Fabric Capacity Metrics app for monitoring.
Preferred
Skills
Experience in mentoring and leading engineering teams. Strong analytical and problem-solving skills. Excellent communication skills, both verbal and written.
#J-18808-Ljbffr
Microsoft Fabric & Airflow Resource in Brampton employer: TechDoQuest
Join a forward-thinking company that prioritizes innovation and collaboration in the heart of the tech industry. As a Senior Full Stack Developer, you'll benefit from a dynamic work culture that fosters continuous learning and professional growth, with ample opportunities to mentor others and enhance your skills. Enjoy a competitive benefits package, flexible work arrangements, and the chance to work on cutting-edge projects that make a real impact in the cloud and platform engineering space.
