At a Glance
- Tasks: Design and implement cloud-based data platforms and services using cutting-edge technologies.
- Company: Join a forward-thinking organization focused on data innovation.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Dynamic role with potential for career advancement in a supportive environment.
- Why this job: Make an impact by optimizing data processes and collaborating with top tech talent.
- Qualifications: Experience with Databricks, Azure Data Services, and strong problem-solving skills.
The predicted salary is between 108000 - 132000 $ per year.
HM is looking for a Data Engineer - with the tech stack below
Must Have
- Experience with
Databricks , Delta Lake and Databricks SQL.
- Knowledge of
- Medallion
Architecture.
- Experience with
- Azure Data Services/Azure Data Factor y
- Experience with Informatica or equivalent integration platforms.
- Experience operationalizing common data models and metadata repositories.
Experience and Skill Set Requirements
- General Skills (80%)
- Demonstrated experience designing, implementing and supporting cloud-based data platforms and services.
- Experience developing scalable ETL/ELT processes, data pipelines and integration solutions.
- Experience implementing Data Ops practices including deployment automation, testing, monitoring and operational support.
- Experience with cloud-native data engineering and modern data platform architectures.
- Experience implementing metadata, lineage and data quality capabilities within cloud data environments.
- Experience developing integration solutions using APIs, event-driven architectures and batch or streaming technologies.
- Knowledge of data governance, security and operational best practices for cloud platforms.
- Experience automating metadata collection, data movement and operational processes.
- Experience supporting cloud modernization and data migration initiatives.
- Experience collaborating with architects, modellers and governance teams to operationalize data standards, metadata and common data models.
- Knowledge of performance optimization and scalability considerations for cloud data platforms.
- Ability to troubleshoot complex technical problems and develop practical solutions.
- Strong analytical, organizational and communication skills.
Resource will support the following deliverables
- Data pipelines and integration services
- Automated metadata collection and synchronization processes
- Cloud data platform implementation and configuration
- Data quality and lineage enablement
- CI/CD and Data Ops automation
- Data migration and interoperability services
- Cloud-hosted data products and reusable data services
- Metadata and governance platform integrations
Desirable Skills (20%)
- Experience with Databricks, Delta Lake and Databricks SQL.
- Knowledge of Medallion Architecture.
- Experience with Microsoft Fabric and Azure Data Services.
- Experience with Microsoft Purview.
- Experience with Informatica or equivalent integration platforms.
- Experience operationalizing common data models and metadata repositories.
- Experience with graph technologies and semantic repositories.
- Knowledge and understanding of AODA and related standards.
- Ability to meet tight deadlines and adapt to changing project priorities.
Nice to have
- Prior OPS/Public sector exp.
- Experience with Microsoft Purview and Microsoft Fabric
- #J-18808-Ljbffr
Senior DataOps/Cloud Data Engineer in Toronto employer: Flexstaf IT
Flexstaf IT is an exceptional employer located in Nepean, Ontario, offering a dynamic work culture that fosters innovation and collaboration. Employees benefit from comprehensive professional development opportunities, competitive compensation, and a supportive environment that values work-life balance. Join us to be part of a forward-thinking team dedicated to transforming enterprise architecture and security operations.
We think you need these skills to ace Senior DataOps/Cloud Data Engineer in Toronto
Databricks
Delta Lake
Databricks SQL
Medallion Architecture
Azure Data Services
Azure Data Factory
Informatica
