Senior Data Engineer in Montréal

We are seeking an experienced Senior Data Engineer to support our North American Retirement organization. The role has significant exposure to Senior Leadership and opportunities to collaborate with business stakeholders and data professionals alike. Your day-to-day will involve partnering with business and technology teams to translate data needs into scalable solutions; designing, building, testing, and monitoring cloud-based data pipelines and models; troubleshooting data quality and production issues; optimizing platform performance and reliability; reviewing code and promoting engineering standards; and supporting analytics, reporting, and machine learning use cases with trusted, well-governed data.

Key Responsibilities:

• Collaborate with fellow data engineering colleagues across the organization to deliver secure, reliable, and efficient data engineering solutions.
• Design, build, and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis.
• Implement data orchestration pipelines, data sourcing, cleansing, augmentation, and quality control processes.
• Collaborate with business and technology stakeholders to understand current and future data infrastructure requirements.
• Design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow; including those specifically tailored for machine learning workflows.
• Design, implement, and maintain existing and future data platforms like data warehouses, data lakes, data lakehouses for structured and unstructured data.
• Collaborate with Data Scientists and Engineers to create features and pre-process data for ML models and move data analysis models into production.
• Design and develop analytical tools, algorithms, data landscape modernization roadmaps, and programs to support Data Engineering activities like writing scripts and automating tasks.
• Utilize a variety of data interchange formats to ensure data requirements are met and continuously monitor data integrity across the organization.
• Deploy machine learning models with existing production systems and workflows, considering compatibility with other systems, data sources, and APIs.
• Design and promote effective use of data querying APIs to provide easy access to organizational data sources.
• Evaluate, integrate, and manage tools and frameworks within the data engineering ecosystem, ensuring compatibility and efficiency in model development and deployment.
• Design and promote data versioning and lineage tracking, including transparency and traceability for data used in ML model training and inference.

Job Requirements:

• 4 or more years of experience as a data engineer or data scientist with proficiency in big data engineering.
• Ability to collaborate effectively in a large highly matrixed organization with many different data teams.
• Expert in SQL and PySpark.
• Knowledge of database systems, data lakes, and NoSQL databases.
• Knowledge of data warehouse concepts and architectures and working with Parquet files.
• Proficiency in using job orchestration tools like Roadrunner.
• Familiarity with data quality and data modelling tools.
• Proficiency in using version control systems like Git for managing codebase.
• Experience with Azure cloud environment especially Azure Data Factory, ADLS, and Databricks.
• Experience with integrating to back-end/legacy environments.

Preferred Qualifications:

• Experience working on Agile teams using Scrum and Kanban.
• Experience with Call Centre analytics and operations.
• Experience with vector databases and AI engineering.
• Bilingualism (English and French) is an asset. If the successful candidate is in Québec, proficiency in both languages will be required to support clients from various provinces outside of Quebec.
• Familiarity with Tabular Editor & Roadrunner.
• Knowledge of Manulife & John Hancock Retirement products systems and operations.

Decision Authority:

• Leads projects or work streams independently and contributes to their planning.
• Act as professional expertise information resource in creating data engineering solutions to business problems.
• Requires advanced problem-solving skills.

At Manulife/John Hancock, we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment, retention, advancement and compensation, and we administer all of our practices and programs without discrimination on the basis of race, ancestry, place of origin, colour, ethnic origin, citizenship, religion or religious beliefs, creed, sex (including pregnancy and pregnancy-related conditions), sexual orientation, genetic characteristics, veteran status, gender identity, gender expression, age, marital status, family status, disability, or any other ground protected by applicable law.