At a Glance
- Tasks: Lead the development of cloud-native data pipelines and infrastructure using cutting-edge technologies.
- Company: Join Egen, a fast-growing company with a data-first mindset and innovative culture.
- Benefits: Competitive salary, health benefits, remote work options, and opportunities for professional growth.
- Other info: Dynamic, agile environment with excellent career advancement opportunities.
- Why this job: Make a real impact by solving tough problems and innovating with advanced technology.
- Qualifications: Experience in building resilient data pipelines and implementing ETL/ELT processes.
The predicted salary is between 118800 - 145200 $ per year.
Egen is a fast-growing and entrepreneurial company with a data-first mindset.
We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights.
We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better.
We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results.
Our Data Engineering teams build scalable data pipelines using Python, Spark, and cloud services (GCP and AWS).
The pipelines we build typically integrate with technologies such as Kafka, Storm, and Elasticsearch.
We are working on a continuous deployment pipeline that leverages rapid on-demand releases.
Our developers work in an agile process to efficiently deliver high value applications and product packages.
As a Lead Engineer at Egen, you will leverage Spark and GCP (preferred) to architect and implement cloud-native data pipelines and infrastructure to enable analytics and machine learning on rich datasets.
Required
Experience: Built and run resilient data pipelines in production and have implemented ETL/ELT to load a multi-terabyte enterprise data warehouse.
Implemented analytics applications using multiple database technologies, such as relational, multidimensional (OLAP), key-value, document, or graph.
Defined data contracts, and wrote specifications including REST APIs.
Transformed data between data models and formats with the most modern Py Spark practices.
Have built cloud-native applications and supporting technologies / patterns / practices including: Cloud Services, Docker, CI/CD, Dev Ops, and microservices.
Planned and designed artifacts that describe software architectures involving multiple systems and technologies You've worked in agile environments and are comfortable iterating quickly.
Nice to have's (but not required): GCP expertise is preferred but will consider AWS Experience moving trained machine learning models into production data pipelines.
Experience in biotech, genomics, clinical research or precision medicine.
Expert knowledge of relational database modeling concepts, SQL skills, proficiency in query performance tuning, and desire to share knowledge with others.
#J-18808-Ljbffr
Lead Software Engineer in Mississauga employer: Egen
Egen is an exceptional employer that fosters a dynamic and innovative work culture, perfect for those looking to make a significant impact in the tech industry. As a Lead Cloud Data Engineer, you will enjoy opportunities for professional growth while collaborating with agile teams to develop cutting-edge data solutions on Google Cloud. Located in a vibrant tech hub, Egen offers a supportive environment that encourages creativity and values your contributions to transformative projects.
