We are looking for a Databricks Architect with strong experience in building and optimizing ETL pipelines on cloud platforms like AWS or Azure. This role involves working on large scale data processing real time pipelines and leading data engineering initiatives.
Build and optimize ETL pipelines using Databricks and Spark
Work with SQL Python PySpark and Delta Lake for data processing
Implement CI CD pipelines using Azure DevOps and manage workflows with Airflow
Integrate data using APIs and support real time streaming solutions
Lead data engineering projects and collaborate with cross functional teams
Must Have Skills
- Strong Databricks and Spark experience
- SQL, Python and ETL pipeline development
- Experience with cloud platforms AWS or Azure
- Experience with Delta Lake and data processing
#J-18808-Ljbffr
Databricks Architect employer: Acunor
Acunor is an exceptional employer that fosters a collaborative and innovative work culture, making it an ideal place for professionals in the insurance sector. With a strong emphasis on employee growth and development, we offer comprehensive training programs and opportunities to lead impactful data governance initiatives. Located in a vibrant area, our team enjoys a supportive environment that values diversity and encourages meaningful contributions to the industry.
