Build scalable cloud data pipelines with Python, SQL, and Databricks in a Cloud Data Engineer position focused on secure processing. This Cloud Data Engineer position centers on designing, building, and maintaining scalable data pipelines and Azure cloud platforms. You will work with large datasets, optimize workflows, and support efficient storage and processing. The work includes Spark programs, Delta Lake, data integration, and modeling. Key Responsibilities:
Build and optimize ingestion, transformation, and loading pipelines Develop Spark programs in Databricks for large datasets Optimize, monitor, and troubleshoot Databricks jobs Implement data management, security, and governance practices Perform code reviews against requirements and standards Requirements:
Five-plus years of Python coding experience Five-plus years developing with SQL Server large datasets Five-plus years deploying Databricks PySpark ETL pipelines Experience with cloud warehouses including Synapse or Snowflake Experience with dimensional data modeling and data warehousing Apply Python, SQL, Databricks, and cloud data engineering expertise to scalable pipelines and secure data processing.
#J-18808-Ljbffr
Cloud Data Engineer Databricks Python in Toronto employer: Rivago Infotech Inc
Join a forward-thinking company that values innovation and collaboration, where as a Senior Data Engineer, you will play a crucial role in shaping data solutions within the banking domain. Our supportive work culture fosters continuous learning and professional growth, offering opportunities to work with cutting-edge technologies in a dynamic environment. Located in a vibrant city, we provide competitive benefits and a commitment to employee well-being, making us an excellent employer for those seeking meaningful and rewarding careers.