Design scalable big data pipelines as a Senior Data Engineer on a fully remote team, using Python, SQL, and cloud platforms. This senior position supports advanced analytics and machine learning initiatives through reliable data infrastructure. You will build batch and real-time processing solutions, work with vast datasets, and improve data access. Collaboration with data scientists and analysts remains central to understanding requirements and delivering efficient systems. Key Responsibilities:
Design and optimize scalable batch and real-time data pipelines Build cloud data warehouses and data lakes Implement ETL and ELT processes from varied sources Ensure data quality, integrity, and reliability Monitor infrastructure and address performance issues proactively Requirements:
Six or more years in data engineering or related work Bachelor's degree in Computer Science, Engineering, or related field Big data pipeline experience with Spark, Hadoop, or Hive Proficiency in SQL and relational or NoSQL databases Python, Scala, or Java programming skills Apply senior data engineering expertise across pipelines, cloud infrastructure, SQL, and big data processing in a remote setting.
#J-18808-Ljbffr
Senior Big Data Pipeline Engineer in Kimberley employer: Placements24
Join a forward-thinking company that values innovation and offers a fully remote work environment, allowing you to thrive from anywhere in South Africa. With a highly competitive salary, significant bonus potential, and a generous budget for professional development, this role as Legal Counsel - Intellectual Property not only provides the opportunity to protect and manage a diverse IP portfolio but also fosters a culture of growth and collaboration. Embrace the chance to work on cutting-edge technology while shaping the future of the company's intellectual property.
