Introduction A leading South African bank is expanding its cloud data engineering capability and is looking for an experienced Cloud Data Engineer to build and optimise enterprise-scale data platforms supporting advanced analytics, AI and real-time business insights.
This is not a traditional ETL role. We are looking for engineers who have built modern cloud-native data platforms on Azure.
Duties & Responsibilities
Design and develop scalable cloud-based data pipelines Build batch and real-time data ingestion solutions Develop enterprise data solutions using Microsoft Fabric and Databricks Engineer high-performance data lakes and data warehouses Develop PySpark/Python data transformation pipelines Implement DataOps, CI/CD and automated testing Optimise cloud data performance, scalability and reliability Work closely with Data Scientists, Analysts and Software Engineers
Desired Experience & Qualification Applicants must have hands-on experience with:
Microsoft Azure Microsoft Fabric Databricks Azure Data Factory Python PySpark Apache Spark CI/CD for data pipelines DataOps Azure Event Hub or Kafka SQL Enterprise Data Warehousing Data Lakes
Highly Advantageous
Ab Initio Azure Synapse SAS Denodo DB2 Warehouse Netezza Infrastructure as Code (IaC) Real-time streaming architecture
Experience Required
5+ years Data Engineering experience Proven experience building cloud-native Azure data platforms Experience developing enterprise-scale data pipelines Experience working with structured and unstructured data Financial Services or Banking experience highly advantageous Agile delivery experience
You'll Stand Out If You Have
Microsoft Fabric project experience Databricks certification Azure certifications Experience supporting AI, Analytics or Machine Learning platforms
Package & Remuneration Market Related Hourly Rate
Interested? Please Apply Only If You Can Answer YES to Most of These:
✔ Have you built production data pipelines using Microsoft Fabric?
✔ Have you worked extensively with Databricks?
✔ Do you have strong hands-on experience with Azure Data Factory, Python and PySpark?
✔ Have you built enterprise cloud data platforms on Microsoft Azure?
✔ Have you worked with streaming technologies such as Kafka or Azure Event Hub?
Sourced from external listing
Losika Consulting
Recruitment Agency
Sourced from PNet