Data Engineer
Job Purpose
- The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives.
- Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders.
- They also create data pipelines, Ingestion, provisioning, streaming, self-service, API and solutions around big data that support the Bank’s strategy to become a data driven organisation.
Job Responsibilities
- Responsible for the day to day maintenance of data pipelines, providing support to the data squads including performing data related tasks (such as data profiling, data cleaning, data configurations, data support, data validation, data quality assurance) in a Data Epic and assisting in basic data pipelines, data ingestion and supporting Data Engineers in their Epics.
- Data Infrastructure: Support and maintain the Data Infrastructure to ensure it is secure, available and reliable.
- Data Pipeline Build (Ingestion, Provisioning, Streaming and API):
- Maintain data pipelines starting with Data Virtualisation, then progressing to Data Ingestion and finally to Data Provisioning.
- Ensure that data pipelines are monitored and run successfully and configure and support minor changes in data pipelines.
- Data Visualisation: Create virtual data bases and assist in creating data extracts for the business in response to business needs
Desired Skills:
- Data Engineer
- Data Engineer
- Data Engineer