ENVIRONMENT:
A well-established Software Engineering & QA Consultancy based in Johannesburg is actively looking for a Senior Data Engineer. This role involves the crucial tasks of developing and maintaining SQL Databases. To excel in this position, the ideal candidate should possess a B.Sc. degree in electronic and/or Computer Engineering or a related field. Furthermore, they must have a minimum of 5 years’ experience in the data engineering domain, with a strong command of SQL, proficiency in Python (preferably with pyspark experience), and an additional advantage would be familiarity with Data Warehousing, particularly Azure Synapse.
DUTIES:
- Development and maintenance of SQL Databases
- Development of data engineering and data analysis pipelines and solutions in the cloud (Azure)
- Ensure DevOps compliance for all data pipelines and workloads.
- Ensure development and maintain Power BI reports.
- Documentation of pipelines and databases.
- Troubleshooting and support to the Technical Operations team when dealing with production issues.
- Contribute to application and systems design in collaboration with the Software Architects.
- Provide mentorship and support to junior data engineers.
REQUIREMENTS:
Qualifications required:
- B.Sc. (Electronic and/or Computer Engineering) or similar qualification.
Experience required:
- Minimum of 5 years’ experience working within a data engineering environment.
Required Skill set:
- Strong SQL skills.
- Python and preferably pyspark experience.
- Data Lake experience (Azure Data Lake gen 2 experience preferred).
- NoSQL database experience (e.g., Cosmos DB, Couch Base, MongoBD, etc.).
- Azure Data Factory (ADF) experience or similar.
- Debugging and troubleshooting skills.
- Experience in writing technical documentation (architectural diagrams, release notes, etc.).
Additional Nice-to-have Skills:
- Data Warehouse experience – especially Azure Synapse.
- Databricks or Spark experience, with Azure Databricks being preferred.
- Data Science and AI/ML experience would be beneficial.
ATTRIBUTES:
- Good interpersonal and communication skills.
While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.
COMMENTS:
When applying for jobs, ensure that you have the minimum job requirements. Only SA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Apply here [URL Removed] e-mail a Word copy of your CV to [Email Address Removed] and mention the reference number of the job.
Desired Skills:
- Senior
- Data
- Engineer