ENVIRONMENT:
A fast-growing Pan-African PSP that makes online commerce and digital payment acceptance easier and more accessible across all Africa, is seeking a Data Engineer to Operationalize streaming platform and add more data sources (in raw form) to the data warehouse and build out more transformations that serve the business needs (using dbt and postgres native functions). The successful candidate must have at least 6 years of experience in the data field, working primarily with SQL and Python, and at least 4 – 6 years’ experience with data streaming and pub/sub models.
DUTIES:
- Operationalize streaming platform and add more data sources (in raw form) to the company’s data warehouse.
- Build out more transformations that serve the business needs (using dbt and postgres native functions).
- Build out complex models and algorithms to improve the company’s ability to help merchants and the Company to make better decisions.
- Examples could be alerting when payment processing seems down in a certain area, or advanced fraud detection.
- Allow other products to move over to event driven architectures.
How you’ll be making a difference:
- Work alongside the data team and be a part of the full software development life cycle.
- Building out the company’s core data infrastructure, that includes queuing platforms with a pub/sub architecture with a focus on security and reliability.
- Enabling other product teams to use the infrastructure by setting up guidelines, libraries, and training.
- Monitoring and improving the data warehouse, to make sure it keeps up with scale and usage.
- Show best practices in testing, documenting and the use of version control and deployment tools.
- Automate routine tasks.
REQUIREMENTS:
- At least 4 – 6 years of experience in the data field, working primarily with SQL and Python.
- At least 3 years’ experience with data streaming and pub/sub models.
- Experience with the AWS Stack (Or any other cloud environment).
- Eager to experiment with new technologies and learn new skills.
Tech Stack:
- Data: PostgreSQL, MongoDB, MySQL, Kafka
- Infra: AWS Lambda’s, Serverless, S3, API Gateway, DBT
- Tools: Jira, Confluence, Git, Postman, Pop SQL
- Automation: Gitlab pipelines, CI/CD, Terraform
- Backend: Python, Node, PHP
- Frontend: React, Angular, TypeScript, Material
Nice To Haves:
- BSc Computer Science, technical tertiary qualification or significant work experience.
- Have worked within the FinTech/Payments industry.
- Experience working with PostgreSQL.
- Experience with Kafka implementations.
ATTRIBUTES:
- Time- and self-management skills are vital.
While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.
COMMENTS:
When applying for jobs, ensure that you have the minimum job requirements. Only SA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Apply here [URL Removed] e-mail a Word copy of your CV to [Email Address Removed] and mention the reference number of the job.
Desired Skills:
- Data
- Engineer
- SQL