Data Engineer (Python/Kafka/RabbitMQ) at Datafin Recruitment

Apr 13, 2021

ENVIRONMENT:A Specialist IT Service Provider in Durbanville seeks the technical expertise of a highly meticulous, analytical & solutions-driven Data Engineer with strong Python skills and must be a SA Citizen. Your other skills should include knowledge of event-based systems including Kafka and RabbitMQ, MuleSoft Anypoint Platform, IBM MQ, Amazon MQ, ZeroMQ Google Cloud Pub/Sub, knowledge of working with stream data pipeline frameworks or solutions e.g., Apache Flink, Beam, Dataflow, Databricks; experience with Cloud data platforms and be able to gather requirements and formulate business metrics for reporting and experience with Development methodologies – Agile, Kanban or Scrum. It would be beneficial if you have a Degree in Stats/Economics/Maths or related quantitative field and have 3-4 years’ work experience with SSIS/SSAS or ADF/AAS. You must also be willing to travel [URL Removed] aggregate, and analyse data from multiple internal and external sources to drive insights into business performance.

  • Produce actionable reports that show key performance indicators, identify areas of improvement into current operations and display root cause analysis of problems.
  • Enhance data collection procedures to include information that is relevant for building analytic systems.
  • Communicate complex findings and insights to stakeholders and provide business strategy recommendations to optimize business performance.
  • Provide reporting solutions and respond to ad-hoc report requests as needed.
  • Educate and/or train business partners on operational use of reporting solutions.
  • Assist with segmenting, profiling, matching, de-duplication, and standardization of master data.

    • REQUIREMENTS:Qualifications –

    • A Degree in a quantitative field, i.e., Statistics, Economics, Mathematics, Computer Science, or another related field would be beneficial.

    Experience/Skills –

    • Python.
    • Knowledge of event-based systems: e.g., Kafka, RabbitMQ etc.
    • MuleSoft Anypoint Platform.
    • IBM MQ.
    • Google Cloud Pub/Sub.
    • Amazon MQ.
    • KubeMQ.
    • PubSub+.
    • ZeroMQ.
    • Knowledge of working with stream data pipeline frameworks or solutions e.g., Apache Flink, Beam, Dataflow, Databricks etc.
    • Knowledge of cloud data platforms.
    • Gathering requirements and formulating business metrics for reporting.
    • Experience with Agile or other development methodologies – Kanban or Scrum.
    • Experience within the Automotive and/or Manufacturing industry a plus.
    • 3-4 Years’ work experience with SSIS/SSAS or ADF/AAS.
    • Working experience with reporting tools like Cognos, Power BI, Tableau, Qlik etc.
    • Intermediate to advanced SQL, optimization, developing ETL strategies.
    • Intermediate to advanced knowledge of database and data warehousing principles (e.g., OLAP, Data Marts, Star Schema, lambda/kappa architectures).
    • Must be a SA Citizen.

    ATTRIBUTES:

    • Self-starter with the ability to successfully plan, organise, and execute assigned initiatives with minimal guidance and direction.
    • Strong listening, problem-solving, and analytical skills.
    • Ability to articulate complex concepts, features, and benefits of analyses to any audience.
    • Willing to take initiative.
    • Excellent written and verbal communication skills.
    • Exhibits close attention to detail and is a champion for accuracy.
    • High level of Integrity.
    • Proven ability to meet deadlines, ability to multi-task effectively.
    • Proactive, results-oriented, and can-do attitude extremely desirable.
    • The ability and willingness to do a variety of different tasks.

    While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.COMMENTS:When applying for jobs, ensure that you have the minimum job requirements. OnlySA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Please e-mail a word copy of your CV to [Email Address Removed] and mention the reference numbers of the jobs. We have a list of jobs on [URL Removed] Datafin IT Recruitment – Cape Town Jobs.

    Learn more/Apply for this position