Job Summary:
Our client is seeking a highly skilled Senior Data Engineer with deep expertise in Snowflake and Matillion to design, build, and optimize scalable data pipelines and integration solutions. The ideal candidate will have a strong background in cloud data warehousing, ETL/ELT processes, and modern data architecture.
Responsibilities:
- Data Management and API integration.
- Design, develop, and maintain robust ETL/ELT pipelines using Matillion and Snowflake.
- Optimize Snowflake data warehouse performance and manage data models.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Ensure data quality, governance, and security best practices are implemented.
- Automate data validation, reconciliation, and monitoring processes.
- Document data architecture, pipelines, and integration processes.
- Mentor junior engineers and contribute to best practices and code reviews.
Experience:
- Matric and a tertiary qualification
- 8+ years of experience in data engineering or related roles.
- Strong hands-on experience with Matillion ETL and Snowflake.
- Proficiency in SQL and at least one programming language (e.g., Python, Java, or Scala).
- Experience with cloud platforms (AWS, Azure, or GCP).
- Familiarity with data modeling, data warehousing, and ELT best practices.
- Experience with CI/CD pipelines, version control (Git), and DevOps practices.
- Knowledge of data governance, security, and compliance (e.g., GDPR, SoX).
Job Summary:
Our client is seeking a highly skilled Senior Data Engineer with deep expertise in Snowflake and Matillion to design, build, and optimize scalable data pipelines and integration solutions. The ideal candidate will have a strong background in cloud data warehousing, ETL/ELT processes, and modern data architecture.
Responsibilities:
- Data Management and API integration.
- Design, develop, and maintain robust ETL/ELT pipelines using Matillion and Snowflake.
- Optimize Snowflake data warehouse performance and manage data models.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Ensure data quality, governance, and security best practices are implemented.
- Automate data validation, reconciliation, and monitoring processes.
- Document data architecture, pipelines, and integration processes.
- Mentor junior engineers and contribute to best practices and code reviews.
Experience:
- Matric and a tertiary qualification
- 8+ years of experience in data engineering or related roles.
- Strong hands-on experience with Matillion ETL and Snowflake.
- Proficiency in SQL and at least one programming language (e.g., Python, Java, or Scala).
- Experience with cloud platforms (AWS, Azure, or GCP).
- Familiarity with data modeling, data warehousing, and ELT best practices.
- Experience with CI/CD pipelines, version control (Git), and DevOps practices.
- Knowledge of data governance, security, and compliance (e.g., GDPR, SoX).
Desired Skills:
- data engineering
- Matillion ETL and Snowflake
- SQL + one more Python
- Java
- or Scala
- AWS
- Azure
- or GCP
- ELT best practices
- CI/CD pipelines