About the role
We are seeking a skilled and motivated Data Engineer to join our dynamic data engineering team.
Responsibilities:
? Understand and analyse client requirements and business needs.
? Identify, analyse, visualise, and understand supporting data to propose solid solutions.
? Design and develop data layers to power Big Data analytics.
? Architect data integration pipelines and ensure successful data extraction, transformation, and loading from various sources.
? Create and maintain technical documentation.
? Support existing solutions within GCP and Oracle.
? Analyse specifications and data, designing data warehouse and product layers.
? Develop, test, and ensure the quality of data pipelines and layers.
? Perform peer reviews and comply with the SDLC process and documentation standards.
Team Collaboration and Support
? Participate actively in the product team and provide cross-training and mentorship.
? Provide timely status updates to the team.
? Log change requests and accurately log time.
? Participate in standby rotation.
? Be a team player: collaborate, socialise, and engage with your product team and the wider team at all times.
and IT responsibilities.
? Ensure successful creation of the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
Minimum Requirements:
? Bachelor’s degree in Computer Science, Information Technology, Engineering.
? 4-6 years of data warehouse ETL experience.
? Knowledge of cloud platforms (AWS, Azure, Google Cloud) and their data services.
? Proficiency in SQL and experience with relational databases (Oracle, PostgreSQL, MySQL, SQL Server).
? Experience with dimensional modeling and data analysis.
? Preferred experience with data visualization tools and the retail industry.
? Understanding of version control (SVN/GIT) and proficiency in programming languages such as Python, Java, Korn shell scripting, and SQL.
? Broad understanding of different SDLCs
? Exposure to Agile methodologies.
Desired Skills:
- Data Warehousing
- ETL
- SQL
- AWS
- Azure
Desired Qualification Level:
- Degree