We are looking for an Expert Data Engineer with at least 6 -12 years hands-on experience implementing, testing, and monitoring Data Engineering solutions with AWS.
This role will work on the new Hybrid system which involves Remote work and office rotations on a weekly basis.
This is a long-term fixed Contract until Dec 2024 (Renewable annually thereafter)
- Applies advanced knowledge of area
- Ability to develop within a specific sought-after programming language
- Strong working knowledge with software development tools, techniques and approaches used to build data engineering solutions
- Cloud computing technologies, Business drivers and emerging computing trends
- Understanding of integration between different technologies
- Planning and monitoring
- Eliciting requirements
- Requirements organisation
- Translating and simplifying requirements
- Document requirements in appropriate format depending on methodology followed
- Assist with identification and management of risks
Minimum Requirements
At least 6 -12 years hands-on Data Engineering experience
Extensive experience in implementing, testing, and monitoring Data Engineering solutions
AWS experience
Above average experience/understanding (in order of importance):
• Terraform
• Python 3x
• SQL – Oracle/PostgreSQL
• Py Spark
• Boto3
• ETL
• Docker
• Linux / Unix
• Big Data
• Powershell / Bash
Basic experience/understanding of AWS Components (in order of importance):
• Glue
• CloudWatch
• SNS
• Athena
• S3
• Kinesis Streams
• Lambda
• DynamoDB
• Step Function
• Param Store
• Secrets Manager
• Code Build/Pipeline
• CloudFormation
Nice to have:
• Business Intelligence (BI) Experience
• Technical data modelling and schema design (“not drag and drop”)
• Kafka
• AWS certified developer / architect