Senior Data Engineer
|Remuneration:||R950000 – R960000 per year|
|Company:||E-Merge IT Recruitment|
If discovering and unlocking the hidden potential in massive data sets is what you love, then you’ll love this role! We’re on the hunt for a senior data engineer to join an international media group with a footprint across Europe, Asia and Africa.
Working remotely and reporting to the head of Ssarch and data, you’ll leverage your data mining and statistical analysis skills, as well as your ability to build best in class prediction systems to enable enhanced business performance and data-driven decisions.
In terms of tech, you’ll be highly proficient in Python with solid experience working on either AWS or GCP, building big data pipelines and data sets.
- Two+ years’ experience working with either AWS or GCP
- Solid understanding of Data Lakes
- 4+ years’ experience building and optimizing big data pipelines, architecture and data sets.
- Ability to leverage various skills/techniques to extract value from large data sets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Highly skilled in analysing large, unstructured data sets.
- Working knowledge of message queuing, stream processing and highly scalable “big data” data stores
- Design, build and maintain data pipeline architecture
- Design data integration and data quality frameworks
- Assemble large complex data sets according to business requirements
- Design and implement internal process improvements i.e – optimisation of data delivery, automation of manual processes etc…
- Ensure data security
- Unit/integration testing
Are you ready for a change of scenery? e-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 09 Jul 15:15