|Remuneration:||R900000 – R1000000 per year negotiable|
|Company:||E-Merge IT Recruitment|
An awesome opportunity for an awesome lead data engineer is ready for the taking! A strategic thinker is needed to expand and optimise the organisations data and data pipeline architecture, whilst optimising data flow and collection to ultimately support data initiatives for an award-winning corporate bank.
Apply today and grow your skills exponentially!
- Postgraduate degree/master’s degree in information technology/information studies
- Eight years total number of years’ experience
- Strong analytic skills related to working with unstructured datasets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- A successful history of manipulating, processing and extracting value from large disconnected datasets
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
E-Merge IT Recruitment is a specialist niche recruitment agency with a wide range of positions available. We offer our technical skilled candidates’ options so that we can successfully place the right developers with the top companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 06 Nov 13:46
011 463 3633