Senior Data Engineer

Share and send to your friends !

Senior Data Engineer

Remuneration: Market related
Benefits: Negotiable
Location: Cape Town
Type: Permanent
Reference: #21069
Company: Datafin Recruitment

A dynamic Tech Company specialising in building FinTech platforms seeks the technical and analytical expertise of a Senior Data Engineer for a hands-on role to help build out, setup and manage its data infrastructure to ensure high-level automation & optimal performance. You will require experience with Kafka, Flink, Spark, Apache Airflow, ideally GCP but strong experience in AWS/Azure will be accepted, Cloud data warehouses such as BigQuery, Redshift or Snowflake, Java, Python, Kubernetes and be able to produce transparent and easily navigable data pipelines and be comfortable writing detailed design documents. Please note Remote work on offer.
Duties:
  • Setup and manage the data infrastructure plus building new systems where required.
  • Build and optimize key ETL pipelines on both batch and streaming data.
  • Work with the teams from Product, Engineering, BI/Analytics and Data Science.
  • Take ownership of data model design and data quality.
  • Play an active role in ensuring data governance tooling is implemented and policies thereby adhered to.
  • Value should be assigned to consistently producing high quality metadata to support discoverability and consistency of calculation and interpretation.

Requirements:
  • Ideally GCP, but strong experience in another platform such as AWS or Azure will suffice.
  • Able to produce transparent and easily navigable data pipelines.
  • Event streaming platforms such as Kafka.
  • Stream analytics frameworks such as Flink, Spark, GCP Dataflow, etc.
  • Workflow scheduler such as Apache Airflow.
  • Cloud data warehouses such as BigQuery, Redshift or Snowflake.
  • Fluent using Kubernetes.
  • Java and Python.
  • Comfortable writing detailed design documents.
  • A solid understanding of the retail banking domain is highly desirable, but not required.
  • Able to work with technical leadership to make well informed architectural choices when required.
  • A high degree of empathy is required for the needs of the downstream consumers of the data artefacts produced by the Data Engineering team, i.e., the Software Engineers, Data Scientists, Business Intelligence Analysts, etc

While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.
Comments:
When applying for jobs, ensure that you have the minimum job requirements. Only  SA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Please e-mail a word copy of your CV to target="_blank and mention the reference numbers of the jobs. We have a list of jobs on http://www.datafin.com . Datafin IT Recruitment - Cape Town Jobs.
Posted on 04 Jul 21:26

Apply

Chantelle Lawrence
[email protected]
087 351 0743


Digital DTP/Animator Remuneration: negotiable Cost to company  Location: Johannesburg Job level: Mid Type: Permanent Company: Ad Talent Africa Job description An award-winning creative  full-service agency has an opportunity for a digitally-savvy…
Senior Product Data Scientist Benefits: Negotiable Location: Cape Town Type: Permanent Reference: #20963 Company: Datafin Recruitment ENVIRONMENT: If you enjoy finding innovative solutions to complex problems, then a dynamic global…
General Details Location: , SandtonJohannesburg Advertised By: Agency Job Type: Full-Time Description • Developer Portal • API Manager Developer toolkit • XPath • RegEx • HTTP status codes • GET/POST…
Job Summary An internship in IT support is available at Ultra Electronics Forensic Technology South Africa. Ultra Electronics Forensic Technology is a Global organization that has pioneered automated ballistic identification…
Senior C# Developer Remuneration: R900000 – R1000000 per year  Location: Johannesburg, Sandton Education level: Degree Job level: Senior Type: Permanent Reference: #SZ53069 Company: E-Merge IT Recruitment A reputable life insurance hub with…
Platemaker/DTP Operator Remuneration: R8000 per month negotiable Cost to company  Location: Johannesburg, West Rand Job level: Junior/Mid Own transport required: Yes Type: Permanent Reference: #PLATEMAKER/DTP Company: Worldwide Positions Job description Platemaking, typsetting and…