Sorry, this advert is now closed. Click here to view our live vacancies.

Data Engineer,

 

My client is recruiting for a Data Engineer, within this position you will support the software developers, architects, data analysts and data scientists on initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

 

Responsibilities

  • Extract, cleanse and transform data in RDMS, NoSQL, Kafka, etc from other units and transform them into a new cloud big data solution to be used for applications, reports, real time analytics and AI algorithms
  • Capable of working with both structured and unstructured data sets (NLP)
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders on data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure

Requirements

  • Working with Big Data & Information Retrieval
  • Data mining or Machine Learning
  • Working data warehouses, including data warehouse technical architectures, infrastructure components, ETL/ELT and reporting/analytic tools and environments, data structures.
  • Writing software in one or more languages such as Java, C++, Python, Go, JavaScript
  • Database design and querying (e.g., SQL, MySQL, MapReduce, Hadoop)
  • Strong project management and organisational skills
  • Strong communication skills and ability to lead and push forward initiatives to create value for the business