Job Description

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team in Oxford. As a key member of our engineering department, you will play a pivotal role in designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform.

Responsibilities

  • Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, and other relevant Azure services.
  • Collaborate with data scientists and analysts to understand their data requirements and translate them into technical solutions.
  • Implement data quality and governance processes to ensure data integrity and reliability.
  • Optimize data pipelines for performance and cost-effectiveness.
  • Troubleshoot and resolve data-related issues.
  • Stay up-to-date with the latest advancements in data engineering and cloud technologies.

Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, or a related field.
  • 5+ years of experience as a Data Engineer or a similar role.
  • Strong proficiency in Azure data services, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Storage.
  • Experience with data ingestion, transformation, and loading processes.
  • Knowledge of SQL, Python, and other programming languages.
  • Familiarity with data warehousing and data lake concepts.
  • Excellent problem-solving and analytical skills.
  • Ability to work independently and as part of a team.

Bonus Points

  • Experience with cloud-native technologies and DevOps practices.
  • Certifications in Azure data technologies.
  • Contributions to open-source data engineering projects.