Job Description
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team in Oxford. As a key member of our engineering department, you will play a pivotal role in designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform.
Responsibilities
- Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, and other relevant Azure services.
- Collaborate with data scientists and analysts to understand their data requirements and translate them into technical solutions.
- Implement data quality and governance processes to ensure data integrity and reliability.
- Optimize data pipelines for performance and cost-effectiveness.
- Troubleshoot and resolve data-related issues.
- Stay up-to-date with the latest advancements in data engineering and cloud technologies.
Qualifications
- Bachelor's degree in Computer Science, Data Engineering, or a related field.
- 5+ years of experience as a Data Engineer or a similar role.
- Strong proficiency in Azure data services, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Storage.
- Experience with data ingestion, transformation, and loading processes.
- Knowledge of SQL, Python, and other programming languages.
- Familiarity with data warehousing and data lake concepts.
- Excellent problem-solving and analytical skills.
- Ability to work independently and as part of a team.
Bonus Points
- Experience with cloud-native technologies and DevOps practices.
- Certifications in Azure data technologies.
- Contributions to open-source data engineering projects.