Data Software Engineer (Azure Databricks)

Data Software Engineer - Azure Databricks

Location: London, UK

Duration: 6 months, with extensions expected

Description

We're looking for a Data Software Engineer - Azure Databricks to join our client team in London, UK in a hybrid working mode. In this role, you will design and implement data engineering solutions leveraging Azure Databricks and related Azure services to build large-scale, high-performance data pipelines. You will collaborate across teams to meet project requirements, deliver robust solutions and optimize data processing for massive datasets, ensuring project success in a collaborative, fast-paced environment.

Responsibilities

• Develop and implement scalable data engineering solutions using Azure Databricks

• Design and optimize data pipelines for multi-million record datasets

• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions

• Monitor and enhance performance of data workflows across Azure services

• Participate in stakeholder discussions and communicate project status effectively

• Identify and resolve technical issues, escalating as appropriate for timely resolution

Requirements

• 6-8 years of experience in Data Engineering, with mastery of Azure Databricks

• Proven experience in designing and implementing complex data pipelines using Azure Data Factory and Databricks

• Knowledge of Scala for development is highly desirable

• Strong performance optimization experience for large-scale data environments

• Solid understanding of Azure cloud services and data processing frameworks

Nice to Have

• Experience in Agile delivery frameworks and practices

• Databricks certification

• Familiarity with CI/CD pipelines for data engineering projects

About Korn Ferry

Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit Korn Ferry at www.Kornferry.com