Lead Data Architect / Lead Data Engineer - Azure Databricks | Energy Trading

ownership of the architecture, design and technical leadership of an enterprise

helping define best practice whilst remaining hands-on across complex data engin

Experience within Energy & Utilities, particularly Energy Trading, is ideal

Interim Inside IR35 day-rate contract role:

We're recruiting for an experienced Lead Data Architect / Lead Data Engineer to join a major Energy & Utilities transformation programme.

This is an opportunity to take ownership of a modern Azure Databricks platform, leading architecture whilst remaining technically hands-on across enterprise-scale data engineering initiatives.

You'll work alongside senior stakeholders, engineering teams and architects to design scalable Lakehouse solutions supporting critical business data.

What you'll be doing

Leading Azure Databricks architecture

Designing enterprise Lakehouse solutions

Building scalable Spark and Delta Lake pipelines

Designing streaming and batch data platforms

Driving engineering best practice

Mentoring engineers

Working closely with senior business stakeholders

Defining future-state data architecture

Technical Environment

Azure Databricks

Apache Spark / PySpark

Delta Lake

Azure Data Factory

Azure Data Lake Gen2

Azure Event Hubs

Azure Synapse

Python

SQL

Terraform

CI/CD

Medallion Architecture

We're looking for

Expert Databricks experience

Strong Azure Data Platform experience

Enterprise Data Architecture

Hands-on technical capability

Leadership experience

Excellent stakeholder engagement

Previous Energy, Utilities or Energy Trading experience would be highly desirable.

Contract

£600-675 per day

Inside IR35

9-12 months

Fully remote with occasional London workshops

UK-based applicants only