Databricks Data Engineer

Databricks Data Engineer – Data Ingestion

6 months – £550 a day (outside IR35)
Location: UK – Hybrid/Remote

We are looking for an experienced Databricks Data Engineer / Data Ingestion Engineer to join a large, global organisation.

The role is focused on data ingestion and engineering, connecting data from multiple sources and building robust pipelines within a modern Azure/Databricks environment.

Key Responsibilities

• Build and maintain data ingestion pipelines using Databricks.
• Connect to multiple data sources including SQL databases, APIs and Azure services.
• Develop pipelines using Azure Data Factory and Databricks Lakeflow.
• Implement appropriate ingestion strategies including incremental and batch loads.
• Develop ETL/ELT processes using Databricks Medallion Architecture.
• Write and maintain Python data engineering code.
• Use dbt for data transformation and modelling.
• Ensure pipelines are scalable, reliable and maintainable.

Key Skills

• Strong commercial Databricks experience.
• Proven data ingestion experience.
• Azure Data Factory.
• Databricks Lakeflow.
• SQL and API integration.
• Medallion Architecture.
• Strong Python.
• dbt.
• Experience with incremental/batch data ingestion.

We’re looking for this person to be Immediate availability or able to start within 1-2 weeks.