Data Engineer (Databricks Contractor)
We're seeking an experienced Databricks Engineer to help design and deliver strategic data solutions across enterprise platforms. This role will support both proof-of-concept work and the development of a Strategic Operational Data Store (ODS), with a focus on performance, scalability, and governance. This role is 3 days a week onsite in either Newcastle, London or Edinburgh and falls outside IR35.
Key Responsibilities
Lead Databricks platform evaluation, including performance benchmarking and stress testing
Collaborate with Databricks Professional Services for architectural assurance
Design and document scalable data models and integration patterns
Support enterprise integration, including Salesforce data and unified client ID strategies
Migrate Azure Data Factory flows to Databricks for improved traceability
Implement Unity Catalog for automated data lineage
Deliver backlog items through Agile sprint planning
Skills & Experience
Strong hands-on experience with Databricks, Fabric, Apache Spark, Delta Lake
Proficient in Python, SQL, and PySpark
Familiar with Azure Data Factory, Event Hub, Unity Catalog
Solid understanding of data governance and enterprise architecture
Effective communicator with experience engaging stakeholders
Desirable
Experience with Salesforce data integration
Prior involvement in platform PoCs or benchmarking
Knowledge of Strategic ODS and enterprise integration strategies
Recommended Jobs
Manager, IT Support
At Oura, our mission is to empower every person to own their inner potential. With our award-winning Oura Ring and app, we help over 2.5 million people turn insights about sleep, activity, and readin…
Software Engineer - Java (Tooling) - Technology
Starling is the UK’s first and leading digital bank on a mission to fix banking! We built a new kind of bank because we knew technology had the power to help people save, spend and manage their money…
Sales Manager
The opportunity As a Sales Manager at Shieldpay, you will be a key part of our Commercial team, identifying convertible leads and winning new business. This is a pivotal role in our growth journey…
Band 3 or 4 Cardiographer- Central London
Job Title: Cardiographer- Central London Banding: 3 or 4 Start date: 04/02/2025 Duration : 3 months Location: Central London Working Hours: Full time Rate: £14- £18 per hour…
Community Manager
ABOUT GREYSTAR Greystar is a leading, fully integrated global real estate company offering expertise in property management, investment management, development, and construction services in inst…
SEN Teaching Assistant
Are you currently seeking an exciting job as a SEN Teaching Assistant in a supportive school in London starting in September. Are you a hard-working, motivated and driven teacher who wants good su…
Sales Development Representative - London
Join the planet’s most important fight Normative is now looking for a Sales Development Representative for our team in London Our Sales team is growing and we’re now looking for a Sales Develop…
Project Manager - Theatrical, Localization
At Pixelogic, we believe that the fusion of creativity and technology holds the power to inspire and engage audiences on a global scale. With a strong emphasis on end-to-end creative, localization, a…
Occupational Health Advisor
You will be responsible for: Produce clear, professional, and clinically sound written reports. Advise on occupational health matters in line with legislation and best practice guidance. Co…
Sales Operations Coordinator
Sales Operations Coordinator INEOS Automotive – Built for More Story so far Since we started our journey to build a no nonsense 4X4, we’ve come a long way. We’ve established INEOS Automotive…