Databricks Platform Architect/Engineer - SC Cleared - ASAP

Job Description

Databricks Platform Architect/Engineer - SC Cleared - Immediate

Please note - this is a fully remote contract opportunity. Candidates must hold active SC Clearance and have the unrestricted right to work in the UK. This role requires immediate availability or a short notice period.

About the Company

We are supporting a leading data and AI consultancy with a strong reputation for delivering modern cloud data platforms across enterprise and public sector organisations.

This is an opportunity to join a highly skilled team working on large-scale Databricks implementations, helping clients design, secure and optimise their data platforms. You'll work with modern technologies and best practices across platform architecture, governance, automation and cloud infrastructure, supporting the successful delivery of business-critical data initiatives.

The Role

As a Databricks Platform Architect/Engineer, you will play a key role in designing, implementing and governing enterprise Databricks platforms for a range of clients. You'll work across platform architecture, administration and automation, ensuring environments are secure, scalable and aligned to best practice.

You'll utilise technologies such as Databricks, Unity Catalog, Terraform and GitHub to support platform deployments, access management and infrastructure changes. You'll also help shape networking, security and disaster recovery strategies, ensuring platforms are resilient and well-governed.

Working closely with client stakeholders, architects and engineering teams, you'll provide technical guidance on platform design and operational best practices, while supporting knowledge transfer and documentation to enable long-term client success.

Key Responsibilities

• Design, implement and administer Databricks platforms across workspace and account levels.
• Manage Unity Catalog, permissions, identity management and platform governance.
• Design and review platform architectures, ensuring security, scalability and best practice.
• Support AWS networking, connectivity and platform isolation requirements.
• Develop and maintain Terraform-based infrastructure and access configurations.
• Build and enhance GitHub CI/CD pipelines for platform and infrastructure deployments.
• Define, document and support disaster recovery and operational processes
• Collaborate with client stakeholders, architects and engineering teams on platform initiatives.
• Produce clear technical documentation and deliver knowledge transfer to client teams.

About You

You will be a Databricks Platform Architect, Platform Engineer or similar professional with strong experience administering and supporting Databricks environments. You'll have a solid understanding of Unity Catalog, platform security, access management and AWS-based infrastructure, alongside experience using Terraform and CI/CD tooling to deliver scalable, well-governed platforms.

You'll be comfortable engaging with both technical and non-technical stakeholders, advising on platform best practices and translating complex requirements into effective solutions. Experience of platform architecture, governance and documentation will be essential, as will the ability to support knowledge transfer and enable long-term client ownership.

Key requirements:

• Strong experience administering and supporting Databricks platforms in enterprise environments.
• Proven knowledge of Unity Catalog, permissions models, identity management and platform governance.
• Experience designing and supporting Databricks deployments on AWS.
• Strong understanding of networking, private connectivity and platform security principles.
• Hands-on experience with Terraform for infrastructure and access management.
• Experience building and maintaining GitHub CI/CD pipelines.
• Knowledge of disaster recovery planning, documentation and operational best practice.
• Strong stakeholder management and client-facing communication skills.
• Active SC Clearance is essential.

What's on Offer

• Remote Role
• Opportunity to work with one of the UK's leading data and AI consultancies.
• Exposure to complex, enterprise-scale Databricks platform engagements.
• The chance to work with cutting-edge technologies across cloud, data and AI.

Why Apply?

This is an excellent opportunity to join a leading data and AI consultancy and play a key role in delivering enterprise-scale Databricks platforms for a diverse client base. You'll work with cutting-edge technologies including Databricks, Unity Catalog, Terraform and AWS, helping organisations design, secure and optimise their cloud data platforms.

You'll gain valuable experience working on complex platform architecture and governance initiatives, collaborating with highly skilled consultants and engineers while making a tangible impact on the success of large-scale data transformation programmes.

To apply for this role please submit your CV or contact Alessandro Hood (see below)

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.