SC Cleared Databricks Architect | Remote

Job Description

SC Cleared Databricks Architect | Remote

SR2 is supporting a major public sector data transformation programme seeking experienced Databricks Architects. We're interested in architects with strengths in platform design, data product architecture, or both.

The Role

You'll help shape an enterprise Databricks environment on AWS, supporting secure platform foundations and trusted, reusable data products. Working with engineering, governance and business teams, you'll define architecture that enables teams to discover, access and use data effectively.

Your focus will reflect your expertise, spanning platform infrastructure and integration through to data modelling, product standards and self-service analytics.

Key Responsibilities

• Define architecture, reference designs and reusable patterns for Databricks platforms and data products.

• Shape AWS platform foundations, integration approaches and processing patterns for batch and streaming workloads.

• Establish standards for data modelling, data contracts, metadata, quality and product life cycle management.

• Design governance and access controls through Unity Catalog, supporting discovery, lineage and secure data sharing.

• Guide performance, reliability and cost decisions across platform services and data workloads.

• Lead design reviews and stakeholder workshops, providing technical assurance and direction to delivery teams.

Essential

• Strong architecture experience delivering enterprise Databricks and Lakehouse solutions.

• Expertise in Delta Lake, Unity Catalog and modern data engineering patterns.

• Experience integrating Databricks with AWS, including relevant storage, identity and networking services.

• A strong background in either :

  • Platform architecture: AWS infrastructure, medallion architecture, compute, orchestration, Terraform and deployment automation.

  • Data product architecture: reusable data products, data contracts, modelling, metadata, governance and self-service consumption.

• Understanding of security, access management and governance within complex organisations.

• Ability to communicate architecture decisions clearly and guide multidisciplinary teams.

• SC clearance required.

Desirable

• Knowledge of Spark, dbt, Databricks SQL or Workflows.

• Experience applying data mesh principles and enabling governed data sharing.

• Relevant Databricks, AWS, Terraform or data management certifications.

The Details

• Contract role: 6-month rolling contract

• IR35 Status: Inside IR35

• Rate: £600-£650

• Location: Mainly remote - ad hoc visits in London.

• Clearance: SC required

If you are a Databricks Architect with platform or data product expertise and this looks of interest, please apply for immediate consideration.