Platform Engineer (AWS / Databricks)
Design and support secure integration across AWS S3, Databricks and downstream data platforms.
Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns.
Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls.
Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access.
Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns.
Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls.
Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog.
Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations.
Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns.
Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration.
Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations.
Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions
Recommended Jobs
Head of Growth Marketing (Hiring Immediately)
Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, indus…
Physics Teaching Assistant
Physics Teaching Assistant: Launch Exceptional Science Futures Step into the pivotal Physics Teaching Assistant role and ignite scientific curiosity at a thriving, forward-thinking Haringey school.…
Band 6 Locum Physiotherapist - London
Job Title: Locum Physiotherapist Banding : Band 6 Location : Queen Elizabeth Hospital, King’s Lynn NHS Foundation Trust Start Date: ASAP Position Type : Locum (12/08/24 – 30/09/24) …
Nursery Nurse - Haringey ASAP Start
Location: Haringey, London Salary: Competitive (Based on experience) Start Date: ASAP Trial Dates: 19 May 2026 A welcoming and vibrant nursery in Haringey is seeking a passionate, CACHE Level 3 quali…
Enterprise Sales Development Representative
Enterprise Sales Development Representative Location: London (Hybrid) Salary: up to £45,000 + £30,000 OTE (uncapped) Package: Pension • Unlimited leave • Flexible working • Healthcare cash pla…
Lead Data Scientist - Fraud Prevention (Hiring Immediately)
Company Description Wise is a global technology company, building the best way to move and manage the world’s money. Min fees. Max ease. Full speed. Whether people and businesses are sending m…
Gardener
I am looking for a number of Gardeners for Southwark Council to be based on housing estates MUST HOLD VALID DRIVING LICENCE Duties will include * Litter Picking * Weeding & Prunning * Grass C…
Client Advisor - 125
Harvey Nichols is seeking a Client Advisor to join our brand-new concept store, 125, located on the ground floor within our iconic Knightsbridge store. This is your opportunity to represent an inspir…
Dynamics 365 Developer
Dynamics 365 Developer - Remote (Tech stack: Microsoft Dynamics 365, PowerApps, Power Platform, C#, .NET, SQL, JavaScript, DevOps, Agile) Our client is a specialist technology business delivering b…