Databricks Lead

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting‑edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.

Your role

You will lead our Databricks team: the architecture, the delivery and the people. The team does the full range of Databricks work: greenfield lakehouse builds, migrations from legacy warehouses and Hadoop, data engineering and data products, analytics on Databricks SQL and AI/BI, machine learning and generative AI on Mosaic AI, platform operations and cost optimisation. You own the lakehouse design on every engagement, from the first workspace to data products and models in production, and you stay hands‑on in the parts that decide whether a platform holds: Unity Catalog, pipelines, security and cost. You lead a team of Databricks engineers that is growing fast and run the technical side of bids and estimates. Part of our work comes through our data and AI governance consultants, who define what a client's platform must guarantee: who owns which data, which rules apply, what evidence an auditor gets. On those engagements your team makes it true on Databricks. You will work across clouds (Azure first, AWS and GCP as clients need).

Your tasks

• Own the lakehouse architecture on client engagements: account and workspace design, networking and identity, Unity Catalog, data model, compute and cost strategy, CI/CD.
• Lead Databricks programmes end to end: migrations from legacy warehouses and Hadoop, greenfield lakehouse builds, platform hardening and cost reviews; set the engineering standards (code review, testing, Databricks Asset Bundles, Terraform).
• Deliver data engineering, analytics and ML on the platform: ingestion with Lakeflow Connect, pipelines and data products, Databricks SQL and AI/BI, machine learning and generative AI with MLflow and Mosaic AI; performance tuning and cost optimisation.
• Lead and grow the Databricks engineering team: hiring, technical coaching, certification plan, staffing across engagements.
• Run the technical side of bids: solution design, estimates, proofs of concept, sizing and cost models; present architecture choices and their cost to client architects and executives.
• On engagements with our Data & AI Governance practice, make sure governance designs land in the platform: access models in Unity Catalog, lineage and audit evidence, data quality in pipelines, model governance with MLflow.
• Build reusable assets: reference architectures, migration playbooks, ingestion and cost accelerators, platform standards, and the governance‑by‑design reference architecture developed with the governance team.
• Follow the Databricks roadmap (Lakeflow, Mosaic AI, AI/BI, Lakebase, serverless) and decide what we adopt, when and for which clients.

Your profile

• 8+ years in data engineering or data architecture, at least 4 of them on Databricks, including several years leading engineers or delivery teams.
• Proven delivery of at least two production lakehouse platforms end to end: platform setup, ingestion and pipelines, data model, analytics or ML consumption, operations.
• Deep hands‑on knowledge of Spark, Delta Lake, Unity Catalog, Lakeflow pipelines and jobs (formerly Delta Live Tables and Workflows), Databricks SQL and MLflow; infrastructure as code with Terraform and Databricks Asset Bundles; CI/CD.
• Strong on one cloud (Azure preferred) and able to work on AWS or GCP: networking, identity, storage, security and cost.
• Experience with performance tuning and cost optimisation of Databricks workloads; experience with analytics and ML workloads (Databricks SQL, AI/BI, Mosaic AI) is a plus.
• Databricks Certified Data Engineer Professional; further Databricks certifications or partner accreditations (e.g., Solutions Architect, Platform Administrator) are a plus.
• Presales experience: solution design, estimation and client presentations; ability to defend an architecture and its cost in front of executives.
• Experience leading and developing engineers; excellent communication skills; fluent English.
• Experience in financial services, energy, pharma or public sector is highly desirable.

What You'll Love About Working Here

• Practical benefits: yearly financial bonus, private medical care with Medicover with additional packages (e.g., dental, senior care, oncology) available on preferential terms, life insurance and access to NAIS benefit platform.
• Access to over 70 training tracks with certification opportunities (e.g., Ge