Lead Data Platform Engineer Databricks Data Mesh Architecture

Lead Data Platform Engineer (Databricks/ Data Mesh Architecture)

Location: European Union (Remote or Hybrid)

Full-Time

Join the Future of Digital Tech with Kolomolo

At Kolomolo, we don’t just follow trends - we set them. As a global supplier of IT services and digital modernization solutions, we help businesses embrace cutting-edge technology to optimize their operations. Now, we are growing and looking for fresh talent to grow with us.

Are you proactive, tech-savvy, and eager to build your career in IT? This role could be your perfect fit.

About the Role

As a Lead Data Platform Engineer, you will drive the design, development, and governance of Kolomolo’s next-generation data platform, with a huge focus on Databricks.This is not a typical data engineering position, its is a technical leadership and architecture role where you will define standards, guide implementation, and enable distributed data ownership through a Data Mesh approach.

You will:

• Architect and evolve Kolomolo’s lakehouse-based data platform (Databricks, Delta Lake, cloud-native storage).

• Define domain-oriented data products aligned with data mesh principles.

• Lead the design and rollout of data platform capabilities, which involves ingestion, transformation, cataloging, governance, observability, and lineage.

• Partner with business domain teams to enable self-service data access and stewardship.

What You’ll Be Doing

• Design, build and maintain data pipelines, data modeling and transformation workflows on the Databricks platform (batch & streaming) to ingest, process and deliver data at scale.

• Lead the architecture and roadmap for the data platform and its evolution toward a federated, domain-driven model.

• Work with cloud services (e.g., AWS / Azure / GCP) and infrastructure tools (Terraform, CI/CD pipelines) to deploy and manage data platform components.

• Implement and optimise data models, schemas, and storage (e.g., Delta Lake) for structured and semi-structured datasets.

• Promote platform observability - logging, monitoring, cost optimization, and data quality tracking.

• Collaborate closely with data scientists, analysts, BI teams and business stakeholders to translate business requirements into technical solutions.

• Ensure high data quality, governance, security and observability in all data artefacts and processes.

• Troubleshoot performance, scalability, reliability issues of data pipelines, tuning Spark/Databricks job performance as required.

• Contribute to best practices around data engineering (e.g., code reviews, version control, documentation, test automation).

• Mentor junior engineers and help build a culture of continuous improvement in data platform engineering.

What We Are Looking For

Core: Databricks (PySpark, Delta Lake, Unity Catalog), Spark SQL, Airflow, Data Mesh, Platform-focused.

• 7+ years of professional experience in data engineering and platform architecture, with at least 3 years of hands-on Databricks experience.

• Strong experience with Databricks (e.g., PySpark/Scala, Spark SQL, Delta Lake) in production environments.

• Proficiency in Python, SQL, and preferably experience with Scala or Java.

• Deep understanding of cloud platforms (AWS/Azure/GCP) including data/analytics services, storage, compute, networking.

• Hands-on with infrastructure-as-code tools (e.g., Terraform), CI/CD pipelines and DevOps practices.

• Experience with both batch and streaming data processing and modern data architectures (e.g., lakehouse, Medallion architecture).

• Solid problem-solving skills, attention to detail, and ability to work in a fast-moving, collaborative environment.

• Excellent communication skills and ability to interface with technical and non-technical stakeholders.

What is in It for You

• Competitive salary and benefits.

• Career development opportunities in a growing tech company.

• Continuous learning culture: mentorship, internal training, and certifications.

• Flexible, agile work environment (remote from Poland or Hybrid in Stockholm, Sweden).

• Office perks: great coffee, tea, fresh fruit, snacks, and a fun atmosphere.

• Flat management structure, where your voice matters.

• Regular team events and a social, supportive work culture.

Why Join Kolomolo?

At Kolomolo, we prioritize innovation, agility, and autonomy. Our teams have the freedom to own their work, share ideas, and make meaningful contributions. Inspired by Scandinavian values, we believe in work-life harmony and creating an inclusive culture where everyone thrives.

You will be part of a passionate, skilled, and friendly team that works hard and celebrates together. Here, you can build your career on your own terms, with opportunities to grow, learn, and make a real impact.

Our Flat Structure & The Culture of Inclusion

At Kolomolo, we break the corporate mold. We offer:

• Agile Teams & Autonomy: No micromanagement. You’ll own your projects and enjoy the freedom to innovate.

• Work-Life Harmony: Inspired by Scandinavian values, we prioritize balance and flexibility, where remote work and asynchronous collaboration are in our DNA.

• Learning & Growth: Continuous learning is at our core. We reward hard work, value smart ideas, and foster an environment of mutual respect and trust.

• Inclusive Culture: We believe in DEI: diversity, equity and inclusion. We are committed to creating an environment where every individual, regardless of background, identity, or experience feels valued, respected, and empowered to thrive.

Join Kolomolo and elevate your career with cutting-edge technology, a supportive team, and a company that truly values your input.

Ready for the next step? Apply now and start an exciting journey of growth and innovation with us