Lead GCP Data Engineer Architect

3 tygodni temu

Gdansk, Polska Xebia sp. z o.o. Pełny etat

You will be: designing, building and optimizing the data ingestion pipeline to reliably deliver billions of events daily in defined SLA, leading initiatives to improve scalability, performance and reliability, providing support for all product teams in building and optimizing their complex pipelines, identifying and addressing pain points in the existing data platform; proposing and implementing high-leverage improvements, developing new tools and frameworks to streamline the data platform workflows, driving adoption of best practices in data and software engineering (testing, CI/CD, version control, monitoring), working in close collaboration with data scientists and data analysts to help support their work in production, supporting production ML workflows and real-time streaming use cases, mentoring other engineers and contributing to a culture of technical excellence and knowledge sharing. Your profile: 6 years of hands-on experience in data engineering and large-scale distributed systems, proven expertise in building and maintaining complex ETL/ELT pipelines, deep knowledge of orchestration frameworks (Airflow) and workflow optimization, strong GCP cloud infrastructure experience, GKE experience, expert-level programming in Python or Scala, solid understanding of Spark internals, experience with CI/CD tools (e.g., Jenkins, GitHub Actions) and infrastructure as code, familiarity with managing self-hosted tools like Spark or Airflow on Kubernetes, experience managing data warehouse in BigQuery, strong communication skills and a proactive, problem-solving mindset, very good command of English (min. C1). Work from the European Union region and a work permit are required. Candidates must have an active VAT status in the EU VIES registry: https://ec.europa.eu/taxation_customs/vies/ Nice to have: working experience with messaging systems like Kafka, Redpanda, experience with real-time data streaming platforms (e.g., Flink, Spark Structured Streaming), familiarity with ML platforms or MLOps workflows, familiarity with Kubeflow, Valido, Looker, Looker Studio. Recruitment Process: CV review – HR call – Interview (with Live-coding) – Client Interview (with Live-coding) – Hiring Manager Interview – Decision Benefits Development: development budgets of up to 6,800 PLN, we fund certifications e.g.: AWS, Azure, access to Udemy, O'Reilly (formerly Safari Books Online) and more, events and technology conferences, technology Guilds, internal training, Xebia Upskill. We take care of your health: private medical healthcare, multiSport card - we subsidise a MultiSport card, mental Health Support. We are flexible: B2B or employment contract, contract for an indefinite period.

  • GCP Data Architect

    6 dni temu

    Gdansk, Polska Capgemini Polska Pełny etat

    GCP Data Architect Miejsce pracy: Gdańsk Technologies we use Operating system Windows About the project At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive...

  • Data Engineer

    4 tygodni temu

    Gdansk, Polska Capgemini Polska Pełny etat

    Data Engineer (GCP) Miejsce pracy: Gdańsk Technologies we use Operating system Windows Linux About the project Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to...

  • Data Engineer

    4 dni temu

    Gdansk, Polska SOFTGENT SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    Data Engineer (Senior / Lead) Miejsce pracy: Gdańsk Technologies we use Expected Python Google Cloud Platform DataFlow ETL Optional Apache Flink Java TypeScript Operating system Windows Linux About the project We're looking for an experienced Data Engineer - ideally a former Backend Engineer - to build a scalable data pipeline from scratch. The project is...

  • Cloud Data Architect

    2 dni temu

    Gdansk, Polska Capgemini Polska Pełny etat

    Cloud Data Architect Miejsce pracy: Gdańsk Technologies we use Expected AWS Microsoft Azure Google Cloud Platform Cloud Dataflow BigQuery Cloud Dataproc Cloud KMS Pub/Sub Google Kubernetes Engine Apache Beam Kafka Spark Snowflake Data Cloud Azure SQL Azure Function Power BI Terraform Redshift Glue Athena Kinesis Lambda Python Scala Java Bash About the...

  • Solution Architect

    6 dni temu

    Gdansk, Polska Strive Sp. z o.o. Pełny etat

    Dla jednego z naszych Klientów, międzynarodowej firmy technologicznej, tworzącej aplikacje mobilne i webowe, która projektuje i rozwija innowacyjne aplikacje mobilne i webowe dla globalnych marek, poszukujemy doświadczonego Solution Architect'a. Twój zakres obowiązków Projektowanie, tworzenie i rozwój architektury najnowocześniejszych aplikacji...

  • Data Solution Architect

    2 dni temu

    Gdansk, Polska Sii Sp. z o.o. Pełny etat

    Data Solution Architect Miejsce pracy: Gdańsk Technologie, których używamy Wymagane DWH Data Lake Snowflake Kimball Data Vault O projekcie Do naszego Centrum Data & AI poszukujemy doświadczonego Data Solution Architekta, który wesprze nas w budowie i optymalizacji nowoczesnych platform danych. Jeśli masz doświadczenie w projektowaniu skalowalnych...

  • Site Reliability Engineer Architect SRE

    3 tygodni temu

    Gdansk, Polska EPAM Systems Pełny etat

    We are seeking an experienced and accomplished Site Reliability Engineer/Architect (SRE) to join our dynamic, fast-paced team. In this pivotal leadership role, you will be entrusted with architecting and implementing advanced SRE practices to ensure the reliability, scalability, and efficiency of our Generative AI (GenAI) enablement platform for enterprise...

  • Data Platform Lead

    2 tygodni temu

    Gdansk, Polska Plenti Pełny etat

    Cześć! Dla naszego klienta, globalnego banku z siedzibą główną w Szwecji, poszukujemy doświadczonej osoby na stanowisko Data Platform Lead . W tej roli będziesz odpowiadać za stworzenie od podstaw nowoczesnej platformy danych, która zasili zarówno zaawansowaną analitykę, jak i kluczowe procesy biznesowe. To stanowisko o znaczącym wpływie -...

  • Data Engineer SQL Specialist

    3 tygodni temu

    Gdansk, Polska emagine Polska Pełny etat

    Start : ASAP Contract : B2B 12 months prologantions Work mode : 100% remote Project language: English Recruitment process: 1 screening 2 interviews Summary: The primary objective of the Data Engineer / SQL Specialist role is to enhance the organization's analytical capabilities by developing and managing SQL-based data solutions on the Databricks platform....

  • Solution Architect

    2 dni temu

    Gdansk, Polska Strive Sp. z o.o. Pełny etat

    Solution Architect Miejsce pracy: Gdańsk Technologie, których używamy Wymagane Swift Kotlin Flutter PHP Laravel Vue.js React.js AWS O projekcie Dla jednego z naszych Klientów, międzynarodowej firmy technologicznej, tworzącej aplikacje mobilne i webowe, która projektuje i rozwija innowacyjne aplikacje mobilne i webowe dla globalnych marek, poszukujemy...