Tech Lead ETL Migration to Databricks

1 tydzień temu

Poland Billennium Pełny etat 55 zł - 85 zł rocznie

Billennium is a global technology company with over 20 years of experience, committed to innovation and empowering businesses. As an employer, we offer a supportive, growth-focused environment where collaboration and creativity thrive. Join us to shape the future of technology together

About the Role

We are looking for an experienced Tech Lead to drive the end-to-end migration of ETL pipelines from a Cloudera-based environment to Databricks. Strong communication and stakeholder management skills are essential, as you will act as a bridge between business and technical teams.

Main Responsibilities

  • Lead and coordinate the migration of ETL pipelines from Cloudera to Databricks.
  • Analyze existing pipelines, dependencies, bottlenecks, and pain points; design the target architecture on Databricks.
  • Support the engineering team in troubleshooting and performance optimization.
  • Communicate with business and technical stakeholders, align priorities, and proactively remove blockers.
  • Ensure delivery quality and adherence to timelines.

Technical Skills Required

  • Strong hands-on experience with Databricks (Delta Lake, Databricks SQL, Unity Catalog, MLflow, workspace administration).
  • Deep understanding of ETL/ELT concepts, data pipeline design, and data orchestration.
  • Experience working with Cloudera, Spark, and migrations from Hadoop to cloud-based platforms.
  • Solid knowledge of the Azure ecosystem (Azure Data Factory, Synapse, Azure DevOps CI/CD).
  • Strong programming skills in Python and PySpark.
  • Practical experience with Git, CI/CD workflows, and deployment automation in Databricks.
  • Nice to have: previous experience as a technical lead or migration architect on a similar transformation project.

Soft Skills

  • Excellent communication and stakeholder management.
  • Ability to translate business needs into technical solutions.
  • Proactive, structured, and solution-oriented mindset.
  • English level C1.

Perks and benefits:

  • Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.
  • Flexibility - adaptable working hours and remote/hybrid work options to suit your lifestyle & location.
  • Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.
  • Global collaboration - work with a diverse, international team.
  • Innovative environment - be part of a forward-thinking and growth-oriented workplace.
  • Engaging community – Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.
  • Team-building events including our company tradition (annual company event in Mazury).
  •  A pleasant surprise to start your journey with us in the form of a welcome pack.

Recruitment process:

  • HR call
  • Technical Interview
  • Interview with the dedicated Client
  • Final decision/ Feedback

Sounds interesting? Click "Apply" and have a chance to hear more

  • Data Engineering Tech Lead

    6 dni temu

    Poland N-iX Pełny etat 1 000 000 € - 2 000 000 € rocznie

    Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions...

  • Data Migration Specialist

    1 tydzień temu

    Demant Business Services Poland Sp. z o.o. Demant Pełny etat 40 000 zł - 50 000 zł rocznie

    Are you passionate about working with data and driving transformation across global systems?Do you enjoy analyzing, cleansing, and validating data to ensure smooth transitions between platforms?If yes, we'd love to meet youWe're looking for a Data Migration Specialist to join our dynamic team and play a key role in our global IT transformation journey...

  • Tech Lead

    1 tydzień temu

    Poland MarkIT Pełny etat 750 000 zł - 1 200 000 zł rocznie

    DescriptionHelp Our Clients Succeed - and Succeed with ThemAre you passionate about turning complex technical challenges into clear, scalable solutions? Ready to help build something from the ground up in a fast-growing, international company that's reshaping how global enterprises purchase IT? At Markit, we empower the world's leading organisations by...

  • DevOps Tech Lead

    1 tydzień temu

    Poland Remote, Europe, Poland Palta Pełny etat 60 000 zł - 120 000 zł rocznie

    Zing AI Coach is the world's first AI Fitness Personal Trainer, revolutionising the way people approach health and wellness. Four years ago, we set out to replace traditional PT sessions with smart, personalised, motivating guidance powered by AI. We're not just another app – we're a movement, on a mission to help everyone reach their full physical and...

  • Middle Data Engineer

    1 godzinę temu

    Poland N-iX Pełny etat

    Position Overview:  As a Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment. The project involves integrating various data sources, refactoring ETL processes, and ensuring efficient, reliable data movement for analytics and reporting.Responsibilities:Build and modify...

  • Senior Data Engineer

    22 minut temu

    Poland N-iX Pełny etat

    Position Overview:  As a Senior/Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment. The project involves integrating various data sources, refactoring ETL processes, and ensuring efficient, reliable data movement for analytics and reporting.Responsibilities:Build and...

  • Tech Lead

    1 tydzień temu

    Poland Mindboxgroup Pełny etat 60 000 zł - 90 000 zł rocznie

    Creating an inspiring place to thrive for the talented, we use their expertise and courage to introduce the technology of the future into your business. - This is the foundation of Mindbox and the goal of our business and technology journey. We operate and develop in four areas: Autonomous Enterprise - automation of business processes using RPA, OCR, and...

  • Backend Tech Lead

    6 dni temu

    Poland Navro Pełny etat 80 000 zł - 120 000 zł rocznie

    Backend Tech Lead – LibraLocation: PolandCompany: Navro - Pioneering the Future of PaymentsNot Your Typical Backend Tech Lead RoleThis isn't just another leadership position. No legacy systems. No corporate red tape. No coasting. This is about building something from the ground up. Fast.We're Navro, a rapidly scaling B2B payments startup, and we're looking...

  • Middle QA Engineer for CRM Platform Tech Team

    3 tygodni temu

    Poland (Remote), PL GR8 Tech Pełny etat

    GR8 Tech is a leading B2B provider of iGaming solutions that empowers operators to grow, lead, and win.We deliver high-impact, full-cycle tech solutions designed to scale. From seamless integration and expert consulting to long-term operational support, our platform powers millions of active players and drives real business growth. It’s more than just a...

  • Tech Lead

    6 dni temu

    Helsinki, Poland this opportunity Pełny etat 60 000 zł - 72 000 zł rocznie

    Job ID: 31137At Nordea, we know our customers' needs are changing – and we're deeply committed to meeting them with the financial solutions of tomorrow. We're creating an agile environment where we're harnessing the power of technology – one where you can make an impact. So bring your skills, ideas and unique background. With us, you'll find plenty of...