Lead Data Engineer

1 miesiąc temu


Kraków, Polska GPC Global Technology Center Pełny etat

Position Purpose

Working with a modern analytics stack, including Google Cloud, BigQuery, Informatica and Python, the Lead Data Engineer will be building data pipelines, transforming, structuring, and operationalising data to support BI, Analytics and Data Science projects.

Responsibilities

Key Role Responsibility/Duties

  • Contribute to the development and design of the data platform, including the design and execution of data extraction, transformation, and optimal data pipeline architectures and solutions at an enterprise scale to enable business intelligence, analytics, and data science use-cases
  • Design and implement processes around data-loading, data-transformation and feature engineering as well as access control, data security and data privacy
  • Develop complex code-based ETL/ELT data pipelines with performance optimised data modelling
  • Develop source of truth data models to power business analytics solutions using data warehouse modelling techniques, data quality checks, reconciliation processes and thorough testing practices
  • Establish and implement best practices in coding, monitoring and alerting, using CI/CD and other relevant techniques
  • Ensure code is manage, validated, and released using best practices (DevOps) making effective use of automation for these processes
  • Maintain a repeatable and automated approach to data management including a continuous deployment pipeline, centralised configuration management, automated testing patterns, provisioning of environments and controlled release to production
  • Ensure all features and new releases are tested, upgraded, and changed as necessary from a data perspective

WHS

  • Take proactive action to ensure that WHS practices and policies are in place to provide a safe environment for themselves and all team members, and adhere to legislative requirements, company expectations and other safety initiatives
  • Follow safe work and operating procedures at all times
  • Ensure the work area is kept in a neat and tidy manner, free from hazards
  • Promptly report all OHS hazards, injuries and incidents

Other

  • Understand and demonstrate behaviour in accordance with all Company policies and procedures, including Code of Conduct, Discrimination, Bullying and EEO and all applicable laws whilst ensuring continual compliance with relevant legislation relevant to the role including WHS
  • All other tasks as directed by Manager

Requirements

  • Proficiency in designing efficient and robust ETL/ELT workflows, data modelling and data pipelines – batch and/or event driven
  • Proficiency in designing data solutions and creating solution architecture
  • Experience working in a complex enterprise data warehouse environment and developing and maintaining pipeline processes to move and transform data
  • Experience with data warehousing principles, including orchestration framework, schema structure and data architecture principles
  • Extensive experience with Google Cloud Platform (GCP)
  • Experience with Informatica ETL and Governance
  • Ability to write robust code in SQL, and Python

Benefits nad Perks

Location

Krakow/Hybrid

 


  • Lead Data Engineer

    7 dni temu


    Kraków, Polska Kingfisher Pełny etat

    Overview : We are going through and exciting period of change and are seeking a highly motivated and experienced Lead Data Engineer to join our Data Engineering team. You will work as part of our exciting greenfield tech hub covering all facets of technology within Kingfisher. You will be responsible for the day-to-day performance and productivity of a...

  • Lead Data Engineer

    2 tygodni temu


    Kraków, Lesser Poland GPC GLOBAL TECHNOLOGY CENTER Pełny etat

    Technologies-expected : Google Cloud Platform SQL Python about-project : Working with a modern analytics stack, including Google Cloud, Big Query, Informatica and Python, the Lead Data Engineer will be building data pipelines, transforming, structuring, and operationalising data to support BI, Analytics and Data Science projects.responsibilities : Contribute...

  • Lead Data Engineer

    1 miesiąc temu


    Kraków, Polska GPC Global Technology Center Pełny etat

    Position PurposeWorking with a modern analytics stack, including Google Cloud, BigQuery, Informatica and Python, the Lead Data Engineer will be building data pipelines, transforming, structuring, and operationalising data to support BI, Analytics and Data Science projects.ResponsibilitiesKey Role Responsibility/DutiesContribute to the development and design...

  • Lead Software Engineer

    3 tygodni temu


    Kraków, Lesser Poland HSBC Pełny etat

    Lead Software Engineer at HSBC / Pracuj w IT Strona Główna Programowanie Lead Software Engineer Ogłoszenie archiwalne, może być już nieaktualne. Lead Software Engineer Lokalizacja:Kraków Ogłoszenie Bezpośrednie Szczegóły oferty: Lead Software EngineerRef No: HTK/The team – Wealth & Private Banking – Chief Technology Officer - Business...

  • Senior Data Engineer

    3 tygodni temu


    Kraków, Lesser Poland Sigma Software Pełny etat

    Senior Data Engineer (IT Solutions) @ Sigma Software Kraków, Lesser Poland Voivodeship Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.CUSTOMERSigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to...


  • Kraków, Lesser Poland Balazs Pełny etat

    Lead Engineer, Instrumentation page is loaded Lead Engineer, Instrumentation Apply locations Poland, Kraków time type Full time posted on Posted 2 Days Ago job requisition id R Entity DescriptionAir Liquide Engineering & Construction builds the Group's production units (mainly air gas separation and hydrogen production units) and provides external...

  • Lead Powerbi Engineer

    3 tygodni temu


    Kraków, Lesser Poland GPC GLOBAL TECHNOLOGY CENTER Pełny etat

    Lead Power BI Engineer Miejsce pracy: Kraków Technologies we use Expected Microsoft Power BI About the project The Lead Power BI Developer is responsible for BI solution development, enabling the business to maximize the value of our data by designing and building advanced data products.This position works closely with the wider data team, as well as...

  • Lead Software Engineer

    3 tygodni temu


    Kraków, Lesser Poland Kingfisher Pełny etat

    Overview : We are going through an exciting period of change and are seeking a highly motivated and experienced Lead Software Engineer to join our Software Engineering team. As a Lead Software Engineer, you will work closely with your cross functional team to design and implement new features and products and act as the driving force within the...

  • Senior Data Engineer

    3 tygodni temu


    Kraków, Lesser Poland DCV Global Recruitment Pełny etat

    Experienced in Scala, Python or Java and Unix/Linux environment on-premisesExperience with developing RESTful APIs using Java Spring BootHands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)Experience optimizing Spark jobs Experience with time-series/analytics db's such as Elasticsearch...

  • Lead Piping Engineer

    3 tygodni temu


    Kraków, Lesser Poland FERCHAU POLAND sp. z o.o. Pełny etat

    Lead Piping EngineerMiejsce pracy: KrakówYour responsibilitiesAssuring that L&P team is following all agreed and required procedures, standards and quality practicesAnalyzing planting documentation and requirements together with internal stakeholdersTask management and task distribution in relation to work package that is deliveredCreation of pipework...


  • Kraków, Polska Relativity Pełny etat

    Location: Hybrid Krakow Department: Engineering Work Status: Full-time Location Type: Hybrid Overview As a Lead Engineer focused on the Matter Administration vertical, your primary responsibility will be to develop and enhance products that facilitate administrative workflows, which are crucial for our customers' Legal Data Intelligence...

  • Lead Software Engineer

    3 tygodni temu


    Kraków, Lesser Poland Gpc Global Technology Center Pełny etat

    Technologies Expected:Azure Data FactoryAzure Data LakeMicrosoft SQL ServerAzure Services Bus (AMQP)About the Project:The Lead Integration Engineer will have the main responsibility of linking our modern application landscape. The ideal candidate will bring valuable experience to the team to implement the requirements using cutting-edge technical solutions....

  • Lead Software Engineer

    3 tygodni temu


    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Position PurposeThe Lead Integration Engineer will be overall responsible for connecting our modern application landscape. The successful candidate will bring experience to the team to implement the requirements with the latest technical solutions. Constantly new demands on processes and solutions enable continuous further development. Close collaboration...

  • Data Engineer

    1 miesiąc temu


    Kraków, Polska NeoGames Pełny etat

    NeoGames is a leader in the iLottery and iGaming space offering solutions spanning game studios, game aggregation, lotteries, online casino, sportsbook, bingo, and managed services offered through an industry leading core platform.The Data & BI team owns the group’s Data & Analytics platforms spanning Data Engineering,Analytical Engineering and Business...

  • Data Storage Lead

    3 tygodni temu


    Kraków, Lesser Poland Hsbc Service Delivery Pełny etat

    About-project : HSBC Data & Architecture Office (DAO) promotes a data-driven culture across HSBC through our strategy of: Protect: To protect our data we need robust policies for data management and enhanced governance e.g., data that is consumed from a trusted source, meets quality standards, and complies with regulatory obligations.Connect: Move to a...

  • Data DevOps Engineer

    3 tygodni temu


    Kraków, Lesser Poland Tipico Pełny etat

    Company Description We are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day. Our culture is bursting with energy and ambition where we generate intense moments of Spannung,...

  • Data DevOps Engineer

    3 tygodni temu


    Kraków, Lesser Poland Tipico Group Pełny etat

    Job Family: DataCompany DescriptionWe are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day.Our culture is bursting with energy and ambition where we generate intense moments of...

  • Data Platform Domain Lead

    3 tygodni temu


    Kraków, Lesser Poland Elitmind Pełny etat

    Data Platform Domain Lead (Head of Data Platform) @ Elitmind Kraków, Lesser Poland Voivodeship Data Platform Domain Lead (Head of Data Platform) @ Elitmind Kraków Kraków, Lesser Poland Voivodeship, Polska We've been honored as Microsoft Partner of the year 2023 in Poland and following that achievement we are focusing on growth and development, that's why...

  • Senior Data Engineer

    1 miesiąc temu


    Kraków, Lesser Poland Zendesk Pełny etat

    By clicking "Apply Now," I understand and agree that Zendesk and its affiliates will collect and process my information in accordance with Zendesk's Candidate Privacy Notice.Job Description Zendesk is seeking a Senior Data Engineer to join The Data Platform team. The team is responsible for implementing a globally distributed system that uses powerful cloud...

  • Electrical Lead Engineer

    1 miesiąc temu


    Kraków, Polska HAYS Pełny etat

    Electrical Lead EngineerKrakówNR REF.: 1183170Obecnie dla naszego Klienta z branży Energy zlokalizowanego w Krakowie prowadzimy rekrutację na stanowisko Electrical Lead Engineer. Osoba na tym stanowisku będzie odpowiedzialna za: Planowanie, zarządzanie, monitorowanie i zatwierdzanie projektów pod kątem jakości, specyfikacji projektu i wymagań...