Lead Data Engineer

7 miesięcy temu

Kraków, Polska GPC Global Technology Center Pełny etat

Position Purpose

Working with a modern analytics stack, including Google Cloud, BigQuery, Informatica and Python, the Lead Data Engineer will be building data pipelines, transforming, structuring, and operationalising data to support BI, Analytics and Data Science projects.

Responsibilities

Key Role Responsibility/Duties

  • Contribute to the development and design of the data platform, including the design and execution of data extraction, transformation, and optimal data pipeline architectures and solutions at an enterprise scale to enable business intelligence, analytics, and data science use-cases
  • Design and implement processes around data-loading, data-transformation and feature engineering as well as access control, data security and data privacy
  • Develop complex code-based ETL/ELT data pipelines with performance optimised data modelling
  • Develop source of truth data models to power business analytics solutions using data warehouse modelling techniques, data quality checks, reconciliation processes and thorough testing practices
  • Establish and implement best practices in coding, monitoring and alerting, using CI/CD and other relevant techniques
  • Ensure code is manage, validated, and released using best practices (DevOps) making effective use of automation for these processes
  • Maintain a repeatable and automated approach to data management including a continuous deployment pipeline, centralised configuration management, automated testing patterns, provisioning of environments and controlled release to production
  • Ensure all features and new releases are tested, upgraded, and changed as necessary from a data perspective

WHS

  • Take proactive action to ensure that WHS practices and policies are in place to provide a safe environment for themselves and all team members, and adhere to legislative requirements, company expectations and other safety initiatives
  • Follow safe work and operating procedures at all times
  • Ensure the work area is kept in a neat and tidy manner, free from hazards
  • Promptly report all OHS hazards, injuries and incidents

Other

  • Understand and demonstrate behaviour in accordance with all Company policies and procedures, including Code of Conduct, Discrimination, Bullying and EEO and all applicable laws whilst ensuring continual compliance with relevant legislation relevant to the role including WHS
  • All other tasks as directed by Manager

Requirements

  • Proficiency in designing efficient and robust ETL/ELT workflows, data modelling and data pipelines – batch and/or event driven
  • Proficiency in designing data solutions and creating solution architecture
  • Experience working in a complex enterprise data warehouse environment and developing and maintaining pipeline processes to move and transform data
  • Experience with data warehousing principles, including orchestration framework, schema structure and data architecture principles
  • Extensive experience with Google Cloud Platform (GCP)
  • Experience with Informatica ETL and Governance
  • Ability to write robust code in SQL, and Python

Benefits nad Perks

Location

Krakow/Hybrid

 

  • Lead Data Engineer

    6 miesięcy temu

    Kraków, Polska Kingfisher Pełny etat

    Overview : We are going through and exciting period of change and are seeking a highly motivated and experienced Lead Data Engineer to join our Data Engineering team. You will work as part of our exciting greenfield tech hub covering all facets of technology within Kingfisher. You will be responsible for the day-to-day performance and productivity of a...

  • Cloud Data Engineer Lead with AI Focus

    3 tygodni temu

    Kraków, Polska Capgemini Polska Pełny etat

    About the RoleWe are seeking a skilled Cloud Data Engineer Lead to join our team in Capgemini Polska. This role is responsible for designing and implementing efficient data workflows using Azure Cognitive Services and other AI/ML frameworks.Key ResponsibilitiesLead the development of ETL pipelines in environments utilizing Oracle, PostgreSQL, and Azure...

  • AI ML Engineer

    3 miesięcy temu

    Kraków, małopolskie, Polska PAR Data Central Pełny etat

    To deliver solutions that connect people to the restaurants, meals, and moments they love. We take that responsibility very seriously.As a leading restaurant technology provider to the world’s top restaurant brands, we’re calling all rebels, instigators, idealists, and builders to join our constantly growing team. If you’ve excelled at every job,...

  • Data Engineer

    22 godzin temu

    Kraków, małopolskie, Polska INEXTO POLAND Pełny etat

    Are you passionate about cutting-edge technology and innovative solutions? INEXTO, a global leader in Authentication, Secure Serialization, Track & Trace, and Production Volume Verification, is looking for a Data Engineer to join our team. Our technology secures over 100 billion products annually, and we're just getting started!At INEXTO, you'll be...

  • AWS Data Engineer

    1 tydzień temu

    Kraków, Polska Kolomolo Pełny etat

    To be leaders in digital modernization by helping companies embrace latest cutting edge technologies to optimize their business with the help of our talented experts. Job Vacancy: AWS Data Engineer Location: Poland , Kraków☝ Cooperation: Hybrid - 3 days office 2 days remote⏰ Contract: B2B, Full-Time We are seeking a skilled AWS Data Engineer to join...

  • Data Engineering Lead

    1 miesiąc temu

    Kraków, Lesser Poland Hitachi Vantara Pełny etat

    Job Title: Data Engineering LeadAbout the Role:We are seeking an experienced Data Engineering Lead to join our team at Hitachi Vantara. This role will lead the design, development, and maintenance of large-scale data systems, ensuring they are efficient, scalable, and reliable.Responsibilities:Lead a team of data engineers in designing, developing, and...

  • Cloud Engineer Lead

    2 miesięcy temu

    Kraków, Polska Fedex Express Poland Transportation Sp. z o.o. Pełny etat

    Cloud Engineer Lead25_A71FA5CD9C514B26A5385A9E051EFC2AObowiązki Create and configure data processing and web application infrastructure using Azure services. That includes setting up storage accounts, event hubs, AKS, Databricks components, gateways, databases, service accounts both on prod and non-prod environments; Wymagania Review...

  • Data Engineer

    7 dni temu

    Kraków, Polska INEXTO Pełny etat

    INEXTO is a leading provider of software and services for Authentication, Secure Serialization, Track & Trace and Production Volume Verification. Its technology is already securing over 100 billion products annually in more than 1’700 manufacturing lines in 100 countries.We provide solutions to help public and private organizations in:Regulatory...

  • Data Architecture Lead

    1 miesiąc temu

    Kraków, Lesser Poland Daxx Pełny etat

    About the RoleWe are seeking an experienced Data Architecture Lead to join our team at Grid Dynamics. As a Data Architecture Lead, you will be responsible for designing and implementing data architecture and pipelines on Azure cloud.Key ResponsibilitiesLead the design and implementation of data architecture and pipelines on Azure cloud.Define and implement...

  • Senior Data Engineer

    3 miesięcy temu

    Kraków, Polska kdrhumanresourcesconsulting Pełny etat

    Senior Data EngineerMiejsce pracy: Praca Hybrydowa - biuro Kraków 3 dni, home office 2 dni, We are looking for a Senior Data Engineer to join our team and help us execute our ambitious vision. As a Senior PySpark Developer, you will lead the design and implementation of large-scale data processing systems, providing strategic insights that drive business...

  • Data Insights Lead

    3 tygodni temu

    Kraków, Lesser Poland HEINEKEN Global Shared Services Pełny etat

    Job Title: Data Insights LeadAbout Us:We are HEINEKEN Global Shared Services, a company that values innovation and collaboration. Our team is dedicated to delivering exceptional results and creating a positive impact.Job Description:We are seeking an experienced Data Insights Lead to join our team. In this role, you will be responsible for leading the...

  • Data Engineer

    4 tygodni temu

    Kraków, Lesser Poland Software Mind Pełny etat

    Transformational Data Engineering RoleWe're seeking an exceptional Senior Data Engineer to join our cross-functional team at Software Mind. As a key member, you will be responsible for designing, developing, and maintaining our data gathering, modelling, reporting capabilities and self-service data platforms.Key ResponsibilitiesCollaborate with Data...

  • Lead Software Engineer

    2 miesięcy temu

    Kraków, Lesser Poland Kingfisher Pełny etat

    OverviewWe are seeking a highly skilled and experienced Lead Software Engineer to join our Engineering team at Kingfisher. As a key member of our team, you will play a pivotal role in shaping our technical vision and driving the development of innovative solutions.Key ResponsibilitiesLead the engineering team to design and develop technical products and...

  • Machine Learning Engineer

    5 dni temu

    Kraków, Lesser Poland Tesco Technology Pełny etat

    About the RoleWe are seeking an experienced Machine Learning Engineer to join our growing Data Science Engineering team at Tesco Technology. As a key member of our team, you will work collaboratively with engineers, data scientists, product managers, systems engineers, and analytics professionals to deliver high-impact outcomes for our customers.You will be...

  • Data Engineer

    3 miesięcy temu

    Kraków, Polska Verisk Pełny etat

    Job Description Actineo, a Verisk business, is the leading provider of software solutions and services for the insurance sector. We are looking for a Data Engineer with experience in delivering SaaS applications. As a data engineer, you will play a crucial role in shaping the future of our products by helping to define the system architecture and...

  • Lead Big Data Solutions Architect for Financial Services

    4 tygodni temu

    Kraków, Lesser Poland Capco Poland Pełny etat

    About the RoleWe are seeking a highly skilled Lead Big Data Solutions Architect to join our team at Capco Poland. The ideal candidate will have extensive experience in designing and implementing scalable data pipelines and solutions on-prem, migration, and cloud projects for large-scale data processing and analytics.ResponsibilitiesDesign, develop, and...

  • Electrical Lead Engineer

    2 miesięcy temu

    Kraków, Polska HAYS Pełny etat

    Electrical Lead EngineerKrakówNR REF.: 1189416Hays IT Contracting is a cooperation based on B2B rules. We connect IT specialists with the most interesting, technological projects on the market. Join the group of 500 satisfied Contractors working for Hays’ clients! For our client we are currently looking for Candidates for the position of: Electrical...

  • Senior Data Engineer

    2 miesięcy temu

    Kraków, Lesser Poland Software Mind Pełny etat

    Job OpportunitySoftware Mind is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining our data gathering, modeling, reporting capabilities, and self-service data platforms.Key ResponsibilitiesCollaborate with cross-functional teams to identify data needs and develop...

  • Enterprise Data Engineering Lead

    4 tygodni temu

    Kraków, Polska Grid Dynamics Poland Pełny etat

    We are seeking a highly skilled Enterprise Data Engineering Lead to join our team at Grid Dynamics Poland and contribute to the development of cutting-edge data solutions. As an integral part of our organization, you will be responsible for designing and implementing scalable data ingestion pipelines using Cassandra, Kafka, Spark, and Scala.This is an...

  • Lead Data Analyst Innovations

    3 tygodni temu

    Kraków, Lesser Poland Verisk Pełny etat

    Job Title: Lead Data Analyst InnovationsThe Verisk ISO unit is seeking an experienced Pricing Data Analyst Team Lead to support our large team of actuaries and data analytics professionals in creating innovative analytic products based on our vast database of over 21 billion records spanning twenty lines of insurance.About the Role:Grow, lead, and motivate a...