Data Engineer

2 tygodni temu

Kraków, Lesser Poland GPC Global Technology Center Pełny etat

Position Purpose

Working with a modern analytics stack, including Google Cloud, BigQuery, Informatica and Python, the Data Engineer will be building data pipelines, transforming, structuring, and operationalising data to support BI, Analytics and Data Science projects.

Responsibilities

Key Role Responsibility/Duties

  • Contribute to the development and design of the data platform, including the design and execution of data extraction, transformation, and optimal data pipeline architectures and solutions at an enterprise scale to enable business intelligence, analytics, and data science use-cases
  • Design and implement processes around data-loading, data-transformation and feature engineering as well as access control, data security and data privacy
  • Develop complex code-based ETL/ELT data pipelines with performance optimised data modelling
  • Develop source of truth data models to power business analytics solutions using data warehouse modelling techniques, data quality checks, reconciliation processes and thorough testing practices
  • Establish and implement best practices in coding, monitoring and alerting, using CI/CD and other relevant techniques
  • Ensure code is manage, validated, and released using best practices (DevOps) making effective use of automation for these processes
  • Maintain a repeatable and automated approach to data management including a continuous deployment pipeline, centralised configuration management, automated testing patterns, provisioning of environments and controlled release to production
  • Ensure all features and new releases are tested, upgraded, and changed as necessary from a data perspective

WHS

  • Take proactive action to ensure that WHS practices and policies are in place to provide a safe environment for themselves and all team members, and adhere to legislative requirements, company expectations and other safety initiatives
  • Follow safe work and operating procedures at all times
  • Ensure the work area is kept in a neat and tidy manner, free from hazards
  • Promptly report all OHS hazards, injuries and incidents

Other

  • Understand and demonstrate behaviour in accordance with all Company policies and procedures, including Code of Conduct, Discrimination, Bullying and EEO and all applicable laws whilst ensuring continual compliance with relevant legislation relevant to the role including WHS
  • All other tasks as directed by Manager

Requirements

  • Proficiency in designing efficient and robust ETL/ELT workflows, data modelling and data pipelines – batch and/or event driven
  • Proficiency in designing data solutions and creating solution architecture
  • Experience working in a complex enterprise data warehouse environment and developing and maintaining pipeline processes to move and transform data
  • Experience with data warehousing principles, including orchestration framework, schema structure and data architecture principles
  • Extensive experience with Google Cloud Platform (GCP)
  • Experience with Informatica ETL and Governance
  • Ability to write robust code in SQL, and Python

Benefits nad Perks

Location

Krakow/Hybrid

  • Data Engineer III

    2 tygodni temu

    Kraków, Lesser Poland FedEx Pełny etat

    The Data Engineer III - Driving Innovation Within DataworksActing as a key player in Dataworks, the Data Engineer III is essential for defining the organization, leading business initiatives, and fostering engineering innovationServing as a 'universal translator', bridging IT, business, software engineers, and data scientists to drive collaboration and...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Schibsted Pełny etat

    Passionate about Big Data? Do you want to have a significant role in funding independent digital media while working with the newest technology? Join our Ads Analytics team as a Data EngineerAds Analytics team is part of Schibsted Marketing Services (SMS) which is Schibsted Media ́s Nordic advertising organisation, representing some of the strongest brands...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Position PurposeThe Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines. The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland INUITS bvba Pełny etat

    Embark on a journey with Hypersonix AI as we search for a proficient Data Engineer to enhance their advanced AI Platform. ProfitGPT empowers enterprises with actionable insights derived from their vast array of databases and application systems. Intrigued? Read on for more details.Hypersonix specializes in creating an AI-driven platform that turns vast...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland N-iX Pełny etat

    Senior Data Engineer @ N-iX Kraków, Lesser Poland Voivodeship About our customer:The OVO Group's mission is to drive progress towards net zero carbon living. We're a collection of companies with a single vision: to power human progress with clean affordable energy for everyone. About the role:If you are a Senior Data Engineer with a passion for building...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Sigma Software Pełny etat

    Senior Data Engineer (IT Solutions) @ Sigma Software Kraków, Lesser Poland Voivodeship Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.CUSTOMERSigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to...

  • Data DevOps Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Pełny etat

    Company Description We are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day. Our culture is bursting with energy and ambition where we generate intense moments of Spannung,...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland N Consulting Ltd Pełny etat

    Location:Wroclaw, Poland (Travel 3 times a week)Experience:5 to 12 yearsResponsibility:Create and implement highly scalable and reliable data distribution solution using VQL, Python, Spark & open-source technologies, to deliver data to business components.Work with Denodo, ADLS, Databricks, Kafka, data modelling, data replication, clustering, SQL Query...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland N Consulting Ltd Pełny etat

    Location: Wroclaw, Poland(Hybrid) Experience:05 to 12 years Responsibility: • create and implement highly scalable and reliable data distribution solution using VQL, Python, Spark & open-source technologies, to deliver data tobusiness components.• work with Denodo, ADLS, Databricks, Kafka, data modelling, data replication, clustering, SQL Query patterns...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tesco Technology Pełny etat

    Job DescriptionThe Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities including:Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.Managing critical data related to customer...

  • Data DevOps Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Group Pełny etat

    Job Family: DataCompany DescriptionWe are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day.Our culture is bursting with energy and ambition where we generate intense moments of...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Group Pełny etat

    Job Family: DataCompany DescriptionWe are Tipico, the leading sports betting provider in Germany and one of the most exciting tech companies in the industry. We are fueled by our passion for the perfect product, using the newest tech stack to make advances every single day.Our culture is bursting with energy and ambition where we generate intense moments...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Rite NRG Pełny etat

    Senior Data Engineer Kraków, Województwo małopolskie Senior Data Engineer Kraków Kraków, Małopolskie, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland DCV Global Recruitment Pełny etat

    Experienced in Scala, Python or Java and Unix/Linux environment on-premisesExperience with developing RESTful APIs using Java Spring BootHands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)Experience optimizing Spark jobs Experience with time-series/analytics db's such as Elasticsearch...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Schibsted Pełny etat

    Passionate about Big Data? Do you want to have a significant role in funding independent digital media while working with the newest technology? Join our Ads Analytics team as a Senior Data Engineer ABOUT USAds Analytics team is part of Schibsted Marketing Services (SMS) which is Schibsted Media ́s Nordic advertising organisation, representing some of the...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Commerzbank Ag Pełny etat

    Technologies-expected : SQL Git Google Cloud Platform about-project : In your role as a Data Engineer you will be working in the Data as a Service (Daa S) cell which builds products and services designed to provide barrier free, easy to use information and test data for the whole bank.This includes data anonymization services, user interfaces and a...

  • Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Maxima Europe Sp. Z.o.o. Pełny etat

    Technologies-expected : Databricks Azure Data Factory SQL Py Spark technologies-optional : Azure Analysis Services about-project : We are seeking a skilled Data Engineer to join our team.The ideal candidate will have strong experience in Databricks, Azure Data Factory (ADF), SQL, Py Spark, and Continuous Integration/Continuous Deployment (CI/CD).Experience...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Software Mind Pełny etat

    [GZI] Senior Data Engineer Full-time Company Description Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that...

  • Data / Platform Engineer

    2 tygodni temu

    Kraków, Lesser Poland Mindbox S.a. Pełny etat

    Job Description: Technologies-expected: Spark, Python, Scala, Google Cloud Platform About the Project: Seeking an experienced Data/Platform Engineer to assist in development, analysis, and maintenance of data processes on GCP-managed platforms. Responsibilities: Analysis and refactoring of data engineering pipelines Migration of processes between...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland Gpc Global Technology Center Pełny etat

    Technologies-expected : Data Bricks SQL Python Power BI about-project : The Senior Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines.The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop...