Senior Data Engineer

1 dzień temu

Kraków, Lesser Poland MDPI Pełny etat
Senior Data Engineer

MDPI is seeking a highly skilled Senior Data Engineer to join our team. As a key player in our data engineering team, you will play a critical role in designing, developing, and optimizing our data infrastructure.

Key Responsibilities:
  • Design and implement data lakes, data warehouses, and ETL/ELT pipelines.
  • Develop and maintain data models to support efficient storage and retrieval of data.
  • Implement and optimize data pipelines, ensuring seamless data flow and processing.
  • Integrate and process data from multiple sources, ensuring consistency and accuracy.
  • Develop and implement monitoring systems to ensure data quality and availability.
  • Collaborate with the Data Architect and other team members to ensure alignment on technical strategies and project goals.
Requirements:
  • University degree in Computer Science or related field.
  • 5+ years of relevant work experience in data engineering roles.
  • Proven experience in data acquisition, lakes, warehousing, modeling, and orchestration.
  • Strong knowledge of common columnar file formats used in data applications.
  • Expertise in data partitioning and incremental scalability.
  • Expertise in data quality and data governance.
  • Advanced skills in SQL (including window functions and CTE).
  • Proficiency in RDBMS (MySQL, PostgreSQL).
  • Strong programming skills in Python (with libraries like Polars, optionally Arrow / PyArrow API).
  • Experience with OLAP query engines (Clickhouse, DuckDB, Apache Spark).
  • Experience with Apache Airflow (or similar tools like Dagster or Prefect).
Good to Have:
  • Experience in entity disambiguation.
  • Familiarity with orchestration and containerization technologies (Docker, Kubernetes).
  • Knowledge of Linux (Ubuntu/Debian).
  • Experience with Git and Atlassian tools (Jira, Confluence).
  • Knowledge of dbt.
  • Understanding of graph databases (neo4j).
Why Join Us?
  • Be part of a dynamic and innovative team at the forefront of data technology.
  • Opportunity to shape a new team, driving impactful projects.
  • Work in a collaborative environment that values creativity and diversity.
  • Competitive salary.
  • Private medical care (fully covered).
  • MultiSport card (partially covered).
  • Team building activities.

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Senior Data EngineerAt GPC Global Technology Center, we are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines, transforming and structuring data to support business intelligence, analytics, and data science projects.Key...

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland Daxx Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking an experienced Senior Big Data Engineer to join our team at Grid Dynamics. As a key member of our digital transformation consulting and implementation services, you will be responsible for designing and developing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies.Key...

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland MDPI Pełny etat

    Senior Data EngineerMDPI is seeking a highly skilled Senior Data Engineer to join our team. As a key player in our data engineering team, you will play a critical role in designing, developing, and optimizing our data infrastructure.Key Responsibilities:Design and implement data lakes, data warehouses, and ETL/ELT pipelines.Develop and maintain data models...

  • Senior Data Engineer

    9 godzin temu

    Kraków, Lesser Poland MDPI Pełny etat

    Job Title: Senior Data EngineerMDPI is seeking a highly skilled Senior Data Engineer to join our team. As a key player in our data engineering team, you will play a critical role in designing, developing, and optimizing our data infrastructure.Key Responsibilities:Design and implement data lakes, data warehouses, and ETL/ELT pipelines.Develop and maintain...

  • Senior Data Quality Engineer

    9 godzin temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Senior Data Quality EngineerWe are seeking a highly skilled Senior Data Quality Engineer to join our team at GPC Global Technology Center. As a key member of our Data Science team, you will collaborate with data scientists, AI/ML engineers, and product managers to build and augment our AI-driven digital Catalog products.Key Responsibilities:Validate data...

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland Software Mind Pełny etat

    Software Mind is a leading software development company that creates innovative solutions for global clients. We're looking for a talented Senior Data Engineer to join our team.Job Description:Project Overview:Develop and maintain our data gathering, modeling, and reporting capabilities.Collaborate with data engineers, analysts, scientists, product owners,...

  • Senior Data Quality Engineer

    1 dzień temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Senior Data Quality EngineerAt GPC Global Technology Center, we're seeking a highly skilled Senior Data Quality Engineer to join our Data Science team. As a key member of our team, you'll play a crucial role in building and augmenting our AI-driven digital Catalog products.Key Responsibilities:Collaborate with data scientists, AI/ML engineers, and product...

  • Senior Big Data Engineer

    9 godzin temu

    Kraków, Lesser Poland Daxx Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at Grid Dynamics. As a key member of our digital transformation consulting and implementation services, you will be responsible for designing and developing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies.Key...

  • Senior Azure Data Engineer

    1 dzień temu

    Kraków, Lesser Poland C&F S.A. Pełny etat

    Senior Azure Data EngineerC&F S.A. is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics, and Compliance. With a highly integrated team of 400+ experts, for over 20 years, we have been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science...

  • Senior Data Engineer

    9 godzin temu

    Kraków, Lesser Poland First Advantage Pełny etat

    About First AdvantageAt First Advantage, we're committed to empowering our clients to make informed decisions through data-driven insights. As a leading provider of mission-critical background screening solutions, we're dedicated to delivering innovative solutions that meet the unique needs of our clients.Job SummaryWe're seeking a highly skilled Senior Data...

  • Senior Data Architect

    1 dzień temu

    Kraków, Lesser Poland kdrhumanresourcesconsulting Pełny etat

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of large-scale data processing systems on Azure. As a key member of our team, you will be responsible for providing strategic insights that drive business success.Key ResponsibilitiesData Architecture Design: Design scalable and resilient data...

  • Senior Data Engineer

    1 dzień temu

    Kraków, Lesser Poland Sigma Software Pełny etat

    Sigma Software is seeking a skilled Data Engineer to drive our data engineering initiatives forward.We are looking for a talented professional with a strong background in data engineering and cloud computing services to join our team.Key Responsibilities:Design, develop, and maintain data architectures and pipelines using Azure Cloud platforms (Data Factory,...

  • Data Engineer

    9 godzin temu

    Kraków, Lesser Poland Verisk Pełny etat

    Job Title: Data EngineerAt Verisk Analytics, we're seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data pipelines and architectures.Key Responsibilities:Design and implement data pipelines using AWS services and multiple database technologies.Develop and maintain...

  • Data Engineer

    1 dzień temu

    Kraków, Lesser Poland Verisk Pełny etat

    Job Title: Data EngineerAt Verisk Analytics, we're seeking a skilled Data Engineer to join our team. As a Data Engineer, you'll play a crucial role in developing sophisticated risk models to assist insurers with risk selection and pricing.Key Responsibilities:Design and implement ETL processes using AWS services and multiple database technologies.Ensure the...

  • Data Engineer

    1 dzień temu

    Kraków, Lesser Poland Claims Solutions Pełny etat

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Claims Solutions. As a Data Engineer, you will play a crucial role in shaping the future of our products by helping to define the system architecture and implementing data-driven features.Key Responsibilities:Design and implement data pipelines using Airflow and data...

  • Data Engineer

    1 dzień temu

    Kraków, Lesser Poland State Street Pełny etat

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at State Street. As a Data Engineer, you will play a critical role in designing, developing, and deploying cloud-based data lake solutions that support our business needs.Main Responsibilities:Design and develop end-to-end cloud data lake solutions, including data...

  • Senior DevOps Engineer

    1 dzień temu

    Kraków, Lesser Poland Semantive Pełny etat

    Senior DevOps EngineerWe are a forward-thinking company that helps businesses thrive in the digital age. Our mission is to empower organizations to unlock new possibilities through successful cloud transformation.As a Senior DevOps Engineer, you will be part of our team that specializes in building Big Data platforms and Serverless applications. We are...

  • Senior BigQuery Data Engineer

    1 dzień temu

    Kraków, Lesser Poland Ocado Group Pełny etat

    About the RoleWe are seeking a skilled and experienced BigQuery Data Engineer to join our dynamic team at Ocado Technology. As a BigQuery Data Engineer, you will play a crucial role in managing BigQuery data at all stages of the lifecycle, identifying inefficiencies and waste, and optimising the utilisation of BigQuery resources across the organisation.Key...

  • Senior Cloud Engineer

    1 dzień temu

    Kraków, Lesser Poland Google Pełny etat

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Borg Prime team at Google Cloud. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and efficient cloud-based systems.As a Senior Software Engineer, you will work closely with our team to develop and maintain our core...

  • Data Engineer

    1 dzień temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Job Title: Data EngineerAt GPC Global Technology Center, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing and implementing data pipelines, transforming, structuring, and operationalising data to support Business Intelligence, Analytics, and Data Science projects.Key...