Senior Data Engineer
4 tygodni temu
Expected, DataBricks, SQL, Python, Power BI
About the project, The Senior Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines. The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organization, ensuring data availability, quality, and accessibility for various business needs.
Your responsibilities, Data Pipeline Development:, Design, model, develop and maintain data pipelines to ingest, store, process, and present data., Ensure data quality, accuracy, and consistency., Collaborate with data architects to ensure data pipelines align with the overall data architecture strategy., Data Transformation and Integration:, Perform data transformation tasks, including data cleansing, enrichment, and aggregation, to prepare data for analytics and reporting., Integrate data from structured and unstructured sources, ensuring compatibility and alignment with data models and business requirements., Automate data transformation processes to improve efficiency., Data Quality Assurance:, Implement and maintain data quality checks and validation processes to identify and resolve data anomalies and errors., Monitor data pipelines for data quality issues and implement data quality improvements., Collaborate with business stakeholders to define data quality requirements., Data Modelling and Schema Design:, Collaborate with data architects and data scientists to design and implement data models, schemas, and structures., Ensure that data models support business reporting and analytics needs while optimizing query performance., Maintain data dictionaries and metadata to document data structures and relationships., Performance Optimization:, Optimize data storage, retrieval, and query performance by implementing indexing, partitioning, and caching strategies., Monitor data processing performance and address bottlenecks as they arise., Stay updated with best practices in data processing performance tuning., Documentation and Knowledge Sharing:, Create and maintain documentation for data pipelines, data transformation processes, and data integration procedures., Foster a culture of knowledge sharing within the data engineering team and across the organization., Collaboration and Stakeholder Engagement:, Collaborate effectively with cross-functional teams, data stakeholders, and business units to understand data requirements and deliver data solutions that meet business needs., Communicate technical concepts and data solutions to non-technical stakeholders in a clear and understandable manner.
Minimum 4 years commercial data engineering experience., Commercial experience of DataBricks, SQL, Python, Power BI., Experience in data engineering, including designing and developing data pipelines for retrieval / ingestion / presentation / semantics in an Azure environment., Effective communication and collaboration skills to work with cross-functional teams and gather data requirements., Skills in data modelling (both structured and unstructured data)., Power Automate., Data optimization for performance, scalability, and efficiency., Experience in automotive/distribution sector.
Benefits, sharing the costs of sports activities, private medical care, sharing the costs of professional training & courses, life insurance, coffee / tea, meal passes, sharing the commuting costs, extra leave, work in international teams, friendly atmosphere, copyrights for IT roles, hybrid work
Recruitment stages, INITIAL INTERVIEW (30 min) , TECHNICAL TEST (optional - 45-90 min) , TECHNICAL INTERVIEW (60-90 min), FINAL INTERVIEW (60-90 min), FEEDBACK / OFFER
GPC GLOBAL TECHNOLOGY CENTER, Established in 1928, Genuine Parts Company (GPC) is a leading global service organization specializing in the distribution of automotive and industrial replacement parts. GPC's commitment to innovation and technology is evident in the GPC Global Technology Center in Krakow, established in 2022. This center serves as a hub for research and development, supporting GPC's digital transformation efforts. The center's team of highly skilled IT engineers focuses on developing advanced technologies and solutions that enhance GPC's operations and growth. Their work spans across various areas, including e-commerce and data platforms, supply chain solutions, selling systems, and cyber security. Learn more at genpt.com.
This is how we work,
-
Senior Data Engineer
4 tygodni temu
Krakow, Polska Rite NRG sp. z o.o. Pełny etatSenior Data Engineer Miejsce pracy: Kraków Technologie, których używamy Wymagane AWS Snowflake Data Cloud Python Kafka SQL O projekcie Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania...
-
Senior Data Engineer
4 tygodni temu
Krakow, Polska Schibsted Pełny etatPassionate about Big Data? Do you want to have a significant role in funding independent digital media while working with the newest technology? Join our Ads Analytics team as a Senior Data Engineer! ABOUT US Ads Analytics team is part of Schibsted Marketing Services (SMS) which is Schibsted Media´s Nordic advertising organisation, representing some of...
-
Senior Data Engineer
13 godzin temu
Krakow, Polska Schibsted Pełny etatPassionate about Big Data? Do you want to have a significant role in funding independent digital media while working with the newest technology? Join our Ads Analytics team as a Senior Data Engineer! ABOUT US Ads Analytics team is part of Schibsted Marketing Services (SMS) which is Schibsted Media´s Nordic advertising organisation, representing some of...
-
Senior Data Engineer
2 tygodni temu
Krakow, Polska Rite NRG sp. z o.o. Pełny etatSenior Data Engineer Miejsce pracy: Kraków Technologie, których używamy Wymagane AWSSnowflake Data CloudPythonKafkaSQLO projekcie Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Twój...
-
Senior Data Engineer
4 dni temu
Krakow, Polska SCHIBSTED Pełny etatSenior Data Engineer Miejsce pracy: Kraków Technologies we use Expected Python AWS Kubernetes Docker Spark Optional Airflow Scala MLOps Operating system Windows macOS About the project You will become a part of the Ads Analytics team, composed of Data Scientists and Data Engineers. Our daily endeavours encompass working on complex data products ,...
-
Senior Data Engineer || Big Data Engineer
1 miesiąc temu
Krakow, Polska DCV Technologies Pełny etatSenior Data Engineer: Experienced in Scala, Python or Java and Unix/Linux environment on-premises Experience with developing RESTful APIs using Java Spring Boot Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL) Experience optimizing Spark jobs Experience with time-series/analytics...
-
Senior Data Engineer
4 dni temu
Krakow, Polska Schibsted Tech Polska Pełny etattechnologies-expected : Python AWS Kubernetes Docker Spark technologies-optional : Airflow Scala MLOps about-project : You will become a part of the Ads Analytics team, composed of Data Scientists and Data Engineers. Our daily endeavours encompass working on complex data products , including all stages of development. This involves building ETL pipelines ,...
-
Senior Data Engineer
2 tygodni temu
Krakow, Polska DCV Global Recruitment Pełny etatSenior Data Engineer:Experienced in Scala, Python or Java and Unix/Linux environment on-premisesExperience with developing RESTful APIs using Java Spring BootHands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL)Experience optimizing Spark jobs Experience with time-series/analytics db's such...
-
Senior Data Engineer
1 miesiąc temu
Krakow, Polska GPC GLOBAL TECHNOLOGY CENTER Pełny etattechnologies-expected : DataBricks SQL Python Power BI about-project : The Senior Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines. The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop...
-
Senior Data Engineer
2 tygodni temu
Krakow, Polska GPC GLOBAL TECHNOLOGY CENTER Pełny etattechnologies-expected :DataBricksSQLPythonPower BIabout-project :The Senior Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines. The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop the...
-
Senior Data Engineer
4 dni temu
Krakow, Polska Rite NRG sp. z o.o. Pełny etattechnologies-expected : AWS Snowflake Data Cloud Python Kafka SQL about-project : Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi. responsibilities : Projektowanie i wdrażanie...
-
Senior Data Engineer
2 tygodni temu
Krakow, Polska GPC GLOBAL TECHNOLOGY CENTER Pełny etatExpected, DataBricks, SQL, Python, Power BIAbout the project, The Senior Data Engineer is a technical role responsible for designing, developing, and maintaining data pipelines. The pipelines will be realized in alignment with the future data architecture and the engineer will collaborate in cross-functional teams to gather requirements and develop the...
-
Senior Data Engineer
4 tygodni temu
Krakow, Polska Rite NRG sp. z o.o. Pełny etatWymagane, AWS, Snowflake Data Cloud, Python, Kafka, SQL O projekcie, Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi. Twój zakres obowiązków, Projektowanie i wdrażanie infrastruktury...
-
Senior Data Engineer
2 tygodni temu
Krakow, Polska Rite NRG sp. z o.o. Pełny etatWymagane, AWS, Snowflake Data Cloud, Python, Kafka, SQLO projekcie, Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Twój zakres obowiązków, Projektowanie i wdrażanie infrastruktury...
-
Senior Data Engineer
4 tygodni temu
Krakow, Polska Opensignal Pełny etatJob title: Senior Data Engineer (Spark) Department: Engineering Reporting to: Engineering Manager Location: Poland Purpose of Role We’re looking for a Senior Data Engineer (Spark) to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts...
-
Senior Azure Data Engineer
1 miesiąc temu
Krakow, Polska C&F S.A. Pełny etatC&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry. Senior Azure Data...
-
Senior Data Engineer
1 miesiąc temu
Krakow, Polska N-iX Pełny etatAbout our customer: The OVO Group’s mission is to drive progress towards net zero carbon living. We’re a collection of companies with a single vision: to power human progress with clean affordable energy for everyone. About the role: If you are a Senior Data Engineer with a passion for building scalable, resilient solutions, and you enjoy influencing the...
-
Senior Data Engineer
4 tygodni temu
Krakow, Polska Zendesk Pełny etatJob DescriptionZendesk is seeking a Senior Data Engineer to join The Data Platform team. The team is responsible for implementing a globally distributed system that uses powerful cloud technologies that span Amazon Web Services. Our goal is to help 170,000+ global businesses truly understand customer interactions at depths never thought possible until now.As...
-
Senior Data Engineer
4 tygodni temu
Krakow, Polska Zendesk Pełny etatJob DescriptionZendesk is seeking a Senior Data Engineer to join The Data Platform team. The team is responsible for implementing a globally distributed system that uses powerful cloud technologies that span Amazon Web Services. Our goal is to help 170,000+ global businesses truly understand customer interactions at depths never thought possible until now.As...
-
Krakow, Polska DCV Global Recruitment Pełny etatSenior Data Engineer: Experienced in Scala, Python or Java and Unix/Linux environment on-premises Experience with developing RESTful APIs using Java Spring Boot Hands-on experience building data pipelines using Hadoop components (Apache Hadoop, Scala, Apache Spark, YARN, Hive, SQL) Experience optimizing Spark jobs Experience with time-series/analytics db's...
