Data Engineer Expert

2 tygodni temu

Tadeusza Czackiego Warszawa, Polska Addepto Pełny etat

At Addepto, we're at the forefront of AI and Big Data innovation. As a leading consulting and technology company, we partner with top-tier global enterprises to deliver cutting-edge data projects.

About Us

We've earned recognition from Forbes as one of the top 10 AI companies due to our exclusive focus on AI and Big Data. Our team of experts is dedicated to helping clients achieve innovative data solutions.

Job Description

As a Senior Data Engineer, you'll have the exciting opportunity to work with our team on challenging projects across various industries, leveraging advanced technologies.

  • Design and development of a universal data platform for global aerospace companies using Azure and Databricks. This project combines diverse enterprise and public data sources, covering architecture design, process implementation, and technology selection.
  • Development and maintenance of a large platform for processing automotive data, utilizing Spark, Cloudera, Airflow, Iceberg, Python, and AWS.
  • Design of the data transformation and following data ops pipelines for a global car manufacturer. This project aims to build a data processing system for real-time streaming and batch data, handling business use cases like process monitoring, analysis, and reporting.

 

Main Responsibilities

You'll be responsible for:

  • Building and scaling reliable data pipelines for both real-time and batch processing, using technologies like Airflow and AWS Step Functions.
  • Developing automated data workflows that power analytics, reporting, and AI/ML models using services such as S3, Glue, EMR, Lambda, Redshift, and SageMaker.
  • Working with diverse data sources, ensuring consistent quality, integrity, and readiness for analysis across platforms.
  • Ingesting, transforming, and managing data from structured and semi-structured sources, including relational databases, cloud APIs, XML, JSON, and Hadoop/Spark.
  • Partnering closely with data science and business teams to align technical solutions with real-world use cases.
  • Contributing to MLOps and CI/CD pipelines, helping streamline the deployment and monitoring of data products and models.
  • Evaluating and improving existing processes for speed, efficiency, and scalability in a cloud environment.
  • Turning business problems into data-driven solutions, ensuring high performance, security, and scalability.
Requirements

To succeed in this role, you'll need:

  • At least 5 years of professional programming experience implementing, developing, or maintaining Big Data systems, ideally in a business or enterprise setting.
  • Strong proficiency in Python and SQL for data engineering tasks.
  • Solid understanding of cloud data ecosystems, especially AWS.
  • Familiarity with automation tools such as Airflow, AWS Step Functions, or similar workflow orchestrators.
  • Experience working in Unix environments and using Git for version control.
  • Excellent communication skills and consulting experience with direct interaction with clients.
  • Ability to work independently and take ownership of project deliverables.
  • Fluent in English (at least C1 level).
  • Master's in Computer Science, Big Data, Data Science, Mathematics, Physics, or a related field.
Benefits

We offer a supportive team environment, flexible work arrangements, career growth opportunities, and a comprehensive benefits package.

  • Senior Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Internetwork Expert Pełny etat

    Intuition Machines uses AI/ML to build enterprise security products. We apply our research to systems that serve hundreds of millions of people, with a team distributed around the world. You are probably familiar with our best-known product, the hCaptcha security suite. Our approach is simple: low overhead, small teams, and rapid iteration.We are seeking a...

  • Data Engineer Spark

    4 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Data Engineer AWS

    2 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Data Engineer Expert

    3 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    The role of a Data Engineer Expert is crucial in building technology that makes Allegro's deliveries easy, cost-effective, fast and predictable.This involves predicting delivery times using statistical algorithms and machine learning, selecting the best delivery methods tailored to customers, and integrating with carrier companies.We are looking for a...

  • Junior Data Engineer Databricks

    3 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Senior Data Engineer AWS

    2 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Data Scientist ML Engineer

    3 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Data Scientist ML Engineer

    4 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Big Data Engineer for Cloud Architecture

    2 tygodni temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    At Addepto, we specialize in AI and Big Data solutions, serving top-tier global enterprises and pioneering startups. Our exclusive focus has earned us recognition as one of the top 10 AI companies by Forbes.The role of Data Engineer is a key position in our team, responsible for designing and developing data platforms across various industries. We are...

  • Senior Data Scientist Position

    1 tydzień temu

    Warszawa, Mazovia, Polska Internetwork Expert Pełny etat

    About the JobWe are seeking an experienced Senior Data Engineer to spearhead the development, maintenance, and improvement of our existing data/ML workflows. The ideal candidate will collaborate with ML engineers and researchers to build datasets on demand, influence data storage and processing strategies, and work closely with various teams to enhance our...

  • High-Performance Data Engineer for Large-Scale Automotive Projects

    19 godzin temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    About AddeptoWe are a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI companies.Overview of the ProjectAs a Data Engineer, you will have the exciting opportunity to work with a team of...

  • Senior Data Engineer @

    3 tygodni temu

    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...

  • Cloud Data Engineer Role

    1 tydzień temu

    Warszawa, Mazovia, Polska Internetwork Expert Pełny etat

    Key ResponsibilitiesMaintain, extend, and improve existing data/ML workflows, implementing new ones to handle high-velocity data.Design interfaces and systems enabling ML engineers and researchers to create datasets on demand.Influence data storage and processing strategies to ensure seamless integration.Collaborate with the ML team, frontend, and backend...

  • Big Data Engineer with Expertise in Cloud Solutions

    1 tydzień temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    At Addepto, a leading consulting and technology company specializing in AI and Big Data, we are seeking a highly skilled Junior Data Engineer to join our team of technology experts. With a focus on cutting-edge technologies, you will have the exciting opportunity to work on challenging projects across various industries.We partner with top-tier global...

  • AI and Big Data Solutions Expert

    1 tydzień temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups to drive business transformation.

  • Software Delivery Expert

    7 dni temu

    Tadeusza Czackiego /, Warszawa, Polska Sunscrapers Pełny etat

    Sunscrapers is a technology consultancy that empowers finance and healthcare leaders to succeed by leveraging cutting-edge software, data, and AI.We combine world-class engineering, deep industry expertise, and proprietary know-how to deliver innovative, high-impact solutions. Specializing in software engineering, DevOps, data engineering, and data science,...

  • Data Science Innovator: AI and Machine Learning Expert

    1 tydzień temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    **About Addepto**We are a leading consulting and technology company specializing in AI and Big Data. Our mission is to help clients deliver innovative data projects by leveraging cutting-edge technologies.**Project Highlights**Airport Operation Management Optimization Engine: We are seeking talented individuals to join our team in creating an AI-driven...

  • Unlocking Business Value with Scalable Data Solutions

    1 tydzień temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    About UsAddepto is a pioneering consulting and technology company specializing in AI and Big Data. We partner with leading global enterprises and innovative startups, helping clients drive impactful data projects. Our expertise has earned us recognition as one of the top 10 AI companies by Forbes.Your RoleWe're seeking an experienced Senior Data Engineer to...

  • Big Data Architect with Cloud Expertise

    1 tydzień temu

    Tadeusza Czackiego /, Warszawa, Polska Addepto Pełny etat

    Company OverviewAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as...

  • Data Engineering Expert for Cloud Data Platforms

    7 dni temu

    Warszawa, Polska emagine Polska Pełny etat

    About the RoleWe are seeking a skilled Data Engineering Expert to join our team at emagine Polska. As an Analytics Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines and a state-of-the-art lakehouse within Google Cloud.Key ResponsibilitiesDesigning and implementing efficient ELT processes using DBT and...