Data Engineer Automotive Domain

3 dni temu


Warszawa, mazowieckie, Polska Sigma Software Pełny etat

Are you looking for a team of professionals on top of cutting-edge technologies? Are you looking for a place to boost your Big Data career?

We invite you to join our Big Data Competence Center, part of Sigma Softwareâs complex organizational structure. This center combines various clients, interesting projects, and activities to grow your professional skills.


CUSTOMER

Our client is a well-established company in Europeâs automotive market. We are working together to develop software that will be used worldwide.


PROJECT

The Client provides the middleware application for the independent automotive aftermarket. The solution provides easy integration of end-user IT infrastructure and bi-directional product catalogue updating.

The solution supports various platforms with instant data processing and synchronization. It is a middleware component used in B2B integration scenarios, with some Front-End components, REST API, and Windows services running locally.


REQUIREMENTS
  • 4+ years of strong experience with Python as a programming language for data pipelines and related tools (e.g., Pandas)
  • Experience as a Data Analyst
  • In-depth knowledge of AWS infrastructure and tools for creating serverless data pipelines, mainly for batch processing
  • Hands-on experience with IaaS tools, preferably AWS CDK or Serverless Framework
  • Work experience building ETL pipelines for analytics and internal operations
  • Experience building internal APIs and integrating with external APIs
  • Practicalâ¯experience with distributed application concepts and DevOps tooling
  • Experience with Linux operational system
  • Effective communication skills, especially for explaining technical concepts to nontechnical business leaders
  • Desire to work on a dynamic, research-oriented team
  • Troubleshooting and debugging ability

WOULD BE A PLUS
  • Certification Solutions Architect or Data Analytics
  • 2+ years of experience with Hadoop, Spark, and Airflow
  • Experience with DAGs and orchestration tools
  • Experience with developing Snowflake-driven data warehouses
  • Experience with developing event-driven data pipelines


RESPONSIBILITIES
  • Contributing to new technologies investigations and complex solutions design, supporting a culture of innovation considering matters of security, scalability, and reliability with the focusâ¯on building out our ETL processes
  • Working with modern data stack, coming up with well-designed technical solutions and robust code, implementing data governance processes
  • Working and professionally communicating withâ¯the customerâs team
  • Taking up responsibility for delivering major solution features
  • Participating in requirements gathering & clarification process, proposing optimal architecture strategies, lead the data architecture implementation
  • Developingâ¯core modules and functions, designing scalable and cost-effective solutions
  • Performing code reviews, writing unit and integration tests
  • Scaling the distributed system and infrastructure to the next level
  • Building data platform using the power of AWS cloud provider




  • Warszawa, mazowieckie, Polska Sigma Software Pełny etat

    We invite a motivated and experienced Senior/Principal Software Engineer to join our embedded team.As we strive to increase our expertise in the automotive field, we are looking for a professional to help us in this mission.Passionate about automotive development? Letâs work together!PROJECTWe are building a Competence Center focused on becoming...


  • Warszawa, mazowieckie, Polska Sigma Software Pełny etat

    We invite a motivated and experienced Senior/Principal Software Engineer to join our embedded team.As we strive to increase our expertise in the automotive field, we are looking for a professional to help us in this mission.Passionate about automotive development? Let’s work together!PROJECTWe are building a Competence Center focused on becoming...

  • Data Engineer

    1 tydzień temu


    Warszawa, mazowieckie, Polska L.M. Group Poland Pełny etat

    Data Engineer Responsibilities: Understand the data consumed within Corporate TreasuryIdentify data gaps, data uplift and data consolidation opportunitiesWork with multiple data consumers to understand the data requirementsWork with multiple data providers to source the data for Corporate Treasury needsCreate logical data models to represent financial...

  • Data Engineer

    1 tydzień temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    ​As a Data Engineer in D&A Scaled Analytical Products, you will play a crucial role in designing, developing, and implementing data solutions that enable data-driven decision-making across the organization. You will collaborate with cross-functional teams to acquire, transform, and optimize data from various sources. Your technical expertise and innovative...

  • Azure Data Engineer

    3 dni temu


    Warszawa, mazowieckie, Polska C&F S.A. Pełny etat

    ð C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Azure Data...

  • Data Engineer Databricks

    1 tydzień temu


    Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat

    Experis to światowy lider w rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujące projekty IT skierowane zarówno do doświadczonych ekspertów, jak i osób rozpoczynających karierę w branży IT. Obecnie, dla naszego klienta realizującego projekty w branży...


  • Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat

    Experis to Åwiatowy lider w rekrutacji specjalistów i kadry zarzÄdzajÄcej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujÄce projekty IT skierowane zarówno do doÅwiadczonych ekspertów, jak i osób rozpoczynajÄcych karierÄ w branży IT. Obecnie, dla naszego klienta realizujÄcego projekty w...

  • Senior Data Engineer ESG

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    Procter and Gamble (P&G), a lead FMCG company and therefore a key influencer of the FMCG industry, recently made several bold commitments to resolve environmental sustainability challenges – tackling top problems like climate change (become net zero carbon emissions), waste (100% recycled/reusable plastic), water (make more water available in critically...


  • Warszawa, mazowieckie, Polska NeoGames Pełny etat

    NeoGames is a leader in the iLottery and iGaming space offering solutions spanning game studios, game aggregation, lotteries, online casino, sportsbook, bingo, and managed services offered through an industry leading core platform.The Data & BI team owns the groupâs Data & Analytics platforms spanning Data Engineering,Analytical Engineering and Business...


  • Warszawa, mazowieckie, Polska Lingaro Pełny etat

    We are seeking an experienced Cloud Data Engineer proficient with Snowflake and AWS. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows.Tasks: Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms. Integrating and...


  • Warszawa, mazowieckie, Polska Craftware Pełny etat

    Job Description:We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will be a Snowflake expert with extensive experience in data pipeline programming, cloud technologies, and DevOps practices. The role involves working on cutting-edge data solutions that provide actionable insights and support data exploration with Business...


  • Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:Act as a Data Engineer for the Google Cloud Platform projects: scalable and re-usable, self-service frameworks for data ingestion implementation of warehouses, data lakes, data marts and data processing pipeline solutions for new and existing clients.Build and maintain efficient, scalable, and reliable data architectures for analytics and...


  • Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:Act as a Data Engineer for the Google Cloud Platform projects: scalable and re-usable, self-service frameworks for data ingestion implementation of warehouses, data lakes, data marts and data processing pipeline solutions for new and existing clients.Build and maintain efficient, scalable, and reliable data architectures for analytics and...


  • Warszawa, mazowieckie, Polska Multi Parts Poland Pełny etat

    Multi Parts – since 1998, one of the Aftermarket’s leading manufacturers of replacement parts for passenger and commercial vehicles. Combining a deep understanding of the common failures impacting modern vehicles with expert engineering and manufacturing capabilities, Multi Parts offers customers a unique turn-key product solutions. Multi Parts has...

  • Cloud engineer senior

    1 miesiąc temu


    Warszawa, mazowieckie, Polska BEC Poland Pełny etat

    Join a community of people sharing great ambitionsBEC is a financial technology company creating IT solutions for Danish banks. Together, we enable their customers to invest online, take out loans and transfer money. In other words, everything it takes to run a bank.We have 1,700+ employees spread across five locations in Denmark and Poland. We collaborate...


  • Warszawa, mazowieckie, Polska BEC Poland Pełny etat

    Join a community of people sharing great ambitionsBEC is a financial technology company creating IT solutions for Danish banks. Together, we enable their customers to invest online, take out loans and transfer money. In other words, everything it takes to run a bank.We have 1,700+ employees spread across five locations in Denmark and Poland. We collaborate...


  • Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    We are looking for a driven, naturally curious Senior Data Engineer to join our Digital Experiences team delivering cloud native Big Data solutions within our global Media ecosystem. Our engineering teams work with data on a massive scale and are responsible for the design, development, and continuous innovation of best-in-class solutions supporting P&G as...


  • Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    We are looking for a driven, naturally curious Senior Data Engineer to join our Digital Experiences team delivering cloud native Big Data solutions within our global Media ecosystem. Our engineering teams work with data on a massive scale and are responsible for the design, development, and continuous innovation of best-in-class solutions supporting P&G as...

  • Data Engineer

    3 dni temu


    Warszawa, mazowieckie, Polska PAYBACK Pełny etat

    ðµ PAYBACK is the worldâs leading multi-partner loyalty program. As an international player, we operate in German, Italian, Mexican, and Austrian markets. More than 10 million active customers already use the German PAYBACK app and mobile PAYBACK services via their smartphones.Your responsibilities:Develop and migrate data processing, ETL processes, data...

  • Data Engineer

    5 dni temu


    Warszawa, mazowieckie, Polska PAYBACK Pełny etat

    PAYBACK is the world’s leading multi-partner loyalty program. As an international player, we operate in German, Italian, Mexican, and Austrian markets. More than 10 million active customers already use the German PAYBACK app and mobile PAYBACK services via their smartphones.Your responsibilities:Develop and migrate data processing, ETL processes, data...