Data Engineer with Expertise in Groovy and Spark

3 miesięcy temu


Łódź, Polska DataArt Pełny etat

Responsibilities

Work closely with data engineers, the product team, and other stakeholders to gather data requirements, and design and build efficient data pipelines Create and maintain algorithms and data processing code in Java/Groovy Implement processes for data validation, cleansing, and transformation to ensure data accuracy and consistency Develop Python scripts to automate data extraction from both new and existing sources Monitor and troubleshoot the performance of data pipelines in Airflow, proactively addressing any issues or bottlenecks Write SQL queries to extract data from BigQuery and develop reports using Google’s Looker Studio Participate in daily stand-ups, sprint planning, and retrospective meetings Engage in peer code reviews, knowledge sharing, and assist other engineers with their work Introduce new technologies and best practices as needed to keep the product up to date Assist in troubleshooting and resolving production escalations and issues

Requirements

Bachelor's degree or equivalent programming experience 4-5 years of overall experience as a backend software developer, with at least 2 years as a Data Engineer using Spark with Java/Groovy and/or Python Strong coding skills, and knowledge of data structures, OOP principles, databases, and API design Highly proficient in developing programs and data pipelines in Java/Groovy or Python 2+ years of professional experience with Apache Spark/Hadoop

Nice to have

Work experience with AWS (EMR, S3, lambda, EC2, glue, RDS) Work experience with SQL (MYSQL is a Plus) and NoSQL Databases Experience with Elasticsearch Experience with Python Experience with Scala (Zeppelin) Experience with Airflow or other ETL Certification or verified training in one or more of the following technologies/products: AWS, ElasticSearch Useful links
  • Data Engineer

    1 tydzień temu


    Łódź, Łódź Voivodeship, Polska Commerzbank AG Poland Pełny etat

    About the Role:We are seeking a highly skilled Data Engineer to join our Big Data Team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using various technologies such as Hadoop, Spark, and Cloud Dataflow.Develop and maintain...

  • Azure Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska IN Team Pełny etat

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at IN Team. As a key member of our Data Platform team, you will be responsible for designing, implementing, and maintaining a robust and scalable data platform on Azure.Key Responsibilities:Collaborate with product teams to understand business requirements and...

  • Azure Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska IN Team Pełny etat

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at IN Team. As a key member of our Data Platform, you will be responsible for designing, implementing, and maintaining a robust and scalable data platform on Azure Databricks and Azure Cloud.Key Responsibilities:Collaborate with product teams to understand...

  • Azure Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska IN Team Pełny etat

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at IN Team. As a key member of our Data Platform, you will be responsible for designing, implementing, and maintaining a robust and scalable data platform on Azure Databricks and Azure Cloud.Key Responsibilities:Collaborate with product teams to understand...

  • Data Engineer

    1 tydzień temu


    Łódź, Łódź Voivodeship, Polska Incubly Pełny etat

    We are looking for a skilled Data Engineer to join our team at Incubly. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.Key responsibilities include:Understanding customer business context, objectives, and requirementsConverting functional specifications into programming instructionsPrototyping...

  • Data Engineer

    6 dni temu


    Łódź, Łódź Voivodeship, Polska Incubly Pełny etat

    We are seeking a highly skilled Data Engineer to join our team at Incubly. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and develop data pipelines and architectures to support business intelligence and analytics initiatives.Collaborate with...


  • Łódź, Łódź Voivodeship, Polska Commerzbank AG Poland Pełny etat

    About the Role:We are looking for a skilled Senior Data Engineer to join our Big Data Team. As a member of this team, you will be responsible for developing and maintaining our cloud and on-prem data solutions.About the Team:Our Big Data Team is responsible for building and maintaining our data infrastructure, including data lakes, warehouses, and pipelines....

  • Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska Incubly Pełny etat

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Incubly. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure to support business growth and decision-making.ResponsibilitiesCollaborate with cross-functional teams to understand business requirements and develop...

  • Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska Commerzbank AG Poland Pełny etat

    About the RoleWe are seeking a highly skilled Data Engineer to join our Big Data Team at Commerzbank AG Poland. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring the seamless flow of data across our systems.Key ResponsibilitiesDesign and implement data pipelines to transform data into...

  • Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska IMG ARENA Pełny etat

    About the RoleAt IMG ARENA, we're pushing the boundaries of sports data innovation. As a Data Engineer, you'll be part of our agile Data Engineering and Data Science team, collaborating with cross-functional teams to champion the highest standards of data storage, quality, analysis, and democratization. Your mission will be to implement new products and...

  • Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska Incubly Pełny etat

    {"h2": "Join Our Team as a Data Engineer/BI Developer", "p": "At Incubly, we are passionate about building a company that attracts great minds and achieves success together. We believe that great people want to work with great people, and we are looking for a talented Data Engineer/BI Developer to join our team.", "ul": [{"li": "Understand the...


  • Dowborczyków , Łódź, Polska Incubly Pełny etat

    About the JobWe are seeking a highly skilled Data Engineer and Business Intelligence Developer to join our team at Incubly. As a key member of our team, you will be responsible for designing, developing, and maintaining our data infrastructure and business intelligence solutions.Key responsibilities include:Understanding the customer's business context,...


  • Łódź, Polska Spyrosoft Pełny etat

    We are seeking a seasoned DevOps Engineer with expertise in Azure to join our team at Spyrosoft. The ideal candidate will have a strong background in designing and implementing scalable Azure infrastructure.The selected candidate will be responsible for migrating our client's Umbraco main website to a new subscription based on a Terraform script. This...

  • Senior Data Engineer

    1 tydzień temu


    Al. Piłsudskiego , Łódź, Polska Incubly Pełny etat

    About the JobWe are seeking a highly skilled Senior Data Engineer to join our team at Incubly. As a key member of our data engineering team, you will play a crucial role in designing and implementing scalable data solutions that drive business growth.Our company, Incubly, is a leader in end-to-end smart mobility and mobility management, offering innovative...


  • Łódź, Polska Nordea Bank Pełny etat

    Job ID: 26511 We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. Nordea is one of the biggest banking employers in the Nordics, Poland and Estonia, and with us, you’ll find plenty of opportunities to grow, develop and make...


  • Łódź, Łódź Voivodeship, Polska McCormick & Company Pełny etat

    HR Specialist with Romanian Language ExpertiseMcCormick & CompanyWe are seeking an HR Specialist with Romanian language expertise to join our team. As a key member of our HR function, you will be responsible for providing HR administration assistance to employees, processing HR data, and ensuring compliance with company policies and procedures.Key...

  • Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska Groupe SII Pełny etat

    Unlock the Power of Data with Our ETL Developer RoleWe are seeking a highly skilled ETL Developer/Data Engineer to join our Data & Analytics Competency Center at Groupe SII. As a key member of our team, you will be responsible for designing and implementing scalable, high-performance data architectures that support our business needs.Your Key...

  • Data Engineer

    2 tygodni temu


    Łódź, Łódź Voivodeship, Polska Groupe SII Pełny etat

    We are seeking a skilled Data Engineer to join our Data & Analytics Competency Center at Groupe SII. As an ETL Developer, you will be responsible for designing and implementing scalable data architectures, ensuring optimal performance, scalability, and reliability.Your key responsibilities will include:Developing and implementing ETL processes using...

  • Big Data Developer

    2 dni temu


    Łódź, Łódź Voivodeship, Polska Belmont Lavan Ltd Pełny etat

    Big Data Developer at Belmont Lavan LtdWe are looking for a talented Big Data Developer to design, develop, and maintain scalable and efficient big data solutions. As a Big Data Developer, you will work closely with cross-functional teams to gather requirements, design data architectures, and implement data processing and analysis...


  • Łódź, Polska Spyrosoft Pełny etat

    Job Title: Senior Lead DevOps with AzureWe are seeking a seasoned Senior Lead DevOps professional with expertise in Azure to join our team at Spyrosoft. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud infrastructure on Azure.The ideal candidate will have a strong...