Data Engineer with Expertise in Groovy and Spark
3 miesięcy temu
Responsibilities
Work closely with data engineers, the product team, and other stakeholders to gather data requirements, and design and build efficient data pipelines Create and maintain algorithms and data processing code in Java/Groovy Implement processes for data validation, cleansing, and transformation to ensure data accuracy and consistency Develop Python scripts to automate data extraction from both new and existing sources Monitor and troubleshoot the performance of data pipelines in Airflow, proactively addressing any issues or bottlenecks Write SQL queries to extract data from BigQuery and develop reports using Google’s Looker Studio Participate in daily stand-ups, sprint planning, and retrospective meetings Engage in peer code reviews, knowledge sharing, and assist other engineers with their work Introduce new technologies and best practices as needed to keep the product up to date Assist in troubleshooting and resolving production escalations and issues
Requirements
Bachelor's degree or equivalent programming experience 4-5 years of overall experience as a backend software developer, with at least 2 years as a Data Engineer using Spark with Java/Groovy and/or Python Strong coding skills, and knowledge of data structures, OOP principles, databases, and API design Highly proficient in developing programs and data pipelines in Java/Groovy or Python 2+ years of professional experience with Apache Spark/Hadoop
Nice to have
Work experience with AWS (EMR, S3, lambda, EC2, glue, RDS) Work experience with SQL (MYSQL is a Plus) and NoSQL Databases Experience with Elasticsearch Experience with Python Experience with Scala (Zeppelin) Experience with Airflow or other ETL Certification or verified training in one or more of the following technologies/products: AWS, ElasticSearch Useful links-
Data Engineer
1 tydzień temu
Łódź, Łódź Voivodeship, Polska Commerzbank AG Poland Pełny etatAbout the Role:We are seeking a highly skilled Data Engineer to join our Big Data Team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using various technologies such as Hadoop, Spark, and Cloud Dataflow.Develop and maintain...
-
Azure Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska IN Team Pełny etatJob Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at IN Team. As a key member of our Data Platform team, you will be responsible for designing, implementing, and maintaining a robust and scalable data platform on Azure.Key Responsibilities:Collaborate with product teams to understand business requirements and...
-
Azure Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska IN Team Pełny etatJob Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at IN Team. As a key member of our Data Platform, you will be responsible for designing, implementing, and maintaining a robust and scalable data platform on Azure Databricks and Azure Cloud.Key Responsibilities:Collaborate with product teams to understand...
-
Azure Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska IN Team Pełny etatJob Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at IN Team. As a key member of our Data Platform, you will be responsible for designing, implementing, and maintaining a robust and scalable data platform on Azure Databricks and Azure Cloud.Key Responsibilities:Collaborate with product teams to understand...
-
Data Engineer
1 tydzień temu
Łódź, Łódź Voivodeship, Polska Incubly Pełny etatWe are looking for a skilled Data Engineer to join our team at Incubly. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.Key responsibilities include:Understanding customer business context, objectives, and requirementsConverting functional specifications into programming instructionsPrototyping...
-
Data Engineer
6 dni temu
Łódź, Łódź Voivodeship, Polska Incubly Pełny etatWe are seeking a highly skilled Data Engineer to join our team at Incubly. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and develop data pipelines and architectures to support business intelligence and analytics initiatives.Collaborate with...
-
Senior Data Engineer
2 dni temu
Łódź, Łódź Voivodeship, Polska Commerzbank AG Poland Pełny etatAbout the Role:We are looking for a skilled Senior Data Engineer to join our Big Data Team. As a member of this team, you will be responsible for developing and maintaining our cloud and on-prem data solutions.About the Team:Our Big Data Team is responsible for building and maintaining our data infrastructure, including data lakes, warehouses, and pipelines....
-
Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska Incubly Pełny etatAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Incubly. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure to support business growth and decision-making.ResponsibilitiesCollaborate with cross-functional teams to understand business requirements and develop...
-
Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska Commerzbank AG Poland Pełny etatAbout the RoleWe are seeking a highly skilled Data Engineer to join our Big Data Team at Commerzbank AG Poland. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring the seamless flow of data across our systems.Key ResponsibilitiesDesign and implement data pipelines to transform data into...
-
Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska IMG ARENA Pełny etatAbout the RoleAt IMG ARENA, we're pushing the boundaries of sports data innovation. As a Data Engineer, you'll be part of our agile Data Engineering and Data Science team, collaborating with cross-functional teams to champion the highest standards of data storage, quality, analysis, and democratization. Your mission will be to implement new products and...
-
Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska Incubly Pełny etat{"h2": "Join Our Team as a Data Engineer/BI Developer", "p": "At Incubly, we are passionate about building a company that attracts great minds and achieves success together. We believe that great people want to work with great people, and we are looking for a talented Data Engineer/BI Developer to join our team.", "ul": [{"li": "Understand the...
-
Data Engineer and Business Intelligence Developer
1 tydzień temu
Dowborczyków , Łódź, Polska Incubly Pełny etatAbout the JobWe are seeking a highly skilled Data Engineer and Business Intelligence Developer to join our team at Incubly. As a key member of our team, you will be responsible for designing, developing, and maintaining our data infrastructure and business intelligence solutions.Key responsibilities include:Understanding the customer's business context,...
-
Senior DevOps Engineer with Azure Expertise
1 tydzień temu
Łódź, Polska Spyrosoft Pełny etatWe are seeking a seasoned DevOps Engineer with expertise in Azure to join our team at Spyrosoft. The ideal candidate will have a strong background in designing and implementing scalable Azure infrastructure.The selected candidate will be responsible for migrating our client's Umbraco main website to a new subscription based on a Terraform script. This...
-
Senior Data Engineer
1 tydzień temu
Al. Piłsudskiego , Łódź, Polska Incubly Pełny etatAbout the JobWe are seeking a highly skilled Senior Data Engineer to join our team at Incubly. As a key member of our data engineering team, you will play a crucial role in designing and implementing scalable data solutions that drive business growth.Our company, Incubly, is a leader in end-to-end smart mobility and mobility management, offering innovative...
-
Łódź, Polska Nordea Bank Pełny etatJob ID: 26511 We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. Nordea is one of the biggest banking employers in the Nordics, Poland and Estonia, and with us, you’ll find plenty of opportunities to grow, develop and make...
-
HR Specialist with Romanian Language Expertise
2 tygodni temu
Łódź, Łódź Voivodeship, Polska McCormick & Company Pełny etatHR Specialist with Romanian Language ExpertiseMcCormick & CompanyWe are seeking an HR Specialist with Romanian language expertise to join our team. As a key member of our HR function, you will be responsible for providing HR administration assistance to employees, processing HR data, and ensuring compliance with company policies and procedures.Key...
-
Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska Groupe SII Pełny etatUnlock the Power of Data with Our ETL Developer RoleWe are seeking a highly skilled ETL Developer/Data Engineer to join our Data & Analytics Competency Center at Groupe SII. As a key member of our team, you will be responsible for designing and implementing scalable, high-performance data architectures that support our business needs.Your Key...
-
Data Engineer
2 tygodni temu
Łódź, Łódź Voivodeship, Polska Groupe SII Pełny etatWe are seeking a skilled Data Engineer to join our Data & Analytics Competency Center at Groupe SII. As an ETL Developer, you will be responsible for designing and implementing scalable data architectures, ensuring optimal performance, scalability, and reliability.Your key responsibilities will include:Developing and implementing ETL processes using...
-
Big Data Developer
2 dni temu
Łódź, Łódź Voivodeship, Polska Belmont Lavan Ltd Pełny etatBig Data Developer at Belmont Lavan LtdWe are looking for a talented Big Data Developer to design, develop, and maintain scalable and efficient big data solutions. As a Big Data Developer, you will work closely with cross-functional teams to gather requirements, design data architectures, and implement data processing and analysis...
-
Senior DevOps Engineer with Azure Expertise
2 tygodni temu
Łódź, Polska Spyrosoft Pełny etatJob Title: Senior Lead DevOps with AzureWe are seeking a seasoned Senior Lead DevOps professional with expertise in Azure to join our team at Spyrosoft. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and secure cloud infrastructure on Azure.The ideal candidate will have a strong...