Data Engineer
3 tygodni temu
Job Summary
We are seeking a highly skilled Data Engineer with extensive experience in Hadoop and HDFS, as well as a deep understanding of relational databases. The ideal candidate will design, build, and maintain our data infrastructure to ensure efficient, reliable, and scalable data processing and storage solutions.
Key Responsibilities
- Design, develop, and implement data solutions that acquire, transform, and optimize data from diverse sources
- Design and build scalable and optimized data pipelines to enable data ingestion, transformation, and storage
- Ensure data quality and integrity by implementing data validation and cleansing processes
- Contribute to the development of data models and data architecture
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Manage and maintain HDFS for distributed storage of large datasets
- Perform data transformations and aggregations to support analytical and reporting requirements
- Identify and resolve issues related to data processing and storage
Requirements
- Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree preferred
- Proven experience as a Data Engineer with a strong focus on Hadoop and HDFS
- Proficiency in Hadoop ecosystem tools such as Hive, Pig, Flume, Oozie, and Sqoop
- Experience with data processing frameworks like Apache Spark
- Strong skills in relational databases with experience in SQL development
- Knowledge of data warehousing concepts and database technologies
- Excellent problem-solving skills and the ability to troubleshoot complex data issues
-
Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska b2bnetwork Pełny etatData Engineer Job DescriptionWe are seeking a skilled and motivated Data Engineer to join our team at b2bnetwork. In this role, you will be responsible for designing, building, and maintaining our data infrastructure to ensure efficient, reliable, and scalable data processing and storage solutions.Key Responsibilities:Design and develop data solutions that...
-
Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Acoustic Pełny etatAbout AcousticAcoustic is a leading marketing cloud that empowers businesses to succeed in a dynamic world. We're reimagining marketing technology by automating repetitive tasks and equipping marketers with intuitive tools that simplify complex processes.Job DescriptionWe're seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play...
-
Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Epam Pełny etatAbout the RoleWe are seeking a talented Data Engineer to join our team at EPAM Data Competency Center. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems and pipelines.ResponsibilitiesDesign and implement data pipelines and architectures to support business needsCollaborate with cross-functional...
-
Data Engineer
1 dzień temu
Gdańsk, Pomerania, Polska b2bnetwork Pełny etatAbout the RoleWe are seeking an experienced Data Engineer to join our team at b2bnetwork.Key ResponsibilitiesDevelop data visualization solutions using PowerBI.Analyze and process data from various databases using SQL.Design and implement tabular in-memory data models in SQL Server Analysis Services.Set up data connectors and refresh jobs in SQL Server...
-
Data Engineer
11 godzin temu
Gdańsk, Pomerania, Polska b2bnetwork Pełny etatUnlock New Opportunities with b2bnetwork as our Big Data Engineer!About the Role:We are seeking a skilled Big Data Engineer to join our dynamic team at b2bnetwork. As a key member of our data engineering team, you will be responsible for designing and developing highly scalable and efficient data pipelines using Spark and Python.Key Responsibilities:Design...
-
Cloud Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Kolomolo Pełny etatCloud Data EngineerWe are seeking a skilled Cloud Data Engineer to craft and maintain intricate data pipelines within our state-of-the-art Snowflake data warehouse. As a key member of our dynamic team at DW & Analytics, you will empower your team of BI developers to generate insightful Power BI reports by seamlessly loading and extracting data from source to...
-
Cloud Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Kolomolo Pełny etatCloud Data EngineerWe are seeking a skilled Cloud Data Engineer to craft and maintain intricate data pipelines within our state-of-the-art Snowflake data warehouse. As a key member of our dynamic team at DW & Analytics, you will empower your team of BI developers to generate insightful Power BI reports by seamlessly loading and extracting data from source to...
-
Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Ciklum Pełny etatAbout the RoleCiklum is seeking a highly skilled Data Engineer to join our team in Poland. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our clients' business needs.ResponsibilitiesDesign and implement data pipelines using Hadoop, MapReduce, Pig, Hive, Impala, Spark, Kafka, and...
-
Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Transition Technologies MS Pełny etatWe are looking for a highly skilled Data Engineer to join our team at Transition Technologies MS. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using cloud technologies such as Airflow, Glue, and Dataflow.Key Responsibilities:Design and develop data pipelines using cloud technologiesMaintain...
-
Middle Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska N-iX Pełny etatKey Responsibilities:We are seeking a proactive Middle Data Engineer to join our vibrant team. In this role, you will take on a pivotal position, collaborating closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry.Key Responsibilities:Design,...
-
Big Data Engineer
11 godzin temu
Gdańsk, Pomerania, Polska b2bnetwork Pełny etatAbout the Role:We are seeking a skilled Big Data Engineer to join our team at b2bnetwork.Key Responsibilities:Develop and maintain large-scale data processing systems using Hadoop and related technologies.Design and implement data pipelines to process and analyze large datasets.Collaborate with cross-functional teams to integrate data analytics into business...
-
Data Engineer
1 tydzień temu
Gdańsk, Pomerania, Polska Jit Team Sp. Z O.o. Pełny etatWe're looking for a skilled Data Engineer to help organizations improve customer engagement by leveraging customer data effectively. This role involves leading companies through digital transformation by integrating advanced technologies like AI, CDPs, and analytics platforms, optimizing both data management and decision-making...
-
Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Epam Pełny etatAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesDesign and implement data pipelines using GCP services such as Big Query and Data PrepDevelop and maintain ETL/ELT solutions using...
-
GCP Data Engineer
3 tygodni temu
Gdańsk, Pomerania, Polska Groupe SII Pełny etatTransform Data into InsightsAs a Data Engineer at Groupe SII, you will play a key role in designing and implementing data engineering solutions on the Google Cloud Platform (GCP). Your expertise in data analysis, data profiling, and data integration will be crucial in building and testing complex data products.Key Responsibilities:Develop software projects...
-
Big Data Engineer
1 tydzień temu
Gdańsk, Pomerania, Polska Scalac Pełny etatAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Scalac. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. Your expertise in Scala and Spark will be invaluable in helping us deliver high-quality software solutions to our clients.Key...
-
Big Data Engineer
4 dni temu
Gdańsk, Pomerania, Polska Scalac Pełny etatAbout the Role:We are seeking an experienced Big Data Engineer with a strong background in Scala and Spark to join our team at Scalac. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Scala and...
-
Senior Data Engineer with Hadoop Expertise
3 tygodni temu
Gdańsk, Pomerania, Polska Jit Team Pełny etatJob Title: Senior Data Engineer with Hadoop ExpertiseWe are seeking a highly skilled Data Engineer with extensive experience in Hadoop and HDFS, as well as a deep understanding of relational databases, to join our team.Key Responsibilities:Design, build, and maintain our data infrastructure to ensure efficient, reliable, and scalable data processing and...
-
Data Engineer
6 dni temu
Gdańsk, Pomerania, Polska b2bnetwork Pełny etatJob Title: Data Engineer - Hadoop and HDFS ExpertJob Summary:We are seeking a skilled and motivated Data Engineer with extensive experience in Hadoop and HDFS to join our team. In this role, you will be responsible for designing, building, and maintaining our data infrastructure to ensure efficient, reliable, and scalable data processing and storage...
-
Big Data Engineer with Java Expertise
2 tygodni temu
Gdańsk, Pomerania, Polska Grid Dynamics Poland Pełny etatBig Data Engineer with Java ExpertiseWe are seeking a skilled Big Data Engineer with expertise in Java to join our team at Grid Dynamics Poland. As a Big Data Engineer, you will be responsible for developing and maintaining large-scale data processing systems using Java.Key ResponsibilitiesDesign and implement data processing pipelines using Java.Collaborate...
-
Big Data Engineer
2 tygodni temu
Gdańsk, Pomerania, Polska Grid Dynamics Poland Pełny etatWe are seeking a skilled Big Data Engineer to contribute to the Cassandra Ingestion Service project. This role requires expertise in handling large-scale data using technologies such as Cassandra, Kafka, Spark, and Scala. You will be responsible for designing and optimizing data ingestion pipelines to support data integration and transformation, ensuring the...