Big Data Engineer Expert in Scalable Data Solutions

19 godzin temu

Gdańsk, Pomerania, Polska Grid Dynamics Poland Pełny etat

At Grid Dynamics, we're seeking an experienced Big Data Engineer to join our team in Poland. As a key member of our data engineering team, you will be responsible for designing and developing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies.

About the Job

This role offers a unique opportunity to work on bleeding-edge projects, collaborate with a highly motivated and dedicated team, and leverage your expertise in big data technologies to drive business outcomes.

Key Responsibilities
  • Design and Develop Big Data Solutions: Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements.
  • Data Ingestion and Processing: Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats.
  • Optimize Data Pipelines: Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency.
  • Cluster Management and Optimization: Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications.
  • Real-Time Data Processing: Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making.
  • Data Quality and Governance: Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems.
  • Performance Tuning and Monitoring: Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.
Requirements
  • Strong Programming Skills: Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala.
  • Expertise in Big Data Technologies: Extensive experience with Apache Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, and HBase.
  • Advanced Spark Knowledge: In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics.
  • Data Modeling and ETL: Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies.
  • Cluster Management Tools: Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling.
  • SQL and NoSQL Databases: Proficiency in SQL for querying and analyzing data stored in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
We Offer
  • Competitive Salary: 120,000 PLN per year (approximately $27,000 USD based on current exchange rates)
  • Flexible Schedule: Enjoy a balance between work and personal life
  • Benefits Package: Comprehensive benefits package including medical insurance, sports benefits, and more
  • Professional Development Opportunities: Enhance your skills and advance your career with our comprehensive training programs
  • Well-Equipped Office: Modern and comfortable office space in the heart of Poland

About Us:

Grid Dynamics is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. With a strong presence in the industry and a reputation for delivering innovative solutions, we offer a unique opportunity to work with a talented team of experts and drive business growth through technology.

  • Big Data Engineer Specialist

    2 tygodni temu

    Gdańsk, Pomerania, Polska B2B S.A Pełny etat

    Big Data Engineer SpecialistAt B2B S.A, we are seeking a highly skilled Big Data Engineer to join our team. This is an exciting opportunity for a talented professional to take on a challenging role and contribute to the growth of our company.The ideal candidate will have experience in handling complex data sets and a strong understanding of big data...

  • Expert Big Data Engineer

    1 miesiąc temu

    Gdańsk, Pomerania, Polska Square One Resources Sp. z o.o. Pełny etat

    Job OverviewWe are seeking an expert Hadoop Developer to join our team at Square One Resources Sp. z o.o.Key ResponsibilitiesDesign, develop, and maintain large-scale data processing systems using Hadoop technology.Collaborate with cross-functional teams to analyze business requirements and implement efficient data solutions.Analyze complex data sets to...

  • Data-Driven Scalable Developer

    3 tygodni temu

    Gdańsk, Pomerania, Polska Square One Resources Sp. z o.o. Pełny etat

    At Square One Resources Sp. z o.o., we're seeking an accomplished Data-Driven Scalable Developer to spearhead our data-driven initiative.The goal of this project is to support group risk reporting and other Use Cases by implementing new or improving existing data pipelines, focusing on re-modeling and aggregating defined data input into a common company...

  • Highly Skilled Big Data Engineer

    1 miesiąc temu

    Gdańsk, Pomerania, Polska b2bnetwork Pełny etat

    B2B Network is seeking a highly skilled Big Data Engineer to join our Backend Application capability team. As a Senior Hadoop/Big Data Developer, you will play a vital role in supporting key projects and initiatives within GBS - IT/Technology cluster.We have a customer-focused mindset and value ownership, collaboration, and knowledge highly on our agenda....

  • Data Engineering Expert

    4 tygodni temu

    Gdańsk, Pomerania, Polska b2bnetwork Pełny etat

    Job Title: Big Data Transformation SpecialistWe are seeking a highly skilled Data Engineer to join our team at b2bnetwork.About the Role:This is an exciting opportunity to work with cutting-edge technology and contribute to the development of innovative data solutions.Key Responsibilities:Design, develop, and maintain large-scale data processing systems...

  • Data Engineer II Specialist for Enterprise Data Pipelines

    3 tygodni temu

    Gdańsk, Pomerania, Polska VIATOR Pełny etat

    About Viator: Revolutionizing TravelViator, a leading travel experiences marketplace and part of the Tripadvisor family, is shaping the future of travel. With over 300,000+ experiences to explore, we empower travelers to create unforgettable memories.Competitive SalaryWe offer a competitive compensation package, including a base salary of $120,000 - $180,000...

  • Big Data Engineer for Hybrid Platform Development

    1 miesiąc temu

    Gdańsk, Pomerania, Polska Nordea Bank Pełny etat

    We are Nordea Bank, a 200-year-old institution supporting and growing the Nordic economies. Our values are deeply rooted in open, progressive, and collaborative societies.Our vision is to enable dreams and aspirations for a greater good by building relationships, learning, and leading change.About Our TeamWe are the Data Tooling team at Nordea, responsible...

  • Expert Data Solution Architect

    4 tygodni temu

    Gdańsk, Pomerania, Polska Jit Team Pełny etat

    Salary: 650-850 PLN/MDLocation: Gdynia, Gdansk, Warsaw, Łódź (remote hybrid)This position involves working as a vital bridge between business needs and developers to deliver high-quality IT solutions.Job ResponsibilitiesSolution Design: Create advanced data-driven solutions using analytics and design techniques.Stakeholder Collaboration: Work closely with...

  • Data Storage Solutions Engineer

    4 tygodni temu

    Gdańsk, Pomerania, Polska Cyclad Pełny etat

    Cyclad is seeking a highly skilled Data Storage Solutions Engineer to join our team in Poland. As a key member of our IT department, you will be responsible for designing, deploying, and managing storage solutions that meet the needs of our organization.The ideal candidate will have a strong background in storage technologies, including SAN, NAS, and object...

  • Big Data Analyst and Developer

    3 tygodni temu

    Gdańsk, Pomerania, Polska Square One Resources Sp. z o.o. Pełny etat

    Job Description:We are seeking a skilled Hadoop/Java Developer to join our team at Square One Resources Sp. z o.o. in Gdansk, Poland.About the Role:This is a hybrid work opportunity, requiring occasional presence in our office in Gdansk. As a Hadoop/Java Developer, you will play a key role in supporting our client from the banking industry by leveraging your...

  • Data Engineer

    1 miesiąc temu

    Gdańsk, Pomerania, Polska Epam Pełny etat

    Job OverviewWe are seeking a skilled Data Engineer to join our team at EPAM's Data Competency Center. This exciting opportunity will give you the chance to grow professionally and participate in a project for a leading technological giant.The ideal candidate will have experience in close collaboration with clients, understanding business needs, and providing...

  • Data Scientist and Engineer

    3 tygodni temu

    Gdańsk, Pomerania, Polska Square One Resources Sp. z o.o. Pełny etat

    Square One Resources Sp. z o.o. offers a competitive salary for the position of Data Scientist and Engineer, with an estimated annual income of 120 000 PLN.About Us:Square One Resources Sp. z o.o. is a dynamic company that supports data-driven initiatives by implementing new or improving existing data pipelines. Our team focuses on extracting, transforming,...

  • Cloud Engineering Solutions Expert

    1 miesiąc temu

    Gdańsk, Pomerania, Polska Grid Dynamics Poland Pełny etat

    We are seeking a highly skilled Cloud Engineering Solutions Expert to join our team at Grid Dynamics Poland.Salary: Estimated annual salary range: 120,000 - 180,000 PLN (approximately 25,000 - 37,500 USD) based on experience and qualifications.About the JobThis is an exceptional opportunity to work with a leading technology consulting company that provides...

  • Distributed Data Architect Position

    3 tygodni temu

    Gdańsk, Pomerania, Polska Devire Pełny etat

    We are seeking an experienced Data Engineer to join our team at Devire IT Outsourcing.About the CompanyAt Devire IT Outsourcing, we specialize in delivering high-quality IT solutions to clients across various industries. Our commitment to innovation and excellence has earned us a stable market position, and we continue to grow as a leading provider of IT...

  • Data Management and Analytics Expert

    1 miesiąc temu

    Gdańsk, Pomerania, Polska State Street Pełny etat

    We are seeking a highly skilled Data Management and Analytics Expert to join our team in Krakow or Gdansk, Poland.This role is based out of either of these locations, allowing for a hybrid work model with flexibility to balance work from home and office requirements.The successful candidate will play an integral part in building and maintaining the...

  • Data Foundation Support Expert

    3 tygodni temu

    Gdańsk, Pomerania, Polska Arla Global Shared Services Sp. Z O.o. Pełny etat

    As a Data Foundation Support Expert, you will play a vital role in maintaining the comprehensive understanding of support capabilities and adapting the support model as needed in the Data Foundation area.Key ResponsibilitiesEnsure that support teams for assigned areas perform according to Arla standards when resolving incidents and service requests.Support...

  • Data Solutions Specialist

    2 tygodni temu

    Gdańsk, Pomerania, Polska Emagine Sp. Z O.o. Pełny etat

    Job OverviewWe are seeking a skilled Data Solutions Specialist to join our team at Emagine Sp. Z O.o. and work on international payment operations projects within a Scandinavian business culture.Key Responsibilities:Design, implement, and maintain near real-time payment data flows, including data integrations, data mapping, and solution design.Collaborate...

  • Data Engineering Expert for AI and Machine Learning

    4 tygodni temu

    Gdańsk, Pomerania, Polska Acoustic Pełny etat

    Company OverviewAt Acoustic, we are a dynamic team of professionals working together to deliver cutting-edge solutions in the field of data engineering. We are seeking an exceptional Data Engineer with expertise in AI and machine learning to join our team.SalaryWe offer a competitive salary package ranging from $120,000 to $180,000 per year, depending on...

  • Data Governance Expert for Renewable Energy

    1 miesiąc temu

    Gdańsk, Pomerania, Polska SIEMENS GAMESA RENEWABLE ENERGY Sp. Z O.o. Pełny etat

    Company Overview: Siemens Gamesa is a global leader in renewable energy, dedicated to making clean energy a reality for generations to come. Our team is passionate about innovation and collaboration.Job Description: We are seeking an experienced Data Governance Expert to join our team in driving excellence in Master Data Management for our Equipment and...

  • Master Data Management Specialist

    2 miesięcy temu

    Gdańsk, Pomerania, Polska B2B S.A Pełny etat

    About this OpportunityWe're seeking a RMD Configuration Specialist to work on a multinational project about Master Data Management (MDM).B2B S.A is a leading company in the IT industry, and we're committed to delivering high-quality solutions.As a RMD Configuration Specialist, you'll be responsible for establishing a single trusted source for Master &...