Senior Big Data Engineer

4 tygodni temu

Kraków, Lesser Poland Daxx Pełny etat

We are seeking a highly skilled Senior Big Data Engineer to join our team at Grid Dynamics. As a Senior Big Data Engineer, you will be responsible for designing and developing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements.

Key Responsibilities:

  • Design and Develop Big Data Solutions: Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements.
  • Data Ingestion and Processing: Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats.
  • Optimize Data Pipelines: Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency.
  • Cluster Management and Optimization: Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications.
  • Real-Time Data Processing: Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making.
  • Data Quality and Governance: Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems.
  • Performance Tuning and Monitoring: Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.

Requirements:

  • Strong Programming Skills: Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala.
  • Expertise in Big Data Technologies: Extensive experience with Apache Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, and HBase.
  • Advanced Spark Knowledge: In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics.
  • Data Modeling and ETL: Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies.
  • Cluster Management Tools: Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling.
  • SQL and NoSQL Databases: Proficiency in SQL for querying and analyzing data stored in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).

What We Offer:

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About Us:

Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud migration, and application modernisation. Grid Dynamics achieves high speed-to-market, quality, and efficiency by using technology accelerators, an agile delivery culture, and its pool of global engineering talent. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, UK, Netherlands, Mexico, and Central and Eastern Europe. To learn more about Grid Dynamics, please visit www.griddynamics.com. Follow us on Facebook, Twitter, and LinkedIn.

  • Senior Data Engineer

    4 tygodni temu

    Kraków, Lesser Poland MyGwork Pełny etat

    Senior Data Engineer - Big Data ArchitectureWe are seeking an experienced Senior Data Engineer to join our Global Delivery Team within the Enterprise Customer Success Department.Key Responsibilities:Create data pipeline architecture and assemble complex data sets that meet functional and non-functional requirements.Identify, design, and implement internal...

  • Senior Big Data Engineer

    4 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Digital Transformation OpportunitiesWe are seeking a Senior Big Data Engineer to join our team at Grid Dynamics, a digital-native technology services provider. As a key member of our engineering team, you will be responsible for designing, developing, and implementing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies.Key...

  • Data Engineer

    3 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Data Engineer Role in Digital PaymentsWe are seeking an experienced Data Engineer to join our team and contribute to the development of scalable data solutions using Hadoop and Spark technologies. The ideal candidate will have a strong background in big data engineering, a deep understanding of data processing and analytics, and excellent problem-solving...

  • Big Data Architect

    2 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Unlock Your Potential as a Cloud Big Data Engineer at DaxxWe are seeking an experienced Cloud Big Data Engineer to join our team at Daxx, a leading digital transformation consulting and implementation services provider. As a key member of our engineering team, you will have the opportunity to work on cutting-edge projects that drive innovation and growth for...

  • Data Architect

    2 tygodni temu

    Kraków, Lesser Poland Daxx Pełny etat

    Job DescriptionWe are seeking a highly skilled Data Architect - Big Data Engineer to join our team in Daxx. As a key member of our engineering department, you will be responsible for designing and developing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies.

  • Senior Data Engineer

    4 tygodni temu

    Kraków, Lesser Poland William Hill Pełny etat

    Job Title: Senior Data EngineerAt William Hill, we're looking for a skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you'll play a key role in designing, building, and maintaining our cloud-based data platform. You'll work closely with our data scientists and engineers to develop and implement data pipelines, ensuring that our data...

  • Senior Data Engineer ML AI

    4 tygodni temu

    Kraków, Lesser Poland MyGwork Pełny etat

    Senior Data Engineer AI & MLWe are looking for an experienced Senior Data Engineer to join our growing Global Delivery Team within the Enterprise Customer Success Organization. The successful candidate will improve our data and data pipeline architecture, optimizing data flow and collection for associated teams.Create data pipeline architectureAssemble...

  • Senior Big Data Engineer for Scalable Logistics Solutions

    1 tydzień temu

    Kraków, Lesser Poland Opennet Sp. z o.o. Pełny etat

    We are part of Allegro, a leading e-commerce company, and specialists in providing advanced IT systems for logistics management.Our team is responsible for designing and implementing scalable solutions that meet the demands of our business. We practice Agile methodologies, including Scrum/Kanban, to ensure seamless collaboration and efficient delivery.As a...

  • Senior Data Software Engineer

    4 tygodni temu

    Kraków, Lesser Poland EPAM Systems Pełny etat

    Job Title: Senior Data Software EngineerEPAM Systems is seeking a Senior Data Software Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building ETL/ELT pipelines using Java Dataflow and other technologies on the GCP.Key Responsibilities:Provide technical leadership and oversight for other...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, Lesser Poland NeoGames Pełny etat

    Job Title: Senior Data EngineerAt NeoGames, we're seeking a seasoned Senior Data Engineer to join our Data & BI team. As a key member of our team, you'll be responsible for designing and implementing scalable data pipelines to ingest, transform, distribute, and expose data from our Core Data Lake.Key Responsibilities:Create data pipelines in batch and...

  • Senior Data Architect

    4 tygodni temu

    Kraków, Lesser Poland kdrhumanresourcesconsulting Pełny etat

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of large-scale data processing systems on Azure. As a key member of our team, you will provide strategic insights that drive business success and collaborate with cross-functional teams to deliver robust and efficient data solutions.Key...

  • Data Quality Engineer

    4 tygodni temu

    Kraków, Lesser Poland GPC GLOBAL TECHNOLOGY CENTER Pełny etat

    Senior Data Quality EngineerJob Summary: We are seeking a highly skilled Senior Data Quality Engineer to join our team at GPC GLOBAL TECHNOLOGY CENTER. As a key member of our Data Science team, you will be responsible for ensuring the quality and accuracy of our AI-driven digital Catalog products.Responsibilities: • Collaborate with data scientists, AI/ML...

  • Senior Data Architect

    3 tygodni temu

    Kraków, Lesser Poland VGW Pełny etat

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Engineering team in Poland. As a Senior Data Engineer, you will play a vital role in integrating new games into VGW's existing systems, ensuring high-quality experiences for our players.Tech we useOur current analytics stack includes Snowflake, Databricks, AWS (including S3...

  • Senior Data Test Engineer

    3 dni temu

    Kraków, Lesser Poland William Hill Pełny etat

    Job Title: Senior Data Test EngineerAbout the RoleWe are seeking a highly skilled Senior Data Test Engineer to join our team. In this role, you will be responsible for ensuring the performance, speed, and stability of real-time datasets.Key ResponsibilitiesDevelop comprehensive and top-notch test cases, incorporating both automation and performance...

  • Senior Cloud Data Architect

    3 tygodni temu

    Kraków, Lesser Poland kdrhumanresourcesconsulting Pełny etat

    Job DescriptionSenior Data EngineerAt kdrhumanresourcesconsulting, we are seeking a highly skilled Senior Data Engineer to lead our team in designing and implementing large-scale data processing systems on Azure.This role offers a hybrid model, with 3 days per week working from our office in Krakow, and 2 days from home office.ResponsibilitiesDesign and...

  • Senior Data Engineer

    4 tygodni temu

    Kraków, Lesser Poland GPC Global Technology Center Pełny etat

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at GPC Global Technology Center. As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines, transforming and structuring data to support business intelligence, analytics, and data science projects.Key...

  • Senior Data Solutions Engineer

    2 tygodni temu

    Kraków, Lesser Poland Tipico Pełny etat

    About the RoleWe are seeking a highly skilled Data Engineer to join our strategic data team at Tipico. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures to support our business operations.Your ResponsibilitiesCreate and maintain batch and real-time data pipelines using ELT and...

  • Cloud Data Architect

    3 tygodni temu

    Kraków, Lesser Poland kdrhumanresourcesconsulting Pełny etat

    Senior Data EngineerAt kdrhumanresourcesconsulting, we are seeking a skilled Senior Data Engineer to design and implement large-scale data processing systems. As a key member of our team, you will lead the development and optimization of complex data pipelines using PySpark and Azure Databricks, ensuring high-quality code and best...

  • Senior Test Automation Engineer III

    3 tygodni temu

    Kraków, Lesser Poland OpenX Pełny etat

    Job Title: Senior Test Automation Engineer IIIAbout the Role:We are seeking a highly skilled Senior Test Automation Engineer III to join our team at OpenX. As a Senior Test Automation Engineer III, you will be responsible for designing, developing, and maintaining automation test suites for our large-scale data processing systems. You will work closely with...

  • Senior Data Engineer

    1 miesiąc temu

    Kraków, Lesser Poland MDPI Pełny etat

    Job Title: Senior Data EngineerMDPI is seeking a highly skilled Senior Data Engineer to join our team. As a key player in our data engineering team, you will play a critical role in designing, developing, and optimizing our data infrastructure.Key Responsibilities:Design and implement data lakes, data warehouses, and ETL/ELT pipelines.Develop and maintain...