Senior Big Data Engineer

4 tygodni temu

Warszawa, Polska Grid Dynamics Poland Pełny etat

We are seeking a highly skilled Big Data Engineer with a strong background in data engineering, real-time streaming, and large-scale distributed data processing. The engineer will be a part of the team responsible for building critical risk and fraud detection applications. The ideal candidate will have expertise in big data technologies, real-time data pipelines, and experience developing solutions that enhance fraud prevention and risk mitigation in the payments domain.

Responsibilities:

  • Design, develop, and implement scalable batch and real-time data processing systems for fraud detection and risk mitigation.
  • Build and optimize real-time streaming data pipelines using Kafka, Spark Streaming, ELK, and related technologies.
  • Develop ETL/ELT pipelines, including data quality checks, anomaly detection, and notification systems.
  • Work with Hadoop, MapReduce, Hive, Spark, NoSQL, and relational databases (e.g., MySQL) to create data-driven solutions.
  • Architect high-availability, low-latency, and strongly consistent distributed data processing systems.
  • Collaborate with cross-functional teams to create fraud prevention and risk detection solutions that add business value.
  • Follow Agile development methodologies, incorporating CI/CD best practices for continuous integration and delivery.
  • Present complex data-driven insights in a clear and concise manner.

Requirements:

  • Proven experience in big data engineering and data-driven business solutions.
  • Strong background in Hadoop, Spark, MapReduce, Hive, and NoSQL databases.
  • Hands-on experience in real-time data streaming using Kafka, Spark Streaming, and ELK.
  • Expertise in ETL/ELT pipeline development, data quality checks, and anomaly detection.
  • Experience building distributed data processing systems with high availability and low latency.
  • Proficiency in Java or Python for data engineering and application development.
  • Familiarity with Agile methodologies, CI/CD, and best development practices.
  • Strong communication skills and ability to present complex ideas clearly.

We offer:

  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Professional development opportunities
  • Well-equipped office

About us:

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

Collapse

  • Senior Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Visa Inc. Pełny etat

    We are seeking a highly skilled Senior Big Data Engineer to join our team at Visa. As a key member of our data engineering group, you will be responsible for architecting and implementing large-scale data processing systems that meet the needs of our business stakeholders.Your expertise in big data technologies, programming languages like Java and Python,...

  • Lead Big Data Engineer

    1 dzień temu

    Warszawa, Mazovia, Polska Allegro Pełny etat

    The Brand-First Analytics team at Allegro is seeking a highly skilled Lead Big Data Engineer to join our team. As a Lead Big Data Engineer, you will play a key role in shaping the future of e-commerce by offering cutting-edge technologies and an exceptional environment for professional growth.Your primary responsibility will be to design, manage, and improve...

  • Big Data Engineer Lead

    2 dni temu

    Warszawa, Mazovia, Polska Addepto Pełny etat

    **About the Role:**We are looking for a talented Senior Data Engineer to lead our big data initiatives at Addepto. As a key member of our AI and Big Data team, you will be responsible for designing and implementing universal data platforms on Azure and Databricks for global aerospace companies.**Responsibilities:**Design and development of universal data...

  • Big Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team at TN Poland.The successful candidate will be responsible for designing and implementing efficient data pipelines, collaborating with cross-functional teams, and staying up-to-date with industry advancements.Key Responsibilities:Design and implement complex data pipelines...

  • Senior Big Data Professional

    5 dni temu

    Warszawa, Mazovia, Polska instinctools EE Labs Pełny etat

    Job TitleSenior Data EngineerJob SummaryWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing and implementing scalable data processing systems using Databricks, SQL, and Spark. Additionally, you will work on building and optimizing data pipelines, ensuring the quality and efficiency...

  • Big Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska EndySoft Pełny etat

    Big Data Engineer Miejsce pracy: Warszawa Technologies we use Expected Apache Spark Hadoop Kafka Flink Python Scala Java SQL PostgreSQL MongoDB Cassandra AWS Microsoft Azure Google Cloud Platform Apache Airflow Docker Kubernetes Optional Apache Kafka Streams Kinesis Pulsar Microsoft Power BI Tableau Looker Operating system Windows About the project We are...

  • Senior Big Data

    6 dni temu

    Warszawa, Mazovia, Polska Grid Dynamics Poland Pełny etat

    Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets. We are looking for an experienced Big Data Engineer. Design and Develop...

  • Senior Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.We are looking for an experienced Big Data Engineer.Essential...

  • Big Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska B2B S.A. Pełny etat

    We are looking for an experienced Big Data Engineer to join our team at B2B S.A.As a key member of our organization, you will be responsible for designing and implementing advanced Machine Learning models and data processing workflows in close collaboration with other company departments.Our team works on developing advanced Big Data and Machine Learning...

  • Big Data Solutions Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Management Solutions, SL Pełny etat

    About the RoleWe are looking for a skilled Big Data Solutions Engineer to join our team at Management Solutions. As a key member of our organisation, you will be responsible for designing and implementing Big Data solutions for our clients.Key ResponsibilitiesDesign and implement Big Data architectures.Develop Big Data solutions using specialist...

  • Big Data Engineer Leader

    4 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    About the RoleWe are seeking an experienced Senior Data Engineer to join our team at TN Poland. As a key member of our Data Engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems that meet the needs of our clients.Your main responsibilities will include designing and optimizing data pipelines,...

  • Senior Big Data Specialist

    2 tygodni temu

    Warszawa, Mazovia, Polska Cubestech Ltd Pełny etat

    We are seeking a Senior Big Data Specialist to lead our big data initiatives. As a key member of our team, you will design, develop, and maintain large-scale data processing systems using AWS services.About the RoleLead the development and implementation of big data solutions using AWS servicesWork closely with cross-functional teams to identify business...

  • Senior Big Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.We are looking for an experienced Big Data Engineer.Essential...

  • Senior Big Data Professional

    5 dni temu

    Warszawa, Mazovia, Polska KBC Technologies Group Pełny etat

    We are seeking an Experienced Databricks Engineer to join our team at KBC Technologies Group.Job Description:The successful candidate will be responsible for leading the design and implementation of large-scale data processing architectures on the Databricks Lakehouse Platform. This role requires a strong background in big data engineering and experience...

  • Big Data Solutions Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Infosys Limited Pełny etat

    We are looking for a highly skilled Big Data Solutions Engineer to join our team at Infosys Limited. As a key member of our data engineering team, you will be responsible for designing and implementing big data solutions that meet the needs of our clients.The ideal candidate will have a strong background in designing and implementing big data architectures,...

  • Big Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska N-iX Pełny etat

    We are looking for a Middle Strong Data Engineer with strong expertise in Python and PySpark to join our team. This role is ideal for someone who thrives in designing and implementing robust data solutions in the cloud, with a focus on Azure ecosystems and modern data engineering practices. You'll work on challenging projects, building and...

  • Big Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska B2B S.A. Pełny etat

    Job Title: Big Data Engineer - Junior">Description:">B2B S.A. is seeking a highly motivated and detail-oriented Junior Big Data Engineer to join our team.">This role offers the opportunity to work on challenging projects and collaborate with experienced professionals.">Key Responsibilities:">Design, implement, and maintain large-scale data processing...

  • Senior Big Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.We are looking for an experienced Big Data Engineer.Essential...

  • Unlock Big Data Potential as a Senior Engineer

    4 dni temu

    Warszawa, Polska Grid Dynamics Poland Pełny etat

    At Grid Dynamics Poland, we are at the forefront of developing high-performance data analytics platforms that handle massive datasets.We are seeking an experienced Senior Big Data Engineer to join our team and contribute to this cutting-edge project.Key Responsibilities:Design and Develop Big Data Solutions that drive business value and meet performance...

  • mid/senior big data engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Capco Pełny etat

    CAPCO POLAND*We are looking for Poland based candidate.Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as...