Distributed Data Processing Specialist

5 dni temu


Warszawa, Mazovia, Polska brabers Pełny etat
Job Description

As a Lead Data Engineer/Developer at Brabers, you will be responsible for designing and developing distributed data processing pipelines using Spark and Scala. Your expertise in Linux, Python, and Hadoop will be invaluable in ensuring the seamless operation of our data systems.

Key responsibilities include:

  • Building and maintaining large-scale data pipelines using Spark and Scala
  • Leveraging Python for data enrichment and transformation
  • Collaborating with analysts and business stakeholders to develop analytics models
  • Working closely with the QA team to ensure data quality and reliability


  • Warszawa, Mazovia, Polska Pragmile Pełny etat

    Achieve Operational Excellence with Pragmile">Solar Spy is an analytical platform dedicated to supporting the efficient operation of solar farms, aiming to maximize green energy production and reduce operational and maintenance costs.">We process various types of data, including image data from aerial inspections, weather data, and data from photovoltaic...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    Role HighlightsThis is an exciting opportunity to work in a dynamic environment and contribute to the growth of our company. As a Senior Software Engineer, you will have the chance to:* Develop and implement real-time distributed processing systems and event processing architecture.* Partner with global technology and business teams to develop and implement...


  • Warszawa, Mazovia, Polska Pragmile Pełny etat

    Company Overview">Solar Spy is an analytical platform dedicated to supporting solar farm operations.">We process various types of PV plant data, including image data from aerial inspections, weather data, and data from photovoltaic installation infrastructure elements.">Our main objective is to maximize green energy production and reduce O&M costs.">Job...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    We are looking for a skilled Big Data Processing Expert to join our team. In this position, you will be responsible for working with Scala and Spark to define and maintain data transformation processes. You will collaborate closely with DevOps, QA, and Product Management teams to ensure seamless integration and provide detailed progress updates during demo...


  • Warszawa, Mazovia, Polska PAYBACK Pełny etat

    The role of the Real-Time Data Processing Engineer involves developing scalable software solutions that utilize modern data streaming technologies. This position requires expertise in Java, Spring Boot, and relevant frameworks. The engineer will be responsible for building and maintaining robust data pipelines, integrating with various systems, and...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    We are looking for a skilled Data Engineer to join our team at TN Poland. The ideal candidate will have experience in building distributed processing pipelines using Big Data technologies, such as Hadoop and Spark.Key Responsibilities:Design and implement scalable data processing architectures that can handle massive amounts of structured and unstructured...

  • Big Data Processing Expert

    1 tydzień temu


    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Job DescriptionGrid Dynamics International, Inc. is a leading provider of technology consulting and platform engineering services. We seek a highly skilled Big Data Engineer to join our team and contribute to building critical risk and fraud detection applications.Essential FunctionsDesign, develop, and implement high-availability, low-latency, and strongly...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    Data Processing Specialist delivers one of the processes necessary to create a database or report for our clients (top FMCG companies and retailers). The processes include validating the data, setting up the database, coding products by providing characteristics and managing data samples.ResponsibilitiesConducting processes that lead to a creation of a...

  • Data Insights Specialist

    1 tydzień temu


    Warszawa, Mazovia, Polska Ascendion Pełny etat

    About Us:Ascendion is a global leading provider of AI-first software engineering services, delivering transformative solutions across various regions. We combine technology and talent to drive digital journeys with efficiency and velocity.Job Overview:We are seeking a skilled Data Insights Specialist to work on numerous challenging projects, leveraging...


  • Warszawa, Mazovia, Polska Google Pełny etat

    About the RoleWe're looking for a talented individual to join our SRE team as a Large Scale Distributed Systems Specialist. In this role, you'll work on designing, analyzing, and troubleshooting large-scale distributed systems.You'll also have the opportunity to lead projects and provide technical leadership. If you have experience with data structures or...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    We are looking for a talented Data Transformation Specialist who will play a key role in working with Scala and Spark to define and maintain data transformation processes. This expert will collaborate closely with DevOps, QA, and Product Management teams and provide detailed progress updates during demo sessions.Key Responsibilities:Working with Scala and...


  • Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Job OverviewThis role offers the chance to be part of a highly motivated and dedicated team working on critical risk and fraud detection applications.Main ResponsibilitiesArchitect high-availability, low-latency, and strongly consistent distributed data processing systems.Work with Hadoop, MapReduce, Hive, Spark, NoSQL, and relational databases (e.g., MySQL)...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About UsData Science UA is a company that specializes in providing data science and AI services to its clients. Our mission is to help businesses make informed decisions by leveraging the power of data and artificial intelligence. With a strong focus on innovation and customer satisfaction, we strive to be the go-to partner for organizations seeking to...


  • Warszawa, Mazovia, Polska EcoVadis Pełny etat

    Key ResponsibilitiesDesign and implement data processing pipelines using distributed data processing engines.Develop and maintain data serving layer, manage permissions, and automate processes around data catalog.Integrate with internal and external data sources.Support BI and business in efficient data modeling.Cross-functional cooperation with data...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    Job OverviewData Science UA is a leading provider of data science and AI services. We are looking for a skilled Data Engineer to join our team and contribute to delivering innovative solutions for our clients. The ideal candidate will have commercial experience in developing Spark Jobs using Scala and Java, as well as experience in data processing using...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the CompanyData Science UA is a service company with strong data science and AI expertise. Our journey began with organizing the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have fostered the largest Data Science Community in Eastern Europe.We work with market-leading intelligence platforms for paid...


  • Warszawa, Mazovia, Polska Luxoft Poland Pełny etat

    The Luxoft Poland company is seeking a senior Java specialist to work on market data solutions. As a member of the FICC Technology Team, you will be responsible for building a Next Generation Market Data Plant that ingests, collects, and disseminates market data with minimal latency.Responsibilities:Designing and implementing large-scale solutionsEnsuring...


  • Warszawa, Mazovia, Polska Sii Sp. z o.o. Pełny etat

    Data Management Specialist:We are seeking a Senior Data Management Specialist to join our team at Sii Sp. z o.o. As a leader in cloud technologies, we need someone with expertise in Google Cloud Platform (GCP) to manage our data solutions team and create high-quality products that deliver accessible data.The ideal candidate will have experience managing...


  • Warszawa, Mazovia, Polska Tetra Pak Pełny etat

    We are looking for a highly skilled Senior Dairy Processing Specialist to join our team and drive the development of our dairy processing solutions.In this role, you will be responsible for designing and implementing efficient and effective dairy processing systems that meet our customers' needs.As a key member of our team, you will work closely with our...