Aktualne oferty pracy związane z Big Data Pipeline Specialist - Warszawa, Mazovia - Axiom Software Solutions Limited

  • Data Pipeline Specialist

    17 godzin temu

    Warszawa, Mazovia, Polska Point Wild (Formerly Pango Group) Pełny etat

    Job Overview:We are Point Wild, a leading cybersecurity solutions provider backed by top investors.We are looking for a seasoned Data Pipeline Specialist to help us build and maintain robust data pipelines that fuel our AI-driven products.Responsibilities:Design and develop scalable data pipelines using ETL/ELT technologies.Work closely with AI engineers to...

  • Big Data Engineer Leader

    6 dni temu

    Warszawa, Mazovia, Polska Tietoevry Pełny etat

    We are seeking a highly skilled Big Data Engineer Leader to join our team. In this role, you will lead the development and maintenance of ETL/ELT pipelines using Python and SQL, as well as working with Hadoop, Spark, and Big Data technologies for large-scale data processing.The ideal candidate will have 4+ years' experience with database technologies,...

  • Big Data Developer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Sii Polska Pełny etat

    Join a new team of Engineers at one of the largest financial institutions in the world as a Big Data Specialist. You will work in the area of traded risk on a strategic project to deliver a strategic aggregation platform for Risk managers and utilize a new vendor product in a cloud and on-premises hybrid environment.- At least 5 years of experience as a...

  • Cloud Native Data Pipeline Developer

    7 dni temu

    Warszawa, Mazovia, Polska Cubestech Ltd Pełny etat

    Cubestech Ltd is looking for a Big Data Engineering Expert to join our team. As a Senior Data Engineering Specialist, you will be responsible for designing and implementing scalable data pipelines using Hadoop and Spark. Your expertise in big data engineering will help us build a robust and efficient data architecture.Job RequirementsDesign and develop...

  • Big Data Technology Lead

    5 dni temu

    Warszawa, Mazovia, Polska Rutkowski Pełny etat

    Rutkowski is seeking a highly skilled Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the infrastructure required to analyze large data sets. Our ideal candidate has strong experience with big data technologies, such as Spark, Hadoop, and NoSQL databases.Key Responsibilities:Closely...

  • Big Data Processing Expert

    5 godzin temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Job DescriptionGrid Dynamics International, Inc. is a leading provider of technology consulting and platform engineering services. We seek a highly skilled Big Data Engineer to join our team and contribute to building critical risk and fraud detection applications.Essential FunctionsDesign, develop, and implement high-availability, low-latency, and strongly...

  • Big Data Scientist and Software Engineer

    7 dni temu

    Warszawa, Mazovia, Polska Tietoevry Pełny etat

    Technical RequirementsWe are seeking a highly skilled Senior Software Engineer-Machine Learning Engineer/Data Engineer to join our team in Warsaw. As a senior engineer, you will play a crucial role in designing, developing, and deploying machine learning models using Python frameworks.Develop and maintain ETL/ELT pipelines using Python and SQLWork with...

  • Big Data Engineering Expert

    7 dni temu

    Warszawa, Mazovia, Polska Cubestech Ltd Pełny etat

    We are seeking a Senior Data Engineering Specialist to join our team at Cubestech Ltd. As a Senior Data Engineering Specialist, you will design and implement scalable data pipelines using AWS services such as S3, Lambda, and Glue. Your expertise in cloud-based data engineering will help us build a robust and efficient data architecture.Job DescriptionDesign...

  • Big Data

    3 dni temu

    Warszawa, Mazovia, Polska ITMAGINATION Sp. z o. o. Pełny etat

    We're hiring a Big Data & Cloud Developer (Hybrid work from Warsaw, Poland) at ITMAGINATION, join our team of 400+ developers, analysts and testers ITMAGINATION helps its Clients by becoming a true extension of their software and data development capabilities. Through the readily set up, comprehensive, and self-governing teams, we let our Clients focus on...

  • Data Pipeline Architect

    8 godzin temu

    Warszawa, Mazovia, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    Job SummaryWe are seeking an experienced Data Engineer to join our team at Square One Resources sp. z o.o. This is an excellent opportunity for a professional looking to work on challenging projects and enhance their skills in Big Data or Machine Learning.The ideal candidate will design and implement efficient data pipelines, develop and deploy machine...

  • Big Data Engineer

    7 dni temu

    Warszawa, Mazovia, Polska Capgemini Pełny etat

    Capgemini is seeking a talented Big Data Engineer to join our team. As a Big Data Engineer, you will design, implement, and maintain big data platforms, data architecture, and design techniques to work with large data sets. You will be empowered to shape your career in the way you'd like and supported by a collaborative community of colleagues around the...

  • Data Pipeline Engineer Leader

    7 dni temu

    Warszawa, Mazovia, Polska Capgemini Pełny etat

    We are seeking a highly skilled Data Pipeline Engineer Leader to join our team at Capgemini. As a seasoned expert in data engineering, you will be responsible for architecting, developing, and maintaining scalable data pipelines on Microsoft Azure.About the RoleWith 4+ years of experience in data engineering, you will lead the design and implementation of...

  • Big Data Engineering Manager

    7 dni temu

    Warszawa, Mazovia, Polska Cyclad Pełny etat

    Key ResponsibilitiesThe successful candidate will have the following responsibilities:Oversee the design and development of data engineering solutions, ensuring quality and efficiency.Lead the development and implementation of data governance strategies, including data quality, master data management, data cataloging, and lineage.Represent Cyclad as a...

  • Enterprise Data Pipeline Architect

    3 dni temu

    Warszawa, Mazovia, Polska Skandinaviska Enskilda Banken AB Pełny etat

    Key ResponsibilitiesData Pipeline Design and Implementation: Designing, implementing, and maintaining scalable data pipelines to ensure seamless data flow.Collaboration and Communication: Working closely with developers, architects, and stakeholders to define process implementation design, provide work estimates, and timely updates on solution development...

  • Big Data Developer

    4 tygodni temu

    Warszawa, Mazovia, Polska Sii Sp. z o.o. Pełny etat

    Big Data DeveloperMiejsce pracy: WarszawaTechnologies we useExpected- Java- Spark- Google Cloud PlatformOptional- ScalaAbout the projectJoin a new team of Engineers at one of the largest financial institutions in the world as a Big Data Specialist. You will work in the area of traded risk on a strategic project to deliver a strategic aggregation platform for...

  • Big Data Professional

    4 dni temu

    Warszawa, Mazovia, Polska Atos SE Pełny etat

    Role OverviewWe are seeking an experienced Software/Data Engineer to join our team for a significant project with a prominent German client in the energy sector. The ideal candidate will have a strong background in data engineering and cloud solutions, with hands-on experience in big data architectures and Kubernetes.Your Key AccountabilitiesDevelop and...

  • Big Data Specialist

    4 dni temu

    Warszawa, Mazovia, Polska KBC Technologies Group Pełny etat

    Join our team as a skilled Senior Backend Spark Developer at KBC Technologies Group and take on the challenge of leading the development of new software products and enhancing existing ones.About the JobDesign and develop end-to-end ETL processes with Spark/Scala, transferring data from/to the data lake, conducting technical validations, implementing...

  • Big Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska Atos Pełny etat

    We are currently seeking a skilled Software/Data Engineer to join our project for a German client in the energy sector.About the ProjectWe are working on cutting-edge data solutions using advanced technologies like Kubernetes, DataMesh, and ETL processes.The successful candidate will be responsible for designing and implementing robust data architectures and...

  • Big Data Solutions Expert

    6 dni temu

    Warszawa, Mazovia, Polska Scalac Pełny etat

    Company OverviewScalac is a leading provider of big data solutions, dedicated to helping organizations unlock the full potential of their data. Our team of expert engineers and developers works closely with clients to design, implement, and maintain scalable data systems that meet their unique needs.We pride ourselves on our commitment to innovation,...

  • Hadoop Big Data Administrator/Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Capco Poland Pełny etat

    *We are looking for Poland based candidate.  Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a...

Big Data Pipeline Specialist

2 tygodni temu

Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat

Job Summary

Axiom Software Solutions Limited seeks a skilled Data Engineer to design, develop, and maintain big data pipelines using Python and PySpark.

Responsibilities

  • Develop and maintain ETL pipelines using Python and PySpark to process large datasets efficiently.
  • Work with the Cloudera Hadoop ecosystem to manage and process big data.
  • Ensure data integrity, performance, and reliability across distributed systems.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
  • Implement best practices for data governance, security, and performance tuning.
  • Use Git and GitHub for version control and efficient code collaboration.
  • Track and manage tasks using Jira, and document processes in Confluence.
  • (Optional) Work with Databricks for cloud-based big data processing.

Requirements

  • Strong programming skills in Python.
  • Hands-on experience with PySpark for distributed data processing.
  • Expertise in Cloudera Hadoop ecosystem (HDFS, Hive, Impala).
  • Experience with SQL and working with large datasets.
  • Knowledge of Git and GitHub for source code management.
  • Experience with Jira for task tracking and Confluence for documentation.
  • Strong problem-solving and analytical skills.