Distributed Systems Developer

3 dni temu


Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat

About Us

Axiom Software Solutions Limited is a leading provider of software solutions. We are seeking a highly skilled Data Engineer to join our team.

Job Overview

We are looking for a skilled Data Engineer with expertise in Python, PySpark, and Cloudera to design, develop, and maintain big data pipelines while ensuring efficiency and scalability.

Key Responsibilities

  1. Design and Develop Big Data Pipelines

    Design, develop, and maintain ETL pipelines using Python and PySpark to process large datasets efficiently.

  2. Manage and Process Big Data

    Work with the Cloudera Hadoop ecosystem to manage and process big data.

  3. Ensure Data Integrity and Performance

    Ensure data integrity, performance, and reliability across distributed systems.

  4. Collaborate with Stakeholders

    Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.

  5. Implement Best Practices

    Implement best practices for data governance, security, and performance tuning.

  6. Use Version Control and Task Management Tools

    Use Git and GitHub for version control and efficient code collaboration. Track and manage tasks using Jira, and document processes in Confluence.

  7. Cloud-Based Big Data Processing

    (Optional) Work with Databricks for cloud-based big data processing.

Required Skills & Experience

  • Strong programming skills in Python.
  • Hands-on experience with PySpark for distributed data processing.
  • Expertise in Cloudera Hadoop ecosystem (HDFS, Hive, Impala).
  • Experience with SQL and working with large datasets.
  • Knowledge of Git and GitHub for source code management.
  • Experience with Jira for task tracking and Confluence for documentation.
  • Strong problem-solving and analytical skills.

Preferred Qualifications

  • BASIC KNOWLEDGE OF DATABRICKS FOR CLOUD-BASED BIG DATA SOLUTIONS.
  • EXPERIENCE WITH WORKFLOW ORCHESTRATION TOOLS (E.G., AIRFLOW, OOZIE).
  • UNDERSTANDING OF CLOUD PLATFORMS (AWS, AZURE, OR GCP).
  • EXPOSURE TO KAFKA OR OTHER REAL-TIME STREAMING TECHNOLOGIES.


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    We are looking for a Distributed Systems Specialist to join our team at Amazon.The ideal candidate will have experience working with distributed cloud systems, primarily in Java, and undertaking feasibility studies to design cloud software solutions.About the TeamYou will work with an experienced cross-disciplinary team to bring to market innovative consumer...


  • Warszawa, Mazovia, Polska Rtb House Pełny etat

    We're seeking a skilled system developer to join our team at Rtb House. As a key member of our team, you'll design and implement high-performance system components, ensuring the reliability and scalability of our solutions.About the RoleYou'll work on designing and implementing high-performance modules and componentsYou'll take care of selected technical...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    We're seeking a motivated Distributed Systems Leader to lead our team of engineers in designing and implementing API interfaces using REST or gRPC. As a Distributed Systems Leader, you'll be responsible for guiding the technical direction and strategy for our large-scale cloud services.We're a collaborative team that values diversity in thought and...


  • Warszawa, Mazovia, Polska CloudFerro Sp. z o Pełny etat

    CloudFerro offers innovative cloud data processing services tailored to the European space industry, climate research, and science.Our team boasts extensive experience in managing large-scale data sets, including multi-petabyte Earth observation satellite data repositories. Our solutions are utilized by prominent companies and research institutions across...


  • Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Position OverviewWe are looking for a talented Distributed Data Systems Engineer to join our team. The successful candidate will design and implement scalable distributed data processing systems, leveraging big data technologies and real-time streaming.Main ResponsibilitiesDesign and develop distributed data processing systems for critical applications.Build...


  • Warszawa, Mazovia, Polska NTIATIVE IT Recruitment Pełny etat

    About NTIATIVE IT RecruitmentWe specialize in IT recruitment services for the financial sector, committed to delivering exceptional results through our expertise.This role for a Distributed System Developer - Financial Risk is an essential part of our team, requiring a highly skilled professional to join our efforts in risk management.You will be responsible...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    Execution Systems Developer – JavaRole OverviewWe are seeking an experienced Distributed System Engineer - Java to join our team. As a key member of our Execution Technology team, you will be responsible for designing and implementing high-performance trading system components in a distributed architecture.Key ResponsibilitiesCollaborate with senior...


  • Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    Dear Consultant, we are excited to present an opportunity with our multinational client, a leader in the payment sector.This is a remote B2B position based in Poland. If your skills align with the requirements below, please proceed with sending your CV.About Our ClientA renowned company in the payment sector seeks a skilled Fullstack Developer to join their...


  • Warszawa, Mazovia, Polska Google Pełny etat

    About the RoleAs a Senior Software Engineer on Google Cloud's Site Reliability Engineering (SRE) team, you will be part of a unique blend of software and systems engineering to design, build, and maintain large-scale, fault-tolerant systems.We are looking for experts in software development, data structures, algorithms, and distributed systems who can lead...


  • Warszawa, Mazovia, Polska BIURO DORADCZE Pełny etat

    Distributed System MaintenanceThe ideal candidate will manage day-to-day operations, such as monitoring, backup, performance tuning, and failure handling of a distributed system.This includes tracking the system status and resource usage, estimating trends, and making plans to ensure high availability and growth needs of our customers.


  • Warszawa, Mazovia, Polska Paymentology Pełny etat

    Are you passionate about optimizing infrastructure, automating processes, and delivering exceptional availability and performance?About PaymentologyAs a pioneer in the payments industry, we provide a cutting-edge platform that enables banks and fintechs to issue and process cards across more than 60 countries.Our platform allows customers to process...


  • Warszawa, Mazovia, Polska Turnitin, LLC Pełny etat

    Key ResponsibilitiesLead and design the development and optimization of scalable backend services using Java and serverless architectures.Architect and implement RESTful APIs and event-driven systems to support high-performance distributed applications.Provide technical leadership and guidance to the team on architectural standards and best practices.The...


  • Warszawa, Mazovia, Polska OODI PROSTA S.A. Pełny etat

    Career OpportunityWe are looking for a skilled Senior/Mid Full Stack Developer to join our team at OODI PROSTA S.A. As a member of our team, you will play a key role in designing and implementing scalable, cloud-based solutions using .NET, C#, and other cutting-edge technologies. You will collaborate with cross-functional teams to deliver innovative...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    Execution Systems Developer – JavaAbout UsTN Poland is a leading provider of innovative financial technologies.Job DescriptionWe are seeking an experienced Financial Systems Architect to join our team. As a key member of our Execution Technology team, you will be responsible for designing and implementing high-performance trading system components in a...


  • Warszawa, Mazovia, Polska Starburst Pełny etat

    At Starburst, we are working to dismantle the status quo of data silos and vendor lock-in every single day. For decades, database companies have held their customers hostage and we believe that's just plain wrong. Starburst offers a full-featured data lake analytics platform, built on open-source Trino. Our platform includes all the capabilities needed to...


  • Warszawa, Mazovia, Polska Unit8 SA Pełny etat

    Your RoleYou will be responsible for designing, building, maintaining, and troubleshooting data pipelines and processing systems relied on for both production and analytics applications. You will use a variety of open-source and closed-source technologies. You will help drive optimization, testing, and tooling to improve data quality. You will collaborate...


  • Warszawa, Mazovia, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    Job DescriptionAs a Distributed Data Engineer, you will be responsible for designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from various sources. You will work on GCP-based infrastructure to ensure scalability and reliability.RequirementsOver 5 years of experience in...


  • Warszawa, Mazovia, Polska Asana Pełny etat

    Design and Build Scalable Storage InfrastructureAs a senior software engineer at Asana, you will work with a world-class team to build software-driven reliability for our online storage infrastructure. We're looking for big thinkers and innovators to take on complex engineering systems and deliver elegant solutions.We're committed to building teams that...

  • Distributed Systems Manager

    1 tydzień temu


    Warszawa, Mazovia, Polska Visa Inc. Pełny etat

    Join us at Visa Inc. as a Senior Software Engineering Manager and take on a challenging role that requires a versatile, curious, and energetic individual who can lead a team of engineers in developing high-performing systems.About the RoleYou will be responsible for system development, implementation, maintenance, support, tools, and automation of Visa's...


  • Warszawa, Mazovia, Polska Google Pełny etat

    Job ResponsibilitiesCollaborate with GCP service teams to support their Cloud asset needs.Interact with GCP customers and support their compliance auditing detection needs.Build scalable reliable systems used by teams in GCP as well as GCP customers.