Distributed Systems Developer
3 dni temu
About Us
Axiom Software Solutions Limited is a leading provider of software solutions. We are seeking a highly skilled Data Engineer to join our team.
Job Overview
We are looking for a skilled Data Engineer with expertise in Python, PySpark, and Cloudera to design, develop, and maintain big data pipelines while ensuring efficiency and scalability.
Key Responsibilities
Design and Develop Big Data Pipelines
Design, develop, and maintain ETL pipelines using Python and PySpark to process large datasets efficiently.
Manage and Process Big Data
Work with the Cloudera Hadoop ecosystem to manage and process big data.
Ensure Data Integrity and Performance
Ensure data integrity, performance, and reliability across distributed systems.
Collaborate with Stakeholders
Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
Implement Best Practices
Implement best practices for data governance, security, and performance tuning.
Use Version Control and Task Management Tools
Use Git and GitHub for version control and efficient code collaboration. Track and manage tasks using Jira, and document processes in Confluence.
Cloud-Based Big Data Processing
(Optional) Work with Databricks for cloud-based big data processing.
Required Skills & Experience
- Strong programming skills in Python.
- Hands-on experience with PySpark for distributed data processing.
- Expertise in Cloudera Hadoop ecosystem (HDFS, Hive, Impala).
- Experience with SQL and working with large datasets.
- Knowledge of Git and GitHub for source code management.
- Experience with Jira for task tracking and Confluence for documentation.
- Strong problem-solving and analytical skills.
Preferred Qualifications
- BASIC KNOWLEDGE OF DATABRICKS FOR CLOUD-BASED BIG DATA SOLUTIONS.
- EXPERIENCE WITH WORKFLOW ORCHESTRATION TOOLS (E.G., AIRFLOW, OOZIE).
- UNDERSTANDING OF CLOUD PLATFORMS (AWS, AZURE, OR GCP).
- EXPOSURE TO KAFKA OR OTHER REAL-TIME STREAMING TECHNOLOGIES.
-
Distributed Systems Specialist
2 dni temu
Warszawa, Mazovia, Polska TN Poland Pełny etatWe are looking for a Distributed Systems Specialist to join our team at Amazon.The ideal candidate will have experience working with distributed cloud systems, primarily in Java, and undertaking feasibility studies to design cloud software solutions.About the TeamYou will work with an experienced cross-disciplinary team to bring to market innovative consumer...
-
Distributed Systems Engineering Leader
6 dni temu
Warszawa, Mazovia, Polska Rtb House Pełny etatWe're seeking a skilled system developer to join our team at Rtb House. As a key member of our team, you'll design and implement high-performance system components, ensuring the reliability and scalability of our solutions.About the RoleYou'll work on designing and implementing high-performance modules and componentsYou'll take care of selected technical...
-
Distributed Systems Leader
3 dni temu
Warszawa, Mazovia, Polska TN Poland Pełny etatWe're seeking a motivated Distributed Systems Leader to lead our team of engineers in designing and implementing API interfaces using REST or gRPC. As a Distributed Systems Leader, you'll be responsible for guiding the technical direction and strategy for our large-scale cloud services.We're a collaborative team that values diversity in thought and...
-
Distributed Systems Developer Role
6 dni temu
Warszawa, Mazovia, Polska CloudFerro Sp. z o Pełny etatCloudFerro offers innovative cloud data processing services tailored to the European space industry, climate research, and science.Our team boasts extensive experience in managing large-scale data sets, including multi-petabyte Earth observation satellite data repositories. Our solutions are utilized by prominent companies and research institutions across...
-
Distributed Data Systems Engineer
7 dni temu
Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etatPosition OverviewWe are looking for a talented Distributed Data Systems Engineer to join our team. The successful candidate will design and implement scalable distributed data processing systems, leveraging big data technologies and real-time streaming.Main ResponsibilitiesDesign and develop distributed data processing systems for critical applications.Build...
-
Distributed System Developer
3 dni temu
Warszawa, Mazovia, Polska NTIATIVE IT Recruitment Pełny etatAbout NTIATIVE IT RecruitmentWe specialize in IT recruitment services for the financial sector, committed to delivering exceptional results through our expertise.This role for a Distributed System Developer - Financial Risk is an essential part of our team, requiring a highly skilled professional to join our efforts in risk management.You will be responsible...
-
Distributed System Engineer
6 dni temu
Warszawa, Mazovia, Polska TN Poland Pełny etatExecution Systems Developer – JavaRole OverviewWe are seeking an experienced Distributed System Engineer - Java to join our team. As a key member of our Execution Technology team, you will be responsible for designing and implementing high-performance trading system components in a distributed architecture.Key ResponsibilitiesCollaborate with senior...
-
Senior Backend Developer for Distributed Systems
1 dzień temu
Warszawa, Mazovia, Polska DCV Technologies Pełny etatDear Consultant, we are excited to present an opportunity with our multinational client, a leader in the payment sector.This is a remote B2B position based in Poland. If your skills align with the requirements below, please proceed with sending your CV.About Our ClientA renowned company in the payment sector seeks a skilled Fullstack Developer to join their...
-
Warszawa, Mazovia, Polska Google Pełny etatAbout the RoleAs a Senior Software Engineer on Google Cloud's Site Reliability Engineering (SRE) team, you will be part of a unique blend of software and systems engineering to design, build, and maintain large-scale, fault-tolerant systems.We are looking for experts in software development, data structures, algorithms, and distributed systems who can lead...
-
Distributed Systems Reliability Expert
6 dni temu
Warszawa, Mazovia, Polska BIURO DORADCZE Pełny etatDistributed System MaintenanceThe ideal candidate will manage day-to-day operations, such as monitoring, backup, performance tuning, and failure handling of a distributed system.This includes tracking the system status and resource usage, estimating trends, and making plans to ensure high availability and growth needs of our customers.
-
Distributed Systems Expert
6 dni temu
Warszawa, Mazovia, Polska Paymentology Pełny etatAre you passionate about optimizing infrastructure, automating processes, and delivering exceptional availability and performance?About PaymentologyAs a pioneer in the payments industry, we provide a cutting-edge platform that enables banks and fintechs to issue and process cards across more than 60 countries.Our platform allows customers to process...
-
Warszawa, Mazovia, Polska Turnitin, LLC Pełny etatKey ResponsibilitiesLead and design the development and optimization of scalable backend services using Java and serverless architectures.Architect and implement RESTful APIs and event-driven systems to support high-performance distributed applications.Provide technical leadership and guidance to the team on architectural standards and best practices.The...
-
Warszawa, Mazovia, Polska OODI PROSTA S.A. Pełny etatCareer OpportunityWe are looking for a skilled Senior/Mid Full Stack Developer to join our team at OODI PROSTA S.A. As a member of our team, you will play a key role in designing and implementing scalable, cloud-based solutions using .NET, C#, and other cutting-edge technologies. You will collaborate with cross-functional teams to deliver innovative...
-
Financial Systems Architect
6 dni temu
Warszawa, Mazovia, Polska TN Poland Pełny etatExecution Systems Developer – JavaAbout UsTN Poland is a leading provider of innovative financial technologies.Job DescriptionWe are seeking an experienced Financial Systems Architect to join our team. As a key member of our Execution Technology team, you will be responsible for designing and implementing high-performance trading system components in a...
-
Staff Software Engineer Java Distributed Systems
2 tygodni temu
Warszawa, Mazovia, Polska Starburst Pełny etatAt Starburst, we are working to dismantle the status quo of data silos and vendor lock-in every single day. For decades, database companies have held their customers hostage and we believe that's just plain wrong. Starburst offers a full-featured data lake analytics platform, built on open-source Trino. Our platform includes all the capabilities needed to...
-
Warszawa, Mazovia, Polska Unit8 SA Pełny etatYour RoleYou will be responsible for designing, building, maintaining, and troubleshooting data pipelines and processing systems relied on for both production and analytics applications. You will use a variety of open-source and closed-source technologies. You will help drive optimization, testing, and tooling to improve data quality. You will collaborate...
-
Distributed Data Engineer
6 dni temu
Warszawa, Mazovia, Polska ACAISOFT POLAND Sp. z o.o. Pełny etatJob DescriptionAs a Distributed Data Engineer, you will be responsible for designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from various sources. You will work on GCP-based infrastructure to ensure scalability and reliability.RequirementsOver 5 years of experience in...
-
Warszawa, Mazovia, Polska Asana Pełny etatDesign and Build Scalable Storage InfrastructureAs a senior software engineer at Asana, you will work with a world-class team to build software-driven reliability for our online storage infrastructure. We're looking for big thinkers and innovators to take on complex engineering systems and deliver elegant solutions.We're committed to building teams that...
-
Distributed Systems Manager
1 tydzień temu
Warszawa, Mazovia, Polska Visa Inc. Pełny etatJoin us at Visa Inc. as a Senior Software Engineering Manager and take on a challenging role that requires a versatile, curious, and energetic individual who can lead a team of engineers in developing high-performing systems.About the RoleYou will be responsible for system development, implementation, maintenance, support, tools, and automation of Visa's...
-
Software Developer for Distributed Systems
4 dni temu
Warszawa, Mazovia, Polska Google Pełny etatJob ResponsibilitiesCollaborate with GCP service teams to support their Cloud asset needs.Interact with GCP customers and support their compliance auditing detection needs.Build scalable reliable systems used by teams in GCP as well as GCP customers.