Python Engineer with Big Data

2 miesięcy temu


Warszawa, Polska R Systems Pełny etat
Job Responsibilities:
  • Design, develop, and launch strategic data mining solutions, driving business-wide innovation utilizing AI and analytical techniques at scale.
  • Take full ownership of the end-to-end software development lifecycle, encompassing design, testing, deployment, and operations, engage in technical discussions and strategy, and participate hands-on in design reviews, code reviews, and implementation.
  • Participate in the development of highly scalable platforms for extracting, analyzing, and processing large amounts of contextual data from a plethora of sources, both in real-time and in batch modes.
  • Develop large-scale knowledge graphs through semantically linking information and datasets from across multiple product and technical domains.  
  • Uphold the highest standards of technical rigor in engineering and operational excellence, build highly resilient and scalable systems, and champion operational and process improvements.
  • Craft high-performance, production-ready machine learning code for our next-generation real-time ML platform. Extend existing ML libraries and frameworks.
  • Working closely with other engineers and scientists, develop solutions to accelerate model development, validation, and experimentation cycles, and integrate models and algorithms in production systems at a very large scale.

Basic Qualifications:
  • Degree in mathematics/computer science or related discipline.
  • 3+ years of experience in the complete software development lifecycle including design, coding, code reviews, testing, build processes, deployments, and operations.
  • 3+ years of experience in Python.
  • Required one of these 3 skills setups:  
    • Spark, + Py Spark + S3, + Parquet 
    • Spark + Py Spark + Docker + Kubernetes   
    • Microservices + Flask +Fast API 
  • Experience working with distributed and big data technologies and ML technologies (e.g. MapReduce, Spark, Flink, Kafka, PySpark, NoSQL, etc.).

Preferred Qualifications:
  • MS or PhD in Computer Science or equivalent experience.
  • Experience working with large-scale distributed systems, preferably on cloud platforms (e.g., AWS, Azure, Google Cloud).
  • Experience dealing with real-world large-scale datasets.
  • Strong understanding and passion for statistical/mathematical modeling and data analysis.


About R Systems:

WE SPEAK DIGITAL.OverviewFormerly known as Computaris, we are the European branch of R Systems - global technology and analytics services company.We help our clients achieve speed-to-market, overcome digital barriers, and create business value with our specialized service offerings and consultative business approach. We speak the language of business as fluently as we do the language of technology. In other words: We speak Digital. Our goal: accelerate our clients’ digital leadership.Our clients choose to partner with us for Cloud transformation, automation, data science, analytics, and product engineering, thanks to our technical expertise, domain knowledge, global presence and a record of delivering world-class solutions consistently for over 28 years.With a global workforce of 4,800+ employees spread across 16 delivery-centers and 26 offices, we continue to empower organizations with cutting-edge technologies. In Europe, R Systems has offices in the UK, Romania, Poland, Moldova and Switzerland, providing digital transformation services and extensive telecom expertise.


  • Big Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…To use Scrum methodology,...

  • Big Data Developer

    2 tygodni temu


    Warszawa, mazowieckie, Polska Billennium Pełny etat

    We are seeking a skilled Big Data Developer to join our team. If you have a passion for data and experience in building large-scale distributed systems, this is an exciting opportunity for you!Responsibilities:Develop and optimize Big Data solutions.Integrate and process large datasets from various sources.Work on distributed systems and cutting-edge data...

  • Data Engineer with GCP

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery) Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed. The role will include...

  • Data Engineer Databricks

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat

    Experis to światowy lider w rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujące projekty IT skierowane zarówno do doświadczonych ekspertów, jak i osób rozpoczynających karierę w branży IT. Obecnie, dla naszego klienta realizującego projekty w branży...

  • Data Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    ​As a Data Engineer in D&A Scaled Analytical Products, you will play a crucial role in designing, developing, and implementing data solutions that enable data-driven decision-making across the organization. You will collaborate with cross-functional teams to acquire, transform, and optimize data from various sources. Your technical expertise and innovative...


  • Warszawa, mazowieckie, Polska Capgemini Polska Pełny etat

    Senior Azure Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations...

  • T Hub

    2 miesięcy temu


    Warszawa, mazowieckie, Polska T-Mobile Polska S.A. Pełny etat

    WHAT TASKS AWAIT YOU?Develop and implement advanced AI/ML models on our big data platform.Collaborate with cross-functional teams to understand their business needs and develop solutions.Optimize existing ML algorithms and create new ones to improve performance.Stay updated with the latest advancements in AI/ML and Big Data technologies WHAT SKILLS WILL BE...


  • Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    We are looking for a driven, naturally curious Senior Data Engineer to join our Digital Experiences team delivering cloud native Big Data solutions within our global Media ecosystem. Our engineering teams work with data on a massive scale and are responsible for the design, development, and continuous innovation of best-in-class solutions supporting P&G as...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Sorigo Pełny etat

    W Sorigo zajmujemy się wdrażaniem innowacyjnych rozwiązań w obszarze IT. Mamy kilkunastoletnie doświadczenie we współpracy partnerskiej z dużymi klientami. Wierzymy także, że praca powinna dawać ludziom satysfakcje, a nie być tylko obowiązkiem. Choć czasami znalezienie odpowiedniego dla siebie miejsca wymaga czasu i dobrego ukierunkowania przez...

  • Data Engineer

    6 dni temu


    Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Proactive & Data Driven Support product provides analitycs, data and tools to proactively identify insights and support employees remotely in order to improve the employee experience.Data EngineerYour responsibilities Analyze and organize raw data. Build data systems...


  • Warszawa, Polska N-iX Pełny etat

    As a Data Engineer, you will be crucial in building and optimizing our data pipeline, which is central to our platform’s reliability and performance. You will be responsible for architecting and maintaining efficient data streams and integrating the latest technologies, focusing on complex event processing (CEP), to support our strategic goals and build a...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska easybrain Pełny etat

    We are looking for a skilled Data Engineer to join our BI team, which is responsible for operating large-scale data pipelines, based on integrations with dozens of sources, collecting a rapidly expanding list of data points on how users interact with our games. Using this vast data, we predict a user’s value and create analytical reports for other teams to...


  • Warszawa, mazowieckie, Polska Sii Pełny etat

    At Competency Center Customer Experience we seek an experienced Data Scientist specializing in Generative AI.You will work hands-on with Machine Learning and Big Data technologies within the Adobe Marketing Cloud and third-party tools to build scalable machine learning data products and solutions.Your tasksApply state-of-the-art algorithms relying on...

  • Cloud Data Engineer

    2 miesięcy temu


    Warszawa, mazowieckie, Polska PAYBACK Pełny etat

    PAYBACK is unique worldwide in data-based marketing. With the ability to develop digital business models and implement technical trends, we are pioneers of the data economy. The technical solutions for our 31 million customers relating to the PAYBACK program are designed and operated in-house. To this end, we work with the latest technologies and in a...


  • Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data...

  • Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska Workday Pełny etat

    Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...


  • Warszawa, Polska Nordea Bank Pełny etat

    Job ID: 21770    Senior Test Automation Engineer to Group Data Management Office, Gdynia or Helsinki. Would you like to become an expert in Big Data and Test Automation? We are now looking for a Senior QA Engineer to design and implement tests for Big Data solutions within Nordea’s next generation Big Data Platform.  At Nordea, we know our...

  • Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Workday Pełny etat

    Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...


  • Warszawa, Polska Equinix Poland Sp. z o.o. Pełny etat

    We are currently seeking a candidate for a role that primarily focuses on maintaining the servers and similar tasks. However, we are undergoing a transformation process to implement automation, self-healing, and self-service capabilities. As a result, the role will increasingly involve architecting solutions, programming, automation...


  • Warszawa, Polska Square One Resources Sp. z o.o. Pełny etat

    Project for pharmacy sector - a key project in the field of creating Data Products and reporting solutions supporting decisions for organizations servicing diagnostic instruments.Senior Data Engineer (Snowflake)Your responsibilities Analyze and organize raw data. Build...