Senior Data Platform Engineer

1 miesiąc temu


Katowice, Polska RITS Professional Services Pełny etat
Senior Data Platform Engineer

We are seeking a highly skilled Senior Data Platform Engineer to join our team at RITS Professional Services. As a key member of our engineering team, you will be responsible for designing, building, and maintaining our data platform using cutting-edge technologies such as public cloud infrastructure, Kafka, databases, and containers.

Key Responsibilities:

  • Design and implement data pipelines using ETL tools and messaging systems
  • Collaborate with data engineers to provide platform infrastructure and support
  • Develop and maintain Kafka messaging clusters and K8s clusters
  • Optimize application performance and troubleshoot issues
  • Build and maintain ETL pipelines, define schema, and monitor data quality
  • Develop machine learning frameworks and pipelines
  • Manage and run mission-critical production services

Requirements:

  • 3+ years of experience in a Platform Engineering role
  • Strong software engineering experience and working with Python
  • Strong experience working with SQL and databases/engines such as MySQL, PostgreSQL, SQL Server, Snowflake, Redshift, Presto, etc
  • Experience building ETL and stream processing pipelines using Kafka, Spark, Flink, Airflow/Prefect, etc.
  • Familiarity with data science stack: e.g. Juypter, Pandas, Scikit-learn, Dask, Pytorch, MLFlow, Kubeflow, etc.
  • Experience with using AWS/GCP (S3/GCS, EC2/GCE, IAM, etc.), Kubernetes and Linux in production
  • Strong proclivity for automation and DevOps practices
  • Experience with managing increasing data volume, velocity, and variety
  • Agile, self-starter, and focused on getting things done
  • Ability to deal with ambiguity
  • Strong communicator
  • Participate in on-call outside of regular business hours

Nice to Have:

  • Development skills in C++, Java, Go, Rust
  • Understands TCP/IP and distributed systems
  • Experience managing time series data
  • Familiarity with working with open source communities
  • Financial Services experience

We Offer:

  • Budget for materials and hardware
  • Free private medical insurance or Medicover Sport Membership
  • Ready to have you on a team ASAP
  • Long-term cooperation
  • Integration Trips to NY/London/Warsaw several times a year for 3-4 days (non-mandatory, expenses covered)


  • Katowice, Silesia, Polska Data Reply Pełny etat

    About UsData Reply, a part of the Reply Group, is a leading provider of data-driven solutions to help businesses achieve meaningful results through effective data use. Our team works across various industries and business areas, collaborating closely with clients to develop scalable, automated, and efficient data platforms.Job OverviewWe are seeking an...


  • Katowice, Polska EPAM Systems Pełny etat

    Senior Data Integration Engineer DatabricksWe are seeking a highly skilled Senior Data Integration Engineer to join our dynamic Data Practice team at EPAM Systems. As a key member of our team, you will collaborate on strategic projects and drive forward our data engineering initiatives.Your primary focus will be on designing, building, and managing...


  • Katowice, Silesia, Polska ING Pełny etat

    About INGAs a leading financial institution, ING is committed to innovation and excellence in the field of Environmental, Social, and Governance (ESG) risk & data appliances.Job OverviewThis exciting opportunity as Senior Platform Engineer will enable you to join our team of skilled professionals working on cutting-edge platforms using Python, Docker, and...

  • Senior Data Engineer

    3 tygodni temu


    Katowice, Polska ING Hubs Poland Pełny etat

    We are looking for a highly skilled Senior Data Engineer to join our Wholesale Banking Advanced Analytics team in ING Hubs Poland.This is a unique opportunity to work with the latest concepts and technologies in data engineering and design and build data pipelines that cater to stakeholder requirements.In this role, you will collaborate with data analysts...

  • Senior Data Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for building, deploying, and maintaining end-to-end, scalable, and reliable analytics solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes that ingest, transform, and...

  • Senior Data Engineer

    1 miesiąc temu


    Zabrska , Katowice, Polska ING Hubs Poland Pełny etat

    We are seeking a skilled Data Engineer to join our team at ING Hubs Poland. As a Data Engineer, you will be responsible for designing and building data pipelines that cater to stakeholder requirements. Your day-to-day activities will involve implementing new features in Kedro/PySpark, testing them in Apache Airflow, and deploying them in our in-house...

  • Senior DevOps Engineer

    4 tygodni temu


    Katowice, Silesia, Polska Data Reply Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior DevOps Engineer to join our team at Data Reply. As a key member of our team, you will be responsible for designing and implementing scalable, cost-effective, and flexible solutions for our customers using powerful and state-of-the-art open source and cloud technologies.Key ResponsibilitiesDesign and...


  • Katowice, Silesia, Polska ING Pełny etat

    About ING and the Data Analytics PlatformING is now building its Data Analytics Platform in Google Cloud, aiming to enhance data-driven decision-making. This project is a collaborative effort between various ING units.The platform will be developed by a distributed multi-national and multi-cultural team. The role of Engineer IV positions individuals as key...

  • Senior Data Engineer

    3 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is seeking a skilled Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions that are scalable, reliable, and efficient.Key ResponsibilitiesDesign and implement data pipelines using various technologies such as...

  • Senior Data Engineer

    1 miesiąc temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the RoleVattenfall is a leading energy company seeking a talented Senior Data Engineer to join our Analytics Hub team. As a key member of our team, you will be responsible for designing, developing, and maintaining end-to-end analytics solutions using Microsoft Azure technology stack.Key Responsibilities:Building and deploying scalable and reliable...


  • Katowice, Polska Capgemini Polska Pełny etat

    Job SummaryWe are seeking a highly skilled Databricks Data Engineer to join our team at Capgemini Polska. As a key member of our data engineering team, you will be responsible for designing and implementing solutions for processing large and unstructured datasets, including Data Lake Architecture and Streaming Architecture.Key ResponsibilitiesDesign and...


  • Jesionowa , Katowice, Polska MPC Pełny etat

    Job Title: Senior Data Automation EngineerWe are seeking a highly skilled Data Automation Engineer to join our team at MPC. As a key member of our engineering team, you will be responsible for designing and implementing automated systems that improve data accuracy, reduce manual work, and ensure smooth integration of new data sources.Responsibilities:Develop...

  • Senior Cloud Data Engineer

    1 miesiąc temu


    Katowice, Polska EPAM Systems Pełny etat

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in the Google Cloud Platform (GCP) stack to join our Data Practice and contribute to the success of our clients.ResponsibilitiesDesign and implement data pipelines using Spark and GCP cloud-based data stack technologiesMaintain data quality and ensure governance across data...

  • Senior Data Engineer

    1 miesiąc temu


    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have hands-on experience building complex data pipelines,have experience with Apache Airflow, Spark, Python,have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),have experience with deployment and provisioning automation tools...


  • Katowice, Polska ING Hubs Poland Pełny etat

    Job Title: Platform Software Engineer - Scalability ExpertAbout the Job:We are seeking a highly skilled Platform Software Engineer - Scalability Expert to join our team at ING Hubs Poland. As a key member of our team, you will be responsible for optimizing the performance of our data analytics platform, providing self-service tools and reports for end-users,...

  • GCP Platform Engineer

    6 miesięcy temu


    Katowice, Polska ING Pełny etat

    We are looking for you, if you: have Infrastructure as Code mindset (Our techstack: Terraform with Azure DevOps pipelines), have experience with public cloud (preferably GCP) and building platforms on top of it, are experienced with managed GCP services (. GKE, GCS, BQ, Dataproc), demonstrate skills at programming (Python & Go preferred), got...


  • Katowice, Silesia, Polska ING Pełny etat

    About the RoleWe are seeking a skilled Senior Data Engineer to join our team, responsible for designing and developing a Data Warehouse. As part of this role, you will work closely with the data analytics team to create insightful reports and dashboards using Power BI.ResponsibilitiesDesign and develop a robust Data Warehouse, ensuring data accuracy and...

  • Senior DevOps Engineer

    1 miesiąc temu


    Katowice, Silesia, Polska N-iX Pełny etat

    DevOps Engineer - AI Platform IntegrationWe are seeking a skilled DevOps Engineer to lead the integration of multiple AI tools and enhance the efficiency and cost-effectiveness of our internal AI platform.This project involves selecting the best-fit tools that align with our current infrastructure, seamlessly integrating these tools to maintain a unified AI...

  • Platform Engineer

    1 miesiąc temu


    Katowice, śląskie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have hands-on experience in delivering highly distributed, large scale (data) platforms preferably using open-source technologies,are programming in scripting languages, e.g. Python,are programming in a statically typed language, e.g. JVM (Java/Scala), Golang,have strong experience with SQL/NoSQL datastores (Hive), and other...

  • Senior Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall Pełny etat

    About the roleAt Vattenfall, we are seeking a Senior Data Engineer to join our Analytics Hub team. As a Senior Data Engineer, you will be responsible for building, deploying, and maintaining end-to-end, scalable, and reliable analytics solutions. Your key responsibilities will include designing, developing, and maintaining data pipelines and ETL processes,...