Data Infrastructure Engineer

2 tygodni temu


Warszawa, Mazovia, Polska TN Poland Pełny etat

For our business partner (trading company from USA), we are looking for a Data Infrastructure Engineer

Responsibilities on the project:

  • Build and run data platform using technologies such as public cloud infrastructure (AWS and GCP), Kafka, databases, and containers.
  • Develop data science platform based on open source software and Cloud services.
  • Build and run ETL tools and frameworks to onboard data into the platform, define schema, build DAG processing pipelines, and monitor data quality.
  • Help develop machine learning development framework and pipelines.
  • Manage and run mission-critical production services.

Requirements:

  • 3+ years of experience in a Data Platform/Infrastructure Engineering role.
  • Strong experience with Python.
  • Experience building ETL and stream processing tools and frameworks using Kafka, Spark, Flink, Airflow/Prefect, etc.
  • Experience with SQL and databases/engines such as MySQL, PostgreSQL, MS SQL, Snowflake, Redshift, Presto, etc.
  • Familiarity with data science stack: e.g. Jupyter, Pandas, Scikit-learn, Dask, PyTorch, MLFlow, Kubeflow, etc.
  • Experience using AWS/GCP (S3/GCS, EC2/GCE, IAM, etc.), Kubernetes, and Linux in production.
  • Strong proclivity for automation and DevOps practices.
  • Experience with managing increasing data volume, velocity, and variety.
  • English at least B2+/C1 level.

Nice to have:

  • University degree (preferred in IT or similar).
  • Experience with: Java, C++, Rust, Go.
  • Understanding of TCP/IP and distributed systems.
  • Experience managing time series data.
  • Familiarity with working with open source communities.

We offer:

Location: 100% remote.

Wages: 160 PLN/H - 210 PLN/H net + VAT / B2B.

Working hours: Overlap with US at least 5h (11:00/12:00 - 19:00/20:00 Polish time).

#J-18808-Ljbffr

  • Warszawa, Mazovia, Polska IPF Digital Pełny etat

    We're seeking a talented Data Infrastructure Engineer to join our team at IPF Digital. As a Cloud Data Engineer, you'll be responsible for designing, developing, and maintaining data pipelines that enable secure, scalable, and reliable data storage for advanced analytics and reporting. You'll integrate data from multiple sources, optimize Snowflake...

  • Data Engineer Role

    5 dni temu


    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing complex data systems, working closely with the Data Science team to deliver machine learning models into production environments.You will have experience with distributed technologies, including Hadoop,...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the RoleWe are looking for a highly motivated and experienced Data Engineer to join our team. The successful candidate will have a strong understanding of data structures and algorithms, experience with Spark Jobs, and knowledge of cloud technologies.As a Data Engineer, you will be responsible for designing and implementing complex data systems,...


  • Warszawa, Mazovia, Polska monday Pełny etat

    We're looking for a seasoned Senior Data Infrastructure Engineer to join our DBRE team at monday. This role offers an exciting chance to work with a talented team and contribute to the development of our product.Key Responsibilities:Design, implement, and maintain scalable and reliable data infrastructure, ensuring high-performance and...


  • Warszawa, Mazovia, Polska Sii Sp. z o.o. Pełny etat

    Job Description:We are seeking an experienced Data Engineer to join our team and contribute to the development and maintenance of a modern data infrastructure. As a key member of our team, you will be responsible for applying data engineering practices and standards to develop robust and maintainable data pipelines.The ideal candidate will have expertise in...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the Company: Data Science UA is a leading service company with a strong focus on data science and artificial intelligence expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, laying the foundation for our growth over the past eight years. We have fostered the largest Data Science Community in Eastern...

  • Senior Data Engineer @

    1 tydzień temu


    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...


  • Warszawa, Mazovia, Polska LinkedIn - Jobboard Pełny etat

    **Job DescriptionWe're seeking a Data Infrastructure Specialist to join our global team building and maintaining our in-house pricing and risk platform. As a key member of our team, you will be responsible for designing, developing, testing, automating, and securing these critical components.**Key Responsibilities:Design and implement data warehouse...


  • Warszawa, Mazovia, Polska Point72 Asset Management, L.P Pełny etat

    About the RoleWe are looking for a Senior Frontend Engineer to join our Market Intelligence team in Warsaw. As a Senior Frontend Engineer, you will design and implement visually appealing, responsive interfaces, such as interactive chatbot-like applications, charts, graphs, and data visualizations.The ideal candidate will have 2+ years of experience working...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About the CompanyData Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth.Our client is the market-leading intelligence platform for paid search advertising. The unique combination of artificial search...

  • Data Platform Engineer @

    4 tygodni temu


    Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etat

    Data Platform Engineer About Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...


  • Warszawa, Mazovia, Polska TechHunt Pełny etat

    TechHunt is looking for a skilled Data Engineering Team Lead to join our team. As a Senior Data Engineer, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and implementation using Scala and Python.About the Role:In this role, you will...


  • Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etat

    Key ResponsibilitiesAs a Data Engineer at GetInData | Part of Xebia, your key responsibilities will include:- Crafting and maintaining the structure, tools, and procedures essential for our organization to gather, store, modify, and scrutinize extensive data amounts.- Creating data platforms using provided infrastructure and establishing a clear path for...


  • Warszawa, Mazovia, Polska Asana Pełny etat

    We're looking for a senior software engineer with experience in infrastructure and operations and a strong interest in big data systems. You will work with a world-class team of engineers on deploying and operating existing systems, and building new systems to meet the unique challenges of Asana's data platforms.The Data Infrastructure team builds the...


  • Warszawa, Mazovia, Polska Asana Pełny etat

    We're looking for a senior software engineer with experience in infrastructure and operations and a strong interest in big data systems. You will work with a world-class team of engineers on deploying and operating existing systems, and building new systems to meet the unique challenges of Asana's data platforms. The Data Infrastructure team builds the...


  • Warszawa, Mazovia, Polska Visa Inc. Pełny etat

    The Technical Data Infrastructure Lead will play a crucial role in shaping Visa's data engineering capabilities. As a lead engineer, you will be responsible for designing, developing, and deploying scalable data infrastructure that meets the needs of our business stakeholders.Your expertise in big data technologies, programming languages like Java and...


  • Warszawa, Mazovia, Polska HR-Line Pełny etat

    About Our CompanyWe are a specialist recruitment business providing services to clients. Our goal is to connect talented individuals with exciting opportunities.Data Architect Job OverviewThis role involves collaborating with our team to design and implement data infrastructure solutions. If you have experience working with data and want to take your skills...


  • Warszawa, Mazovia, Polska Asana Pełny etat

    We're looking for a senior software engineer with experience in infrastructure and operations and a strong interest in big data systems. You will work with a world-class team of engineers on deploying and operating existing systems, and building new systems to meet the unique challenges of Asana's data platforms.The Data Infrastructure team builds the...


  • Warszawa, Mazovia, Polska monday Pełny etat

    Overview:monday.com is a rapidly growing company that offers a unique opportunity to make an immediate and real impact on the future of our product. Our DBRE team is responsible for the hundreds of production (and pre-production) database environments that run monday.com, and we are looking for a skilled Data Reliability Engineer to join us.The Role:As a...


  • Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About UsData Science UA is a company that specializes in providing data science and AI services to its clients. Our mission is to help businesses make informed decisions by leveraging the power of data and artificial intelligence. With a strong focus on innovation and customer satisfaction, we strive to be the go-to partner for organizations seeking to...