Data Infrastructure Engineer
2 tygodni temu
For our business partner (trading company from USA), we are looking for a Data Infrastructure Engineer
Responsibilities on the project:
- Build and run data platform using technologies such as public cloud infrastructure (AWS and GCP), Kafka, databases, and containers.
- Develop data science platform based on open source software and Cloud services.
- Build and run ETL tools and frameworks to onboard data into the platform, define schema, build DAG processing pipelines, and monitor data quality.
- Help develop machine learning development framework and pipelines.
- Manage and run mission-critical production services.
Requirements:
- 3+ years of experience in a Data Platform/Infrastructure Engineering role.
- Strong experience with Python.
- Experience building ETL and stream processing tools and frameworks using Kafka, Spark, Flink, Airflow/Prefect, etc.
- Experience with SQL and databases/engines such as MySQL, PostgreSQL, MS SQL, Snowflake, Redshift, Presto, etc.
- Familiarity with data science stack: e.g. Jupyter, Pandas, Scikit-learn, Dask, PyTorch, MLFlow, Kubeflow, etc.
- Experience using AWS/GCP (S3/GCS, EC2/GCE, IAM, etc.), Kubernetes, and Linux in production.
- Strong proclivity for automation and DevOps practices.
- Experience with managing increasing data volume, velocity, and variety.
- English at least B2+/C1 level.
Nice to have:
- University degree (preferred in IT or similar).
- Experience with: Java, C++, Rust, Go.
- Understanding of TCP/IP and distributed systems.
- Experience managing time series data.
- Familiarity with working with open source communities.
We offer:
Location: 100% remote.
Wages: 160 PLN/H - 210 PLN/H net + VAT / B2B.
Working hours: Overlap with US at least 5h (11:00/12:00 - 19:00/20:00 Polish time).
#J-18808-Ljbffr-
Data Infrastructure Engineer
1 dzień temu
Warszawa, Mazovia, Polska IPF Digital Pełny etatWe're seeking a talented Data Infrastructure Engineer to join our team at IPF Digital. As a Cloud Data Engineer, you'll be responsible for designing, developing, and maintaining data pipelines that enable secure, scalable, and reliable data storage for advanced analytics and reporting. You'll integrate data from multiple sources, optimize Snowflake...
-
Data Engineer Role
5 dni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatJob DescriptionWe are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing complex data systems, working closely with the Data Science team to deliver machine learning models into production environments.You will have experience with distributed technologies, including Hadoop,...
-
Experienced Data Engineer Wanted
5 dni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout the RoleWe are looking for a highly motivated and experienced Data Engineer to join our team. The successful candidate will have a strong understanding of data structures and algorithms, experience with Spark Jobs, and knowledge of cloud technologies.As a Data Engineer, you will be responsible for designing and implementing complex data systems,...
-
Senior Data Infrastructure Engineer
1 dzień temu
Warszawa, Mazovia, Polska monday Pełny etatWe're looking for a seasoned Senior Data Infrastructure Engineer to join our DBRE team at monday. This role offers an exciting chance to work with a talented team and contribute to the development of our product.Key Responsibilities:Design, implement, and maintain scalable and reliable data infrastructure, ensuring high-performance and...
-
Data Engineer for Modern Data Infrastructure
7 dni temu
Warszawa, Mazovia, Polska Sii Sp. z o.o. Pełny etatJob Description:We are seeking an experienced Data Engineer to join our team and contribute to the development and maintenance of a modern data infrastructure. As a key member of our team, you will be responsible for applying data engineering practices and standards to develop robust and maintainable data pipelines.The ideal candidate will have expertise in...
-
Data Engineer Position
4 dni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout the Company: Data Science UA is a leading service company with a strong focus on data science and artificial intelligence expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, laying the foundation for our growth over the past eight years. We have fostered the largest Data Science Community in Eastern...
-
Senior Data Engineer @
1 tydzień temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...
-
Data Infrastructure Specialist
1 tydzień temu
Warszawa, Mazovia, Polska LinkedIn - Jobboard Pełny etat**Job DescriptionWe're seeking a Data Infrastructure Specialist to join our global team building and maintaining our in-house pricing and risk platform. As a key member of our team, you will be responsible for designing, developing, testing, automating, and securing these critical components.**Key Responsibilities:Design and implement data warehouse...
-
Data Infrastructure Specialist
7 dni temu
Warszawa, Mazovia, Polska Point72 Asset Management, L.P Pełny etatAbout the RoleWe are looking for a Senior Frontend Engineer to join our Market Intelligence team in Warsaw. As a Senior Frontend Engineer, you will design and implement visually appealing, responsive interfaces, such as interactive chatbot-like applications, charts, graphs, and data visualizations.The ideal candidate will have 2+ years of experience working...
-
Senior Data Engineer Position
6 dni temu
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout the CompanyData Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth.Our client is the market-leading intelligence platform for paid search advertising. The unique combination of artificial search...
-
Data Platform Engineer @
4 tygodni temu
Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etatData Platform Engineer About Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...
-
Senior Data Infrastructure Specialist
7 dni temu
Warszawa, Mazovia, Polska TechHunt Pełny etatTechHunt is looking for a skilled Data Engineering Team Lead to join our team. As a Senior Data Engineer, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and implementation using Scala and Python.About the Role:In this role, you will...
-
Data Infrastructure Developer
2 dni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etatKey ResponsibilitiesAs a Data Engineer at GetInData | Part of Xebia, your key responsibilities will include:- Crafting and maintaining the structure, tools, and procedures essential for our organization to gather, store, modify, and scrutinize extensive data amounts.- Creating data platforms using provided infrastructure and establishing a clear path for...
-
Warszawa, Mazovia, Polska Asana Pełny etatWe're looking for a senior software engineer with experience in infrastructure and operations and a strong interest in big data systems. You will work with a world-class team of engineers on deploying and operating existing systems, and building new systems to meet the unique challenges of Asana's data platforms.The Data Infrastructure team builds the...
-
Senior Software Engineer, Data Infrastructure @
1 dzień temu
Warszawa, Mazovia, Polska Asana Pełny etatWe're looking for a senior software engineer with experience in infrastructure and operations and a strong interest in big data systems. You will work with a world-class team of engineers on deploying and operating existing systems, and building new systems to meet the unique challenges of Asana's data platforms. The Data Infrastructure team builds the...
-
Technical Data Infrastructure Lead
2 dni temu
Warszawa, Mazovia, Polska Visa Inc. Pełny etatThe Technical Data Infrastructure Lead will play a crucial role in shaping Visa's data engineering capabilities. As a lead engineer, you will be responsible for designing, developing, and deploying scalable data infrastructure that meets the needs of our business stakeholders.Your expertise in big data technologies, programming languages like Java and...
-
Data Infrastructure Engineer
3 dni temu
Warszawa, Mazovia, Polska HR-Line Pełny etatAbout Our CompanyWe are a specialist recruitment business providing services to clients. Our goal is to connect talented individuals with exciting opportunities.Data Architect Job OverviewThis role involves collaborating with our team to design and implement data infrastructure solutions. If you have experience working with data and want to take your skills...
-
Senior Software Engineer Data Infrastructure
1 dzień temu
Warszawa, Mazovia, Polska Asana Pełny etatWe're looking for a senior software engineer with experience in infrastructure and operations and a strong interest in big data systems. You will work with a world-class team of engineers on deploying and operating existing systems, and building new systems to meet the unique challenges of Asana's data platforms.The Data Infrastructure team builds the...
-
Data Infrastructure Engineer
5 dni temu
Warszawa, Mazovia, Polska monday Pełny etatOverview:monday.com is a rapidly growing company that offers a unique opportunity to make an immediate and real impact on the future of our product. Our DBRE team is responsible for the hundreds of production (and pre-production) database environments that run monday.com, and we are looking for a skilled Data Reliability Engineer to join us.The Role:As a...
-
Warszawa, Mazovia, Polska Data Science UA Pełny etatAbout UsData Science UA is a company that specializes in providing data science and AI services to its clients. Our mission is to help businesses make informed decisions by leveraging the power of data and artificial intelligence. With a strong focus on innovation and customer satisfaction, we strive to be the go-to partner for organizations seeking to...