Data Engineer PKO Finat
1 miesiąc temu
Poszukiwane kompetencje:
1. Co najmniej 5-letnie doświadczenie jako Developer ETL w obszarze procesów integracji danych na on-prem :
- Biegłe posługiwanie się narzędziami ETL na on-prem na poziomie zaawansowanym : Informatic Power Center , ** NIFI
- Ekspercka znajomość relacyjne bazy danych Oracle, PostgeSQL , ScyllaDB (projektowanie, budowa i tiuning baz danych)
- Bardzo dobra znajomość narzędzia harmonogramującego Automate Now firmy Infinity Data
- Umiejętność wystawiania usług Rest API
2. Co najmniej 3-letniego doświadczenia jako Data Engineer GCP w obszarze procesów integracji danych na GCP:
- Dobra Znajomość narzędzi ETL Flow na GCP : Apache AirFlow , GCP Data Flow, GCP Data Proc
- Dobra znajomość baz danych GCP : GCP Big Query, GCP Big Table, Scylla Cloud (projektowanie, budowa i tiuning baz danych)
- Korzystanie z kolejek : Kafka, GCP Pub / Sub
3. Co najmniej 4-letnie doświadczenie jako programista w językach :
- Biegła znajomość Python (w obszarze integracji i analizy danych), i frame work PySpark
- Dobra znajomość języka Rust do pisania narzędzi i frame worków wspomagających wydajne ładowanie danych
4. Przejęcie odpowiedzialności za obszar wystawiana danych pod usługi w wysokim reżimie wydajnościowych 24h
DODATKOWO :
- Chociaż podstawowa wiedza w zakresie programowania MicroServices w języku JAVA
- Mile widziany język Groovy
- Korzystanie z systemu operacyjnego linux na poziomie zaawansowanego użytkownika,
- Doświadczenie w pracy z dużymi wolumenami danych ~100TB,
- Umiejętności analitycznego myślenia i szybkiego przyswajania wiedzy
- Samodzielności i kreatywności w rozwiązywaniu problemów
- Terminowości i rzetelności w realizacji projektów
- Mile widziana znajomość narzędzi pomocniczych : repozytorium GIT; narzędzi do monitorowania jak np. grafana ; narzędzia do testów wydajności jak Apache JMeter
Dla naszego Klienta szukamy Data Enginner.
- praca w modelu hybrydowym: 2 x w tygodniu biuro (ul. Chmielnej 89, Warszawa)
- umowa B2B
- opcjonalnie pakiet medyczny
-
Data Engineer
2 dni temu
Warszawa, mazowieckie, Polska Semantive Pełny etatWe are an independent multi-cloud services company that helps enterprises and SMB companies build new foundations for future growth through successful cloud transformation and breadth of expertise in applying cloud technologies to unlock new possibilities. Today's digital and technological revolution is an important part of our business - we are not only...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska RITS Professional Services Pełny etatWe are looking for Data Engineer! Hybrid work model - 2-3 times a week from the Warsaw or Prague office.As a Data Engineer, you will perform various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesigning processes and operations, developing and implementing planned solutions...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Link Group Pełny etatJob Overview:We are looking for a Data Engineer with a strong background in analytics to join our expanding team. In this role, you will take the lead in developing a solid data foundation that drives data-driven strategies and unlocks the full potential of investment data. You will play a key role in optimizing data pipelines, enhancing data integration,...
-
Senior Data Engineer
3 miesięcy temu
Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etatJoin our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatFor our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAbout the role:We are seeking a Senior Data Engineer with strong experience in DBT, data warehousing, and SQL. In this role, you'll work collaboratively to optimize data solutions and lead the transition of stored procedures to DBT models. ✔️ Key responsibilities:Analyze existing stored procedures to identify candidates for migration to DBT.Convert...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska RITS Professional Services Pełny etatWe are looking for a Data Engineer for our client in the technology industry!The position is hybrid, with 2-3 days per week in the office in Warsaw. Data Engineer performs various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesign processes and operations, developing and...
-
Data Platform Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatThe ChallengeAs an enterprise producing millions of connected appliances each year, we are generating massive amounts of data. As part of our data mesh journey, your task as a Data Platform Engineer is to build, develop, operate, and maintain a self-serve data platform that will support data and AI products. You will establish foundational capabilities for...
-
Senior Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska capital.com Pełny etatWe are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talent team. As a Data Engineer, you...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Samba TV Pełny etatAbout Us:Samba TV tracks streaming and broadcast video across the world with our proprietary data and technology. We are on a mission to fundamentally transform the viewing experience for everyone. Our data enables media companies to connect with audiences for new shows and movies, and enables advertisers to engage viewers and measure reach across all their...
-
Data Engineer Bank Fraud
3 miesięcy temu
Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you:have hands-on experience building complex data pipelines,have strong experience in data processing and optimization using Apache Spark,have good knowledge of data manipulation and transformation, have experience with Apache Airflow, Python, SQL, have knowledge of software engineering best practices, have deployment and...
-
DATA Engineer
3 dni temu
Warszawa, mazowieckie, Polska PAYBACK Pełny etatPAYBACK is the world’s leading multi-partner loyalty program. As an international player, we operate in German, Italian, Mexican, and Austrian markets. More than 10 million active customers already use the German PAYBACK app and mobile PAYBACK services via their smartphones.PAYBACK is a top player in data-driven marketing. With the ability to develop...
-
Data Engineer with Azure
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatWe’re looking for an experienced Data Engineer skilled in Azure and data pipeline optimization to design, build, and streamline scalable data pipelines and storage solutions that support analytics and machine learning.✔️ Key responsibilities:Design, deploy, and maintain data solutions on Azure (Data Factory, Databricks, SQL Database, Synapse).Manage...
-
Data Engineer in Product Analytics
2 miesięcy temu
Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you have:hands-on experience building complex data pipelines,strong experience in data processing and optimization using Apache Spark, good knowledge of data manipulation and transformation,experience with Apache Airflow, Python, SQL, knowledge of software engineering best practices, deployment and provisioning automation tools...
-
Data Engineer AWSSnowflake
2 miesięcy temu
Warszawa, mazowieckie, Polska Lingaro Pełny etatWe are seeking an experienced Cloud Data Engineer proficient with Snowflake and AWS. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Tasks:Designing and implementing data processing systems using distributed frameworks like Snowflake. This involves writing...
-
Senior Cloud Data Engineer SEB
4 tygodni temu
Warszawa, mazowieckie, Polska SEB Pełny etatAt least 3 years of experience working as Data Engineer with a strong tech background, you are passionate about development and developing solutions that bring value to the business. Proficiency in: data integration, data modelling, data pipelines in the cloud Experience working in: SQL and Python; Version Control (i.e. Git) and Agile development; Testing...
-
Data Engineer Python
2 miesięcy temu
Warszawa, mazowieckie, Polska NG Logic Pełny etatNG Logic is an international company specializing in transforming our clients' visions into digital products. The proof? 90% of our clients come to us by referral. With 20 years of experience, we can build anything for our clients: custom web and mobile applications, microservices, migrations, integrations and product design. We use technologies such as...
-
Cloud Data Engineer
5 miesięcy temu
Warszawa, mazowieckie, Polska PAYBACK Pełny etatPAYBACK is unique worldwide in data-based marketing. With the ability to develop digital business models and implement technical trends, we are pioneers of the data economy. The technical solutions for our 31 million customers relating to the PAYBACK program are designed and operated in-house. To this end, we work with the latest technologies and in a...