Senior Data Engineer
2 miesięcy temu
Our client is seeking a passionate and experienced Senior Data Engineer to support the development of their blockchain crypto solution. This innovative application enables audit teams to verify their clients' assets, such as cryptocurrencies. As a Senior Data Engineer, you will play a crucial role in managing and leveraging large datasets, ensuring data integrity, and supporting blockchain audit-related tasks.
Start Date: ASAP
Remote vs Onsite: Remote
HackerRank Challenge: Yes
US Hours Overlap Needed: Yes (2-6 PM CET)
Senior Data Engineer - Blockchain Solutions
Your responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark, and Databricks.
- Implement data orchestration workflows using Airflow or similar tools.
- Manage and optimize data storage solutions on Azure Cloud.
- Develop and maintain containerized microservices using Docker.
- Collaborate with cross-functional teams to ensure data quality and integrity.
- Support the setup of blockchains.
- Build tools to acquire data from blockchains and perform analysis using Databricks.
- Support production infrastructure, including monitoring and automation with tools like Datadog.
- Participate in agile development practices, contributing to planning exercises and working in cross-functional groups.
Our requirements
- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- Advanced knowledge of Python for data processing and scripting.
- Proven experience with Spark and SQL for data engineering and analysis.
- Familiarity with data orchestration tools such as Airflow.
- Hands-on experience with cloud services (Azure, AWS, GCP).
- Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
- Experience with Data as Code, including version control, regular commits, unit tests, CI/CD, packaging, and familiarity with containerization tools such as Docker (must-have) and Kubernetes (a plus).
- Solid understanding of the software development life cycle.
- Understanding of blockchain technologies and data structures.
- Knowledge of cryptography and its applications in blockchain is a plus.
- Experience with blockchain indexing and Databricks for data ingestion and transformation is a plus.
- Familiarity with Delta Lake and data warehousing concepts is a plus.
Aplikuj
-
Senior Windows Infrastructure Engineer
4 tygodni temu
Warszawa, Mazovia, Polska NTT DATA Pełny etatJob DescriptionWe are seeking a seasoned system expert to join our team as a Senior Windows Infrastructure Engineer. This role is critical in designing and implementing information systems that support our enterprise infrastructure.About the RoleThis position ensures that all systems are working at optimal levels and supports the development of new...
-
Senior Data Engineer
1 miesiąc temu
Emilii Plater , Warszawa, Polska BEC Poland Pełny etatSenior Data Engineer - DWH SolutionsWe are seeking an experienced Senior Data Engineer to join our team at BEC Poland, working closely with Nykredit. As a Senior Data Engineer, you will be responsible for designing and implementing ETL processes, optimizing data loading to the DWH, and performing daily maintenance tasks.Key Responsibilities:Participate in...
-
Senior Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Senior Data Quality Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etat**About the Role**Balyasny Asset Management L.P. is seeking a skilled Senior Data Quality Engineer to join our team.As a Senior Data Quality Engineer, you will be responsible for designing and developing solutions that leverage cloud-based data and distributed computing technologies to create our next-gen data quality platform.You will contribute...
-
Senior ML Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etatSquare One Resources Sp. z o.o. is seeking a Senior ML Engineer - Biomedical Data Insights to join our team.As a Senior ML Engineer, you will design, develop, and deploy solutions based on large language models (LLM) for secondary use and primary exploration of biomedical data. Your responsibilities will include:Fine-tuning LLM models to meet specific...
-
Senior Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Sunscrapers sp. z o.o. Pełny etatAbout the Role:As a Senior Data Engineer at Sunscrapers, you will be responsible for designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from various sources.Key Responsibilities:Design and implement data collection systems that integrate proprietary company data and third-party...
-
Senior Data Architect
1 miesiąc temu
Warszawa, Mazovia, Polska emagine Consulting Pełny etatJob OverviewWe are seeking a Senior Data Engineer to join our team in the data platforms and services department. The ideal candidate will have a strong background in databases, data modeling, and data warehousing.The Senior Data Engineer will be responsible for providing Business Intelligence Foundation and backend solutions components. This includes...
-
Senior Data Engineer
4 tygodni temu
Warszawa, Polska Tangome Poland Sp. z o.o. Pełny etatUnlock the Potential of Big Data as a Senior Data EngineerTangome Poland Sp. z o.o., a pioneering live-streaming platform, is seeking an exceptional Senior Data Engineer to join our team in Poland.We are a forward-thinking organization with 500+ million registered users and a projected market value of $240 billion. Our platform empowers talented individuals...
-
Senior Data Transformation Engineer
4 tygodni temu
Warszawa, Mazovia, Polska Siemens Healthcare Sp. z o.o. Pełny etatJob DescriptionSiemens Healthineers is a leading healthcare company that innovates solutions for diagnostics, therapy and personalized healthcare. We are seeking an experienced Senior Data Transformation Engineer to join our team in Poland.About the RoleThis role offers a unique opportunity to work with cutting-edge technology and contribute to the...
-
Senior AWS Data Engineer
3 miesięcy temu
Warszawa, Polska Square One Resources Sp. z o.o. Pełny etatWe are seeking a highly skilled Senior Data Engineer to join our team. This position involves working on a groundbreaking project that enables the discovery, access, processing, publication, and sharing of biomedical data. The objective is to generate insights for secondary use and to integrate both clinical and non-clinical data...
-
Senior Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska IT Performance Pełny etatPraca Senior Data Engineer w IT PerformanceW IT Performance poszukujemy kandydatów na stanowisko Senior Data Engineer. Niniejsze stanowisko dedykowane jest międzynarodowej firmie specjalizującej się w technologii medycznej i farmacji, z obszarem danych.ObowiązkiProjektowanie, rozwijanie i utrzymywanie solidnych, skalowalnych i wydajnych Data/ETL...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, Mazovia, Polska VGW Pełny etatSenior Data Engineer - Game DevelopmentWe are seeking a highly skilled Senior Data Engineer to join our team in Poland. As a key member of our Growth team, you will be responsible for integrating new games into our existing systems, ensuring a seamless experience for our players.Tech We UseOur current analytics stack includes Snowflake, Databricks, AWS...
-
Senior Data Engineer
4 tygodni temu
Warszawa, Polska B2B.net S.A Pełny etatSenior Data EngineerYour responsibilities Working with Spark & Python to define and maintain data ingestions and transformation Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etatJob Description:Square One Resources Sp. z o.o. is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines using Snowflake.Key Responsibilities:Analyze and organize raw data to extract insights and inform business...
-
Senior AWS Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etatWe are looking for a skilled Senior Data Engineer to work on a groundbreaking project.Key Responsibilities:Design and implement ETL processes for efficient data flow and storage. Maintain and optimize data pipelines using cloud technologies. Collaborate with cross-functional teams to integrate and process biomedical data. Ensure data quality and adherence to...
-
Senior Data Infrastructure Engineer
4 tygodni temu
Marszałkowska , Warszawa, Polska Asana Pełny etatBuild Asana's Data PlatformsAs a senior software engineer on Asana's Data Infrastructure team, you will design and implement production code for backend, infrastructure, and data systems. You will help build the company's data platforms for a world-class team of engineers.Key ResponsibilitiesDesign and implement production code for backend,...
-
Senior Azure Data Platform Engineer
4 tygodni temu
Warszawa, Polska HAYS Pełny etatSenior Azure Data Platform EngineerWarszawaNR REF.: 1189893Senior Azure Data Platform Engineer, UoP, Hybrid Work Model, WarsawYour Tasks: Managing and optimizing Data/AI workflows using AI orchestrators like LangChain. Designing and managing database schemas to efficiently meet application data requirements. Utilizing Azure Cloud services (AI Service, Data...
-
Senior Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Siemens Healthcare Sp. z o.o. Pełny etatJob Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our internal data conversion team at Siemens Healthineers. In this role, you will design, develop, and maintain complex data transformation processes to ensure the accuracy, efficiency, and security of our data operations. Your expertise in SQL, Python,...
-
Senior Data Engineer
3 tygodni temu
Warszawa, Polska N-iX Pełny etatRole OverviewWe are seeking a seasoned Senior Data Engineer to join our team at N-iX. As a key member of our engineering group, you will be responsible for designing, building, and maintaining production-grade data pipelines using Python.This is an excellent opportunity to work with a leading SaaS provider that specializes in developing solutions for...
-
Senior Data Quality Engineer
3 tygodni temu
Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etatJob DescriptionWe are seeking a highly skilled Senior Data Quality Engineer to join our team at Balyasny Asset Management L.P.The ideal candidate will have a strong background in software engineering, data quality, and cloud-native technologies. This is an excellent opportunity to work on a high-impact project that requires expertise in designing and...