![BCF Software Sp. z o.o.](https://media.trabajo.org/img/noimg.jpg)
Senior Data Engineer
6 dni temu
Project overview
Our client is embarking on a significant transformation project aimed at replatforming our financial system. Two initiatives will run in parallel: one for all financial and second for all non-financial data. We are in the early stages of an ambitious project to consolidate data from various sources into a single Delta Lake data warehouse.
Responsibilities
Lead the integration and ingestion of data from diverse sources into the Delta Lake platform, ensuring data consistency and availability.
Collaborate with various teams to identify all data sources, including SFTP / flat files, and APIs.
Design and implement systematic processes for data ingestion and integration.
Conduct extensive data analysis to support the consolidation of organizational data into a single data warehouse.
Utilize Databricks for data ingestion and reporting, transitioning data from multiple data warehouses to a unified Delta Lake platform.
Work closely with the development team to understand project scope, gather full requirements, and plan subsequent phases.
Participate in daily standups, sprint planning, backlog refinement, and retrospectives within a scaled scrum framework.
Exhibit flexibility and adaptability in navigating unknowns and evolving project requirements.
Requirements
Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
Solid understanding of the software development life cycle.
Proven experience with Python, Spark and SQL for data engineering and analysis.
Strong data analysis skills, with the ability to interpret and manipulate large datasets.
Experience with Databricks for data ingestion and transformation.
Familiarity with Delta Lake and data warehousing concepts.
Excellent problem-solving skills and the ability to see the big picture and understand the broader context of assigned tasks.
Strong teamwork and collaboration skills, with a demonstrated ability to work effectively in a team-oriented environment.
Knowledge of reporting tools like Power BI.
Knowledge of Data Science concepts is a plus.
Strong communication, interpersonal and presentation skills.
-
Senior Data Engineer
4 tygodni temu
Poznan, Polska Rite NRG Pełny etatDołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi. Jakimi umiejętnościami możesz się pochwalić? Jesteś ekspertem w korzystaniu z narzędzi AWS, Bardzo dobrze znasz...
-
Senior Data Engineer
4 tygodni temu
Poznan, Polska Shaped Thoughts Pełny etatWe are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector. Who are we ? We are a remote-first boutique software house company formed by a group of seasoned software experts (the average experience in the team is 12 years). What connected all of us,...
-
Senior Data Engineer
4 tygodni temu
Poznan, Polska Opensignal Pełny etatJob title: Senior Data Engineer (MS SQL) Department: Engineering Reporting to: Engineering Manager Location: Poland Purpose of Role We’re looking for a Senior Data Engineer to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our...
-
Senior Data Engineer
4 tygodni temu
Poznan, Polska Amer Sports Pełny etat❄️ Mid/Senior Data Engineer (Snowflake) ❄️ Hybrid /Remote work, Cracow You will be part of the Enterprise Data & Analytics team, building strong ties with our international teams in North America and Asia to ensure seamless database operations. Your role is crucial in safeguarding data integrity, optimizing processes, and supporting the diverse...
-
Senior Big Data Engineer
1 tydzień temu
Poznan, Polska Capgemini Polska Sp. z o.o. Pełny etatYOUR ROLE As a Senior Engineer, you will build distributed data processing solution and highly loaded database solutions for various businesses cases including reporting, product analytics, marketing optimization and financial reporting. Contribute as part of self-organized team of experienced data engineers working in a challenging, innovative environment...
-
Data Engineer
1 tydzień temu
Poznan, Polska MindPal Pełny etatData Engineer Miejsce pracy: Poznań Technologies we use Expected Python SQL AWS About the project We are looking for a Data Engineer to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an...
-
Senior Backend Developer
1 tydzień temu
Poznan, Polska Data System Pełny etatHej! Tutaj Data System. Przez ponad 18 lat świadczymy dla naszych klientów usługi monitoringu i lokalizacji pojazdów. Jest w tym sporo zabawy. Nasze małe lokalizatory, nie tylko pomagają znaleźć samochód w gąszczu innych na parkingu, ale też umożliwiają łatwe i precyzyjne rozliczanie przejazdów po płatnych drogach dzięki systemowi e-Toll....
-
Senior Data Engineer
2 tygodni temu
Poznan, Polska Datumo Pełny etatDatumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects .Our team...
-
Data Engineer
4 tygodni temu
Poznan, Polska MindPal Pełny etattechnologies-expected : SQL Python about-project : We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...
-
Data Engineer
1 miesiąc temu
Poznan, Polska Pragmile Pełny etatPragmile is running an innovative research & development project for a large Polish institution which should result in a unique solution to monitor media market. We're looking for an experienced engineer who could support us in the successful execution and delivery. Requirements: Strong understanding of data structures and algorithms Strong understanding of...
-
Data Engineer
1 tydzień temu
Poznan, Polska Ework Group Pełny etatFor our client - a company from pharmaceutical area, we are looking for Data Engineer. What you will be doing You will be close to the heart of our client’s clinical operations where you will play a key role in shaping the future of clinical trials and patient care, by building scalable solutions in the cloud. Your key responsibilities include the...
-
Hyperscaler Engineer @ NTT DATA Business Solutions
4 tygodni temu
Poznan, Polska NTT DATA Business Solutions Pełny etatThat is what makes the NTT DATA Business Solutions spirit special: Team-oriented corporate culture, collaboration as equals and steady knowledge transfer Sustainable career development in a growth-oriented technology environment with a business focus on SAP full service (financing certificates and trainings) Remote work possibilities Benefits f.e. private...
-
Senior QA Automation Engineer
4 tygodni temu
Poznan, Polska Egnyte Poland Pełny etatSenior QA Automation Engineer Egnyte is the secure multi-cloud platform for content security and governance that enables organizations to better protect and collaborate on their most valuable content. Established in 2008, Egnyte has democratized cloud content security for more than 22,000 organizations, helping customers improve data security, maintain...
-
Data Engineer
1 tydzień temu
Poznan, Polska ITDS Pełny etatBecome a pioneer in smart crop science development with us! Warsaw-based opportunity with possibility to work partly remote (only 2 x month visits in office) As a Data Engineer, you will work for our Client - a global enterprise using science and imagination to advance health and nutrition. You will be working on cutting-edge solutions in the area of...
-
Senior Kotlin/Java Engineer
4 tygodni temu
Poznan, Polska N-iX Pełny etat(1642) We are looking for a talented Senior Kotlin Engineer to join our team in Poland. Our California-based customer is an American global e-commerce leader, one of the most popular and successful websites on the Internet. It provides platform services by connecting millions of sellers and buyers in more than 190 markets around the world. The Senior...
-
Senior AI ML Engineer
1 miesiąc temu
Poznan, Polska Sii Pełny etatJoin Sii and help develop highly specialized software and IT tools for legal, tax, accounting, trading, and compliance professionals, in conjunction with the world's largest information service! As a Senior AI/ML Engineer, you will be part of a global interdisciplinary team of experts driving the company's digital transformation. We are looking for a...
-
Mid/Senior DevOps Engineer
2 tygodni temu
Poznan, Polska Sigma Software Pełny etatJoin a fantastic opportunity to be part of a significant long-term project in the pharmacy sector. We are searching for a highly talented Senior DevOps Engineer with a strong background in designing and scaling centralized logging and metrics systems to join our team.As part of this role, you will focus on the development and enhancement of our innovative...
-
Senior DevOps Engineer
5 dni temu
Poznan, Polska ADB Polska Sp. z o.o. Pełny etattechnologies-expected : Kubernetes Docker Linux Red Hat Git Ansible Jenkins Python Bash PostgreSQL MySQL technologies-optional : Elasticsearch Logstash Kibana Grafana Prometheus AWS about-project : We are looking for an experienced Senior DevOps Engineer to help us improve our infrastructure by deploying, automating, monitoring, and maintaining our...
-
Senior Network Administrator
2 dni temu
Poznan, Polska NTT DATA Business Solutions Pełny etatNa czym będzie polegać Twoja praca? Rozwój i utrzymanie aktualnych struktur Data Center, zarówno logicznych jak i fizycznych Projektowanie i implementacja nowych technologii Data Center Zarządzanie urządzeniami sieciowymi i usługami własnymi i klientów (np. routery, przełączniki, zapory sieciowe, VPN) Współpraca z producentami i dostawcami...
-
Senior Data Scientist @ Sigma Software
4 tygodni temu
Poznan, Polska Sigma Software Pełny etatUnleash your ambition as a Senior Data Scientist! We are looking for a professional who not only has impressive experience in data science but is also ready to take on a driver role, contributing to our Data Competency Center within Sigma Software. The role will involve Solution assessment, pre-sales activities under supervision, architecture design...