Senior Data Engineer

6 dni temu


Poznan, Polska BCF Software Sp. z o.o. Pełny etat

Project overview
Our client is embarking on a significant transformation project aimed at replatforming our financial system. Two initiatives will run in parallel: one for all financial and second for all non-financial data. We are in the early stages of an ambitious project to consolidate data from various sources into a single Delta Lake data warehouse.

Responsibilities
Lead the integration and ingestion of data from diverse sources into the Delta Lake platform, ensuring data consistency and availability.
Collaborate with various teams to identify all data sources, including SFTP / flat files, and APIs.
Design and implement systematic processes for data ingestion and integration.
Conduct extensive data analysis to support the consolidation of organizational data into a single data warehouse.
Utilize Databricks for data ingestion and reporting, transitioning data from multiple data warehouses to a unified Delta Lake platform.
Work closely with the development team to understand project scope, gather full requirements, and plan subsequent phases.
Participate in daily standups, sprint planning, backlog refinement, and retrospectives within a scaled scrum framework.
Exhibit flexibility and adaptability in navigating unknowns and evolving project requirements.

Requirements
Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
Solid understanding of the software development life cycle.
Proven experience with Python, Spark and SQL for data engineering and analysis.
Strong data analysis skills, with the ability to interpret and manipulate large datasets.
Experience with Databricks for data ingestion and transformation.
Familiarity with Delta Lake and data warehousing concepts.
Excellent problem-solving skills and the ability to see the big picture and understand the broader context of assigned tasks.
Strong teamwork and collaboration skills, with a demonstrated ability to work effectively in a team-oriented environment.
Knowledge of reporting tools like Power BI.
Knowledge of Data Science concepts is a plus.
Strong communication, interpersonal and presentation skills.


  • Senior Data Engineer

    4 tygodni temu


    Poznan, Polska Rite NRG Pełny etat

    Dołącz do naszej ekipy  Rite NRG  jako  Senior Data Engineer  i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi. Jakimi umiejętnościami możesz się pochwalić? Jesteś ekspertem w korzystaniu z narzędzi  AWS, Bardzo dobrze znasz...

  • Senior Data Engineer

    4 tygodni temu


    Poznan, Polska Shaped Thoughts Pełny etat

    We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector. Who are we ? We are a remote-first boutique software house company formed by a group of seasoned software experts (the average experience in the team is 12 years). What connected all of us,...

  • Senior Data Engineer

    4 tygodni temu


    Poznan, Polska Opensignal Pełny etat

    Job title:  Senior Data Engineer (MS SQL) Department:  Engineering Reporting to:  Engineering Manager Location:  Poland Purpose of Role We’re looking for a Senior Data Engineer to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our...

  • Senior Data Engineer

    4 tygodni temu


    Poznan, Polska Amer Sports Pełny etat

    ❄️ Mid/Senior Data Engineer (Snowflake) ❄️ Hybrid /Remote work, Cracow You will be part of the Enterprise Data & Analytics team, building strong ties with our international teams in North America and Asia to ensure seamless database operations. Your role is crucial in safeguarding data integrity, optimizing processes, and supporting the diverse...

  • Senior Big Data Engineer

    1 tydzień temu


    Poznan, Polska Capgemini Polska Sp. z o.o. Pełny etat

    YOUR ROLE As a Senior Engineer, you will build distributed data processing solution and highly loaded database solutions for various businesses cases including reporting, product analytics, marketing optimization and financial reporting. Contribute as part of self-organized team of experienced data engineers working in a challenging, innovative environment...

  • Data Engineer

    1 tydzień temu


    Poznan, Polska MindPal Pełny etat

    Data Engineer Miejsce pracy: Poznań Technologies we use Expected Python SQL AWS About the project We are looking for a Data Engineer to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an...

  • Senior Backend Developer

    1 tydzień temu


    Poznan, Polska Data System Pełny etat

    Hej! Tutaj Data System. Przez ponad 18 lat świadczymy dla naszych klientów usługi monitoringu i lokalizacji pojazdów. Jest w tym sporo zabawy. Nasze małe lokalizatory, nie tylko pomagają znaleźć samochód w gąszczu innych na parkingu, ale też umożliwiają łatwe i precyzyjne rozliczanie przejazdów po płatnych drogach dzięki systemowi e-Toll....

  • Senior Data Engineer

    2 tygodni temu


    Poznan, Polska Datumo Pełny etat

    Datumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects .Our team...

  • Data Engineer

    4 tygodni temu


    Poznan, Polska MindPal Pełny etat

    technologies-expected : SQL Python about-project : We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Data Engineer

    1 miesiąc temu


    Poznan, Polska Pragmile Pełny etat

    Pragmile is running an innovative research & development project for a large Polish institution which should result in a unique solution to monitor media market. We're looking for an experienced engineer who could support us in the successful execution and delivery. Requirements: Strong understanding of data structures and algorithms Strong understanding of...

  • Data Engineer

    1 tydzień temu


    Poznan, Polska Ework Group Pełny etat

    For our client - a company from pharmaceutical area, we are looking for Data Engineer. What you will be doing You will be close to the heart of our client’s clinical operations where you will play a key role in shaping the future of clinical trials and patient care, by building scalable solutions in the cloud. Your key responsibilities include the...


  • Poznan, Polska NTT DATA Business Solutions Pełny etat

    That is what makes the NTT DATA Business Solutions spirit special: Team-oriented corporate culture, collaboration as equals and steady knowledge transfer Sustainable career development in a growth-oriented technology environment with a business focus on SAP full service (financing certificates and trainings) Remote work possibilities Benefits f.e. private...


  • Poznan, Polska Egnyte Poland Pełny etat

    Senior QA Automation Engineer Egnyte is the secure multi-cloud platform for content security and governance that enables organizations to better protect and collaborate on their most valuable content. Established in 2008, Egnyte has democratized cloud content security for more than 22,000 organizations, helping customers improve data security, maintain...

  • Data Engineer

    1 tydzień temu


    Poznan, Polska ITDS Pełny etat

    Become a pioneer in smart crop science development with us! Warsaw-based opportunity with possibility to work partly remote (only 2 x month visits in office) As a  Data Engineer,  you will work for our Client - a global enterprise using science and imagination to advance health and nutrition. You will be working on cutting-edge solutions in the area of...


  • Poznan, Polska N-iX Pełny etat

    (1642) We are looking for a talented  Senior Kotlin Engineer  to join our team in Poland. Our California-based customer is an American global e-commerce leader, one of the most popular and successful websites on the Internet. It provides platform services by connecting millions of sellers and buyers in more than 190 markets around the world. The Senior...

  • Senior AI ML Engineer

    1 miesiąc temu


    Poznan, Polska Sii Pełny etat

    Join Sii and help develop highly specialized software and IT tools for legal, tax, accounting, trading, and compliance professionals, in conjunction with the world's largest information service! As a Senior AI/ML Engineer, you will be part of a global interdisciplinary team of experts driving the company's digital transformation. We are looking for a...


  • Poznan, Polska Sigma Software Pełny etat

    Join a fantastic opportunity to be part of a significant long-term project in the pharmacy sector. We are searching for a highly talented Senior DevOps Engineer with a strong background in designing and scaling centralized logging and metrics systems to join our team.As part of this role, you will focus on the development and enhancement of our innovative...


  • Poznan, Polska ADB Polska Sp. z o.o. Pełny etat

    technologies-expected : Kubernetes Docker Linux Red Hat Git Ansible Jenkins Python Bash PostgreSQL MySQL technologies-optional : Elasticsearch Logstash Kibana Grafana Prometheus AWS about-project : We are looking for an experienced Senior DevOps Engineer to help us improve our infrastructure by deploying, automating, monitoring, and maintaining our...


  • Poznan, Polska NTT DATA Business Solutions Pełny etat

    Na czym będzie polegać Twoja praca? Rozwój i utrzymanie aktualnych struktur Data Center, zarówno logicznych jak i fizycznych Projektowanie i implementacja nowych technologii Data Center Zarządzanie urządzeniami sieciowymi i usługami własnymi i klientów (np. routery, przełączniki, zapory sieciowe, VPN) Współpraca z producentami i dostawcami...


  • Poznan, Polska Sigma Software Pełny etat

    Unleash your ambition as a Senior Data Scientist! We are looking for a professional who not only has impressive experience in data science but is also ready to take on a driver role, contributing to our Data Competency Center within Sigma Software. The role will involve Solution assessment, pre-sales activities under supervision, architecture design...