Senior Data Engineer databricks

2 dni temu

Poznań, wielkopolskie, Polska BCF Software Sp. z o.o. Pełny etat

Project overview

Our client is embarking on a significant transformation project aimed at replatforming our financial system. Two initiatives will run in parallel: one for all financial and second for all non-financial data. We are in the early stages of an ambitious project to consolidate data from various sources into a single Delta Lake data warehouse.


Responsibilities

  • Lead the integration and ingestion of data from diverse sources into the Delta Lake platform, ensuring data consistency and availability.
  • Collaborate with various teams to identify all data sources, including SFTP / flat files, and APIs.
  • Design and implement systematic processes for data ingestion and integration.
  • Conduct extensive data analysis to support the consolidation of organizational data into a single data warehouse.
  • Utilize Databricks for data ingestion and reporting, transitioning data from multiple data warehouses to a unified Delta Lake platform.
  • Work closely with the development team to understand project scope, gather full requirements, and plan subsequent phases.
  • Participate in daily standups, sprint planning, backlog refinement, and retrospectives within a scaled scrum framework.
  • Exhibit flexibility and adaptability in navigating unknowns and evolving project requirements.


Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
  • Solid understanding of the software development life cycle.
  • Proven experience with Python, Spark and SQL for data engineering and analysis.
  • Strong data analysis skills, with the ability to interpret and manipulate large datasets.
  • Experience with Databricks for data ingestion and transformation.
  • Familiarity with Delta Lake and data warehousing concepts.
  • Excellent problem-solving skills and the ability to see the big picture and understand the broader context of assigned tasks.
  • Strong teamwork and collaboration skills, with a demonstrated ability to work effectively in a team-oriented environment.
  • Knowledge of reporting tools like Power BI.
  • Knowledge of Data Science concepts is a plus.
  • Strong communication, interpersonal and presentation skills.

  • Hyperscaler Engineer

    4 tygodni temu

    Poznań, wielkopolskie, Polska NTT DATA Business Solutions Pełny etat

    As an SAP full-service provider, we combine services of SAP-consulting, Software, Managed Cloud and Application Management for optimal solutions – delivered globally and tailored to our customer’s specific needs and goals. Benefit from our employee network with more than 10 000 SAP experts in 27 countries.Currently, we are looking for:Hyperscaler...

  • Hyperscaler Engineer

    2 miesięcy temu

    Poznań, wielkopolskie, Polska NTT DATA Business Solutions Pełny etat

    As an SAP full-service provider, we combine services of SAP-consulting, Software, Managed Cloud and Application Management for optimal solutions – delivered globally and tailored to our customer’s specific needs and goals. Benefit from our employee network with more than 10 000 SAP experts in 27 countries.Currently, we are looking for:Hyperscaler...

  • Senior QA Automation Engineer Computer Networking

    2 dni temu

    Poznań, wielkopolskie, Polska PLVision Pełny etat

    PLVision invites a Senior QA Automation Engineer to join our growing project. If you have excellent Python and Bash knowledge and hands-on experience with Layer 2/Layer 3 protocols testing, this opportunity is for you. In this role, you will verify SAI-like API and enable SONiC (Software for Open Networking in the Cloud) OS support on top of SAI (Switch...

  • Senior QA Engineer in Java

    2 dni temu

    Poznań, wielkopolskie, Polska InPost Pełny etat

    At InPost, were passionate about building software that helps our customers send and receive their goods. Our team create software for parcel machines that are currently being used widely by our customers. We are seeking an experienced QA Software Engineer with knowledge of Java to support us in building highly - scalable and highly-available applications....

  • Manager Data Consumer Tech Analytics

    2 dni temu

    Poznań, wielkopolskie, Polska Allegro Pełny etat

    Job DescriptionA hybrid work model requires 3 days a week in the office.We are looking for an experienced Manager, who will coordinate a team with various data roles (Data Analyst/Product Analyst/Data Engineer) that plays a key role in shaping different product for consumers at Allegro. The perfect candidate should not only possess strong analytical skills...

  • Senior Accountant

    3 tygodni temu

    Poznań, wielkopolskie, Polska Lumen Technologies Solutions Pełny etat

    The RoleThe Lumen Senior Accountant on our Expense team will contribute their accounting knowledge and business experience to closing the general ledger, including preparing journal entries, variance analysis and reporting results while gaining valuable experience regarding our product and service offerings and their associated margins.Additional...

  • Senior Accountant

    1 miesiąc temu

    Poznań, wielkopolskie, Polska Lumen Technologies Solutions Pełny etat

    The RoleThe Lumen Senior Accountant on our Expense team will contribute their accounting knowledge and business experience to closing the general ledger, including preparing journal entries, variance analysis and reporting results while gaining valuable experience regarding our product and service offerings and their associated margins.Additional...

  • DevOps Engineer

    4 tygodni temu

    Poznań, wielkopolskie, Polska DTP, Digital Technology Poland Pełny etat

    DTP dostarcza innowacyjne Software & Hardware w obszarze Industry 4.0. Pracuje z nami ponad 300 ekspertów gotowych zrealizować projekt od pomysłu do finalnego produktu. Nasze zespoły zlokalizowane są w Zielonej Górze, Poznaniu i Cieszynie.Obszary w których pracujemy to: Serwisy chmurowe, Internet rzeczy, Sztuczna inteligencja, Big Data, systemy...

  • DevOps Engineer

    1 miesiąc temu

    Poznań, wielkopolskie, Polska DTP, Digital Technology Poland Pełny etat

    DTP dostarcza innowacyjne Software & Hardware w obszarze Industry 4.0. Pracuje z nami ponad 300 ekspertów gotowych zrealizować projekt od pomysłu do finalnego produktu. Nasze zespoły zlokalizowane są w Zielonej Górze, Poznaniu i Cieszynie.Obszary w których pracujemy to: Serwisy chmurowe, Internet rzeczy, Sztuczna inteligencja, Big Data, systemy...

  • DevOps Engineer

    2 dni temu

    Poznań, wielkopolskie, Polska Schaeffler Global Services Europe Sp. z o.o. Pełny etat

    DevOps EngineerYour Key ResponsibilitiesBuild and maintain scalable and reliable cloud infrastructure. Implement and operate an enterprise data platform including tools like GitHub, Jenkins and Artifactory Establish and maintain monitoring and alerting systems to proactively identify and resolve performance issues Collaborate on improving the automation...

  • Lead/Senior Financial Analyst

    3 tygodni temu

    Poznań, wielkopolskie, Polska Lumen Technologies Solutions Pełny etat

    About LumenLumen connects the world. We are igniting business growth by connecting people, data and applications – quickly, securely, and effortlessly. Together, we are building a culture and company from the people up – committed to teamwork, trust and transparency. People power progress. We’re looking for top-tier talent and offer the flexibility you...

  • Lead/Senior Financial Analyst

    1 miesiąc temu

    Poznań, wielkopolskie, Polska Lumen Technologies Solutions Pełny etat

    About LumenLumen connects the world. We are igniting business growth by connecting people, data and applications – quickly, securely, and effortlessly. Together, we are building a culture and company from the people up – committed to teamwork, trust and transparency. People power progress. We’re looking for top-tier talent and offer the flexibility you...

  • Senior UI Designer Design system specialist

    2 dni temu

    Poznań, wielkopolskie, Polska Allegro Pełny etat

    Job DescriptionWe are looking for people who:Have significant experience designing usable, intuitive, and aesthetically-pleasing user interfacesHave a proven track record of creating and evolving multiplatform design systemsClearly and persuasively communicate the rationale for design choicesLove experimenting and do not shy away from bold ideas, propose...

  • Senior Data Engineer with Databricks

    2 tygodni temu

    Poznań, Greater Poland INSIGHT Pełny etat

    We assist our customers in developing IoT services, portals, and mobile apps and, above all, analyze data using AI and advanced analytics to reduce costs, streamline and find new opportunities for the business. Our goal is to grow strong, but not in numbers, but rather in competencies. We get things done and, on the way, we build a dynamic company culture to...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Sigma Software Pełny etat

    Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.CUSTOMER Sigma Software provides top-quality software development, graphic design, testing, and support services.Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming,...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Rite NRG Pełny etat

    Senior Data Engineer Poznań, Województwo wielkopolskie Senior Data Engineer Poznań Poznań, Greater Poland Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi...

  • Senior Data Engineer @

    2 tygodni temu

    Poznań, Greater Poland Capgemini Polska Sp. z o.o. Pełny etat

    Capgemini Engineering is a world leader in engineering and R&D services. We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds. Every day, we help our clients to accelerate their journey towards Intelligent Industry.At Capgemini, we are a responsible and...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Lite e-Commerce Pełny etat

    Senior Data Engineer Poznań, Województwo wielkopolskie Senior Data Engineer Poznań Poznań, Greater Poland Voivodeship, Polska Informacje: Lokalizacja: Poznań Poznań, Greater Poland Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Poznań - Ciekawe oferty pracy w okolicy:PoznańOferty pracy w okolicznych lokalizacjachPoznań: Inne...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Datumo Pełny etat

    Datumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects . Our team...

  • Senior Data Engineer Flink

    2 tygodni temu

    Poznań, Greater Poland GetInData | Part of Xebia Pełny etat

    Senior Data Engineer Flink Poznań, Województwo wielkopolskie Senior Data Engineer Flink Poznań Poznań, Greater Poland Voivodeship, Polska Informacje: Lokalizacja: Poznań Poznań, Greater Poland Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Poznań - Ciekawe oferty pracy w okolicy:PoznańOferty pracy w okolicznych...

  • Azure Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    We are currently looking for a Azure Data Engineer, who wishes to join our project.The main tasks will be: Develop and deploy data warehouse solution in Azure Cloud Design and implement data ingestion to Azure Storage services Creation of data transformations using Data Factory, Synapse Analytics, DatabricksRequired skillset: Azure Data Factory Azure Data...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland j-labs Pełny etat

    Senior Data Engineer Poznań, Województwo wielkopolskie Senior Data Engineer Poznań Poznań, Greater Poland Voivodeship, Polska Dołącz do zespołu odpowiedzialnego za przetwarzanie danych potrzebnych do generowania raportów.Masz okazję zostać częścią projektu, który ma na celu zrewolucjonizowanie branży zarządzania inwestycjami.Platforma pozwala...

  • Senior Data Engineer z

    2 tygodni temu

    Poznań, Greater Poland dmTECH Polska Pełny etat

    Senior Data Engineer z j.niemieckim Poznań, Województwo wielkopolskie Senior Data Engineer z j.niemieckim Poznań Poznań, Województwo wielkopolskie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii...

  • Senior Data Engineer Python Pyspark Cloud

    2 tygodni temu

    Poznań, Greater Poland Crestt Pełny etat

    Senior Data Engineer Python Pyspark Cloud Poznań, Województwo wielkopolskie Senior Data Engineer Python Pyspark Cloud Poznań Poznań, Greater Poland Voivodeship, Polska CześćJako Senior/Lead Data Engineer będziesz miał możliwość pracy nad kluczowym projektem naszego klienta, który obejmuje budowanie mechanizmu składowania danych decyzyjnych....

  • Senior Data Engineer z jniemieckim

    2 tygodni temu

    Poznań, Greater Poland dmTECH Polska Pełny etat

    Senior Data Engineer z jniemieckim Poznań, Województwo wielkopolskie Senior Data Engineer z jniemieckim Poznań Poznań, Greater Poland Voivodeship, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland CLOUDFIDE Pełny etat

    ABOUT USAt CLOUDFIDE, we do everything with data and contribute to pivotal projects for Fortune 500 companies. This is your chance to enhance your skills and leave your global footprint.Our collaborative culture champions your professional growth. Dive into cloud data processing, gain hands-on big data experience, and leverage our team's expertise to drive...

  • Data Scientist mid senior

    2 tygodni temu

    Poznań, Greater Poland Square One Pełny etat

    Data Scientist mid senior Poznań, Województwo wielkopolskie W Square One Resources już od ponad 20 lat pomagamy firmom zarządzać procesami rekrutacyjnymi na szeroką skalę. Nasze biura zlokalizowane są w Londynie i Warszawie, ale relacje nawiązujemy z klientami z całego świata, od start-upów po globalne korporacje. Poza dobrymi relacjami z naszymi...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Shaped Thoughts Pełny etat

    We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector.Who are we?We are a remote-first boutique software house company formed by a group of seasoned software experts (the average experience in the team is 12 years). What connected all of us, despite a...

  • Senior Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Ework Group Pełny etat

    We are seeking a skilled and experienced Data Engineer to join our client (pharmaceutical area) team. The ideal candidate will have a strong background in data architecture, data modeling, data warehousing and ETL processes. The Data Engineer will be responsible for designing, building, and maintaining the data infrastructure that supports our organization's...

  • Senior Cloud Data Engineer Azure and Snowflake

    2 tygodni temu

    Poznań, Greater Poland Future Processing Pełny etat

    Senior Cloud Data Engineer Azure and Snowflake Poznań, Województwo wielkopolskie Senior Cloud Data Engineer Azure and Snowflake Poznań Poznań, Greater Poland Voivodeship, Polska Szukamy Ciebie, jeśli:masz min. 5 lat doświadczenia w IT, w tym min. 3, 5 roku w pracy z danymi w chmurze (potwierdzone projektami komercyjnymi wdrożonymi na...

  • Senior Data Engineer Azure

    2 tygodni temu

    Poznań, Greater Poland GetInData | Part of Xebia Pełny etat

    Who are GetInData | Part of Xebia? GetInData | Part of Xebia is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Experis ManpowerGroup Sp. z o.o. Pełny etat

    Data Engineer We are seeking a talented Data Engineer with 4+ years of experience to join our dynamic team. The ideal candidate will be passionate about transforming raw data into valuable insights and possess a strong proficiency in SQL, T-SQL, and various data manipulation and visualization tools. If you're looking for an opportunity to work with...

  • Data Engineer

    2 tygodni temu

    Poznań, Greater Poland Mindpal Pełny etat

    Technologies-expected : SQL Python about-project : We are looking for a Data Engineer (Snowflake) to join the team at Mind Pal, working for our key client in the technology sector.We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...