Aktualne oferty pracy związane z Big Data Engineer - Warszawa, mazowieckie - Collabera Digital


  • Warszawa, mazowieckie, Polska mBank Pełny etat

    Jesteśmy 12 osobowym zespołem pracującym w SCRUMie w obszarze Big Data. Realizujemy projekty biznesowe jak i te R&D. Moglibyśmy o nich opowiadać godzinami, ale krótko nakreślając. Jesteśmy odpowiedzialni m.in za implementację rozwiązań z zakresu przetwarzania streamingowego (znacznie skróciliśmy czas ładowania danych pod raporting w banku)....


  • Warszawa, mazowieckie, Polska PKO BANK POLSKI S.A. Pełny etat

    Dołącz do nas jako: MLOPS ENGINEER/STARSZY SPECJALISTA DS. BIG DATA RYZYKA KREDYTOWEGOBiuro Informacji Ryzyka Kredytowego - Warszawa, Świętokrzyska 36Na co dzień w naszym zespole:utrzymujesz i rozwijasz platformę MLOps, która pozwala zespołom Data Science efektywnie budować modele ML,testujesz, monitorujesz, poprawiasz wydajność działania modeli...

  • Senior Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Tangome Poland Sp. z o.o. Pełny etat

    Description Tango is a successful, market leader, a live-streaming Platform with 500+ Million registered users, in an industry projected to reach $240 BILLION in the next couple of years. The B2C platform, based on the best-quality global video technology, allows millions of talented people around the world to create their own live content, engage with their...

  • Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska Formula5 Pełny etat

    About UsFormula5 is a dynamic and expanding data consulting firm specializing in Microsoft Azure's cutting-edge technologies, including the powerful Microsoft Fabric suite. We cultivate a collaborative and supportive atmosphere where your individual growth is as important as our collective success. Join our passionate team and shape innovative data...

  • Senior Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska Sorigo Pełny etat

    W Sorigo zajmujemy się wdrażaniem innowacyjnych rozwiązań w obszarze IT. Mamy kilkunastoletnie doświadczenie we współpracy partnerskiej z dużymi klientami. Wierzymy także, że praca powinna dawać ludziom satysfakcje, a nie być tylko obowiązkiem. Choć czasami znalezienie odpowiedniego dla siebie miejsca wymaga czasu i dobrego ukierunkowania przez...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska BlueCloud Pełny etat

    As a Senior Data Engineer at BlueCloud, you will:•Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements•Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Sorigo Pełny etat

    W Sorigo zajmujemy się wdrażaniem innowacyjnych rozwiązań w obszarze IT. Mamy kilkunastoletnie doświadczenie we współpracy partnerskiej z dużymi klientami. Wierzymy także, że praca powinna dawać ludziom satysfakcje, a nie być tylko obowiązkiem. Choć czasami znalezienie odpowiedniego dla siebie miejsca wymaga czasu i dobrego ukierunkowania przez...


  • Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you have:hands-on experience building complex data pipelines,strong experience in data processing and optimization using Apache Spark, good knowledge of data manipulation and transformation,experience with Apache Airflow, Python, SQL, knowledge of software engineering best practices, deployment and provisioning automation tools...

  • Data Engineer

    6 dni temu


    Warszawa, mazowieckie, Polska Clouds on Mars Sp. z o.o. Pełny etat

    Your responsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer’s sideDesiging DWH architectureDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating of DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh concepts We...


  • Warszawa, mazowieckie, Polska BlueSoft Pełny etat

    Project description:Due to the planned expansion of the team working on building a corporate Data Warehouses / Data Lakehouse in Azure Cloud for one of the largest retail clients in Poland, we are looking for a Senior Data Engineer/Data Platform Architect to join us in this project. Additionally, we aim to strengthen the internal Microsoft Competence Center...

  • Data Engineer

    2 tygodni temu


    Warszawa, mazowieckie, Polska Transition Technologies MS Pełny etat

    We offer:Participation in interesting and challenging projectsFlexible working hoursA great, non-corporate atmosphereStable employment conditions (contract of employment or B2B contract)Opportunities for development and promotionAttractive package of benefitsRemote workYour tasks:The responsibilities of this person will include development of components...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etat

    Join our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...

  • Data Analyst

    2 miesięcy temu


    Warszawa, mazowieckie, Polska Kordian Group sp zoo Pełny etat

    About the CompanyKordian Group and our sister company, Akord LLC, extend and complement IT for marquee brands across the world.We are building and operating excellence centers for clients operating in the United States, Canada, Netherlands, Germany and several other European countries. We work with the latest technologies in data analysis, software...

  • Data Engineer Bank Fraud

    2 tygodni temu


    Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etat

    We are looking for you, if you:have hands-on experience building complex data pipelines,have strong experience in data processing and optimization using Apache Spark,have good knowledge of data manipulation and transformation, have experience with Apache Airflow, Python, SQL, have knowledge of software engineering best practices, have deployment and...


  • Warszawa, mazowieckie, Polska Google Pełny etat

    About the jobIn this role, you will guide customers on how to ingest, store, process, analyze, and explore/visualize data on the Google Cloud Platform. You will work on data migrations and modernization projects, and with customers to design large-scale data processing systems, develop data pipelines optimized for scaling, and troubleshoot potential...

  • Machine Learning Engineer

    1 tydzień temu


    Warszawa, mazowieckie, Polska adQuery Pełny etat

    AdQuery firma z branży AdTech, która dzięki autorskim narzędziom zapewnia kompleksową obsługę w zakresie kampanii digitalowych. Obecnie do naszego zespołu szukamy osoby na stanowisko:Machine Learning Engineer miejsce pracy: Warszawa, MokotówPoszukujemy doświadczonego Machine Learning Engineer do projektu, który wykorzystuje technologie Symfony,...

  • Senior Data Engineer

    2 tygodni temu


    Warszawa, mazowieckie, Polska VISA Pełny etat

    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network,...


  • Warszawa, mazowieckie, Polska Paramount Pełny etat

    At Paramount Networks International (part of Paramount Global), we have an iconic portfolio of brands, like Paramount Pictures, MTV, Nickelodeon, Channel 5, Comedy Central and many more, reaching more than 3.8 billion subscribers in 180+ countries and territories, via more than 200 locally programmed and operated TV channels and more than 550 digital media...


  • Warszawa, mazowieckie, Polska ITLT Pełny etat

    IT LeasingTeam realizuje usługi w zakresie pozyskiwania dla organizacji wysokiej klasy specjalistów i kadry zarządzającej z obszaru IT a także rozwija i wdraża nowoczesne rozwiązania IT w ramach outsourcingu procesów. IT LeasingTeam wspiera procesy biznesowe firm, umożliwiając im zwiększenie elastyczności i budowanie przewagi...

  • Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska emagine Polska Pełny etat

    Industry: FintechWork model: hybrid (3 days/week working from the Warsaw office)Contract’s length: B2B, long-term cooperationProject language: EnglishStart: ASAP / 1 month notice period1. SQL / Redshift and/or PySpark: Essential for building data pipelines and transformations at scale2. Git: Required for version control and collaboration3. Apache...

Big Data Engineer

2 miesięcy temu


Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment


Roles & Responsibilities:
  • To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…
  • To use Scrum methodology, and be part of a high-performance team
  • To document your solutions in the project partner tools: JIRA, Confluence, ALM.
  • To certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team's delivery

Requirement:-
  • More than 5 years of experience with Spark with Scala, software design patterns, and TDD
  • Experience working with big data – Spark, Hadoop, Hive is a must – Azure Databricks be a plus
  • Agile approach for software development
  • Experience and expertise across data integration and data management with high data volumes
  • Experience working in Agile
  • Continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
  • Experience with different database structures, including (Postgres, SQL, Hive)
  • English (at least B2+)