Azure Databricks Engineer mid senior

1 miesiąc temu


Warszawa, mazowieckie, Polska BlueSoft Pełny etat

Responsibilities:


  • designing and implementing extremely efficient data ingestion and wrangling pipelines from various kind of sources (volumes up to hundreds of terabytes) into Delta Lake (Azure Databricks);
  • orchestrating data processing on various stages;
  • creating and executing automated tests for the purposes of validation;
  • providing insights on the latest technologies which might be later used by clients


Must-have: 


  • 3+ years of experience in area of data processing, esp. Databricks, including optimizations;
  • familiar with Databricks, Delta Lake and its core concepts;
  • good knowledge of Microsoft Azure cloud services (Azure Data Factory, Azure Key Vault, Azure Data Lake Storage Gen2);
  • programming skills in Python;
  • proficiency in Spark/Databricks SQL;
  • experience in collaborative work on code using Git.


Nice-to-have:


  • familiar with DataOps approach;
  • cloud certificates;
  • good knowledge of English (spoken and written).


We offer:


  • ‍ Work in a team of interdisciplinary experts and technology enthusiasts, inspired by working in a flat hierarchy;
  • Permanent full-time cooperation in an extraordinary company, which has been growing dynamically for more than 20 years;
  • Possibility of development in various IT projects realized for well-known and recognizable clients – leaders in their industries;
  • The ability to work with the latest technologies and the highest standards of development;
  • ⌚️ Flexible working hours and a hybrid or fully remote working model (different arrangements apply in different teams, we do not impose any options);
  • ☁ A number of initiatives supporting knowledge sharing and development, such as: internal training, thematic guilds, Cloud training and certification opportunities (technology partnerships in four clouds);
  • Possibility to learn English or German online and English lessons for teams;
  • ️‍♂️ Multisport card and medical insurance;
  • ⛵️ Sea adventures co-financed by company – we regularly sail in the Caribbean, Mediterranean or North Sea.



  • Data Engineer Databricks

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat

    Experis to światowy lider w rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujące projekty IT skierowane zarówno do doświadczonych ekspertów, jak i osób rozpoczynających karierę w branży IT. Obecnie, dla naszego klienta realizującego projekty w branży...


  • Warszawa, mazowieckie, Polska Capgemini Polska Pełny etat

    Senior Azure Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations...


  • Warszawa, mazowieckie, Polska BlueSoft Pełny etat

    Project description:Due to the planned expansion of the team working on building a corporate Data Warehouses / Data Lakehouse in Azure Cloud for one of the largest retail clients in Poland, we are looking for a Senior Data Engineer/Data Platform Architect to join us in this project. Additionally, we aim to strengthen the internal Microsoft Competence Center...

  • Senior Azure Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska KPMG Pełny etat

    Job title descriptionBudowa chmurowych rozwiązań procesujących daneProjektowanie, utrzymanie oraz wdrażanie przepływów danych wsadowych włączając w to procesy ELT, oraz integracje pomiędzy systemami chmurowymi i systemami on-premisesProjektowanie, utrzymanie oraz wdrażanie przepływów danych strumieniowychWdrażania rozwiązań Data...

  • Azure Data Engineer

    2 dni temu


    Warszawa, mazowieckie, Polska Nexio Management Pełny etat

    Nexio Management is a Polish technology company with over 16 years of experience in the market. Currently, we employ more than 500 consultants across our competency centers, providing IT services to clients worldwide. Nexio Management is headquartered in Warsaw, with additional offices located in Wrocław, Romania, and the United Kingdom. As part of our...


  • Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data. Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms. Integrating and transforming data to...


  • Warszawa, mazowieckie, Polska RED Global Pełny etat

    RemoteUp to 200 PLN per hourOur client is for experts in the area of designing and migrating corporate applications to the Azure cloud. Key responsibilitiesdevelopment of architectural standards in the field of hybrid infrastructure,selection of appropriate hardware and system solutions with high performance in the field of hybrid infrastructure,verification...


  • Warszawa, mazowieckie, Polska EPAM Systems Pełny etat

    We are currently seeking a qualified Azure Support Engineer to join our team.As an Azure Support Engineer, you'll assist in providing Level 1 support for our current Azure DevOps pipelines, ensuring optimal performance and user satisfaction. You'll collaborate closely with development teams and vendors to troubleshoot, enhance, and maintain our Azure...

  • Mid Senior Data Scientist

    2 tygodni temu


    Warszawa, mazowieckie, Polska Surfshark Pełny etat

    Our Data Science team, working with Surfshark and Incogni products, is looking for a skilled Mid/Senior Data Scientist. Work challenges span from time series modeling and attribution models to NLP and generative AI.We are dedicated to a value-driven approach and are deeply committed to contributing to the growth and success of our products. If you are...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:-- To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…- To use Scrum...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…To use Scrum methodology,...

  • Administrator Azure

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Bank Millennium Pełny etat

    Zadania:Administrowanie oraz realizacja zadań związanych z prawidłowym funkcjonowaniem systemów informatycznych na platformie MS Azure ze szczególnym uwzględnieniem aspektów bezpieczeństwaPlanowanie, testowanie i wprowadzanie zmian w dużym środowisku Azure adekwatnie do postępującego rozwoju i nowych wymagań, w tym automatyzacji, delegacji...


  • Warszawa, mazowieckie, Polska EPAM Systems Pełny etat

    We are seeking a highly skilled Senior DevOps .NET Engineer to join our dynamic team.This role involves maintaining and supporting our Azure Automatic operator and Azure functions, currently in development. The ideal candidate will focus on development, configuration, compliance, automation scripting, and documentation, ensuring smooth and efficient CI/CD...


  • Warszawa, mazowieckie, Polska Lingaro Pełny etat

    Tasks:Team Leadership, mostly in the scope of Tech Lead. Ability to work in the team of people from different companies.Business requirements understanding in order to maintain the backlog and perform data modelling activities for the dev team.Keeping the architecture of a solution clean and up to date (e.g. proper use of medallion architecture and...

  • Data Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    ​As a Data Engineer in D&A Scaled Analytical Products, you will play a crucial role in designing, developing, and implementing data solutions that enable data-driven decision-making across the organization. You will collaborate with cross-functional teams to acquire, transform, and optimize data from various sources. Your technical expertise and innovative...


  • Warszawa, mazowieckie, Polska GPW Pełny etat

    Giełda Papierów Wartościowych w Warszawie SA poszukuje kandydatki/kandydata na stanowisko: Starszy Inżynier Systemów PAM (Senior PAM Engineer) Miejsce pracy: Warszawa/praca hybrydowa Nr ref.: SISPAM/DI/2024 Zakres zadań: • projektowanie, rozwijanie oraz utrzymywanie bezpiecznych rozwiązań w zakresie zarządzania dostępem uprzywilejowanym, •...

  • Senior DevOps

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Hemolens Diagnostics Pełny etat

    Hemolens Diagnostics to polska firma, specjalizująca się w diagnostyce kardiologicznej. Nasz zespół składający się z bioinżynierów, kardiologów i specjalistów IT stworzył innowacyjną, nieinwazyjną metodę diagnostyki choroby wieńcowej serca w oparciu o algorytmy numerycznej mechaniki płynów (CFD). Technologia oferowana przez Hemolens...

  • EPM Konsultant

    2 miesięcy temu


    Warszawa, mazowieckie, Polska IT CONNECT Pełny etat

    O projekcie:Poszukujemy doświadczonych specjalistów, fanów technologii chmurowej, mogących wesprzeć zespół naszego klienta w przeprowadzaniu użytkowników przez ścieżkę transformacji cyfrowej w kierunku organizacji opartej na danych, gdzie dane przekształcone w użyteczną informację biznesową stają się jednym z najważniejszych aktywów...


  • Warszawa, mazowieckie, Polska PeakData Pełny etat

    About Us PeakData is a Swiss-based AI startup revolutionizing healthcare by helping patients receive the best treatment available. We empower pharmaceutical companies to enhance their commercial and medical efforts through intelligent healthcare professional identification and engagement. The Opportunity We're seeking a talented Junior to Mid-level Data...


  • Warszawa, mazowieckie, Polska Samsung R&D Institute Poland Pełny etat

    Senior Software Engineer for Managed Database ServiceAbout our TeamOn a daily basis, we build and maintain Samsung Private Cloud, the platform for internal company needs. We are looking for a Senior Software Engineer responsible for the development of cloud database and cloud data warehouse solutions.Role and ResponsibilitiesDelivering microservices into a...