Azure Databricks Engineer mid senior
1 miesiąc temu
Responsibilities:
- designing and implementing extremely efficient data ingestion and wrangling pipelines from various kind of sources (volumes up to hundreds of terabytes) into Delta Lake (Azure Databricks);
- orchestrating data processing on various stages;
- creating and executing automated tests for the purposes of validation;
- providing insights on the latest technologies which might be later used by clients
Must-have:
- 3+ years of experience in area of data processing, esp. Databricks, including optimizations;
- familiar with Databricks, Delta Lake and its core concepts;
- good knowledge of Microsoft Azure cloud services (Azure Data Factory, Azure Key Vault, Azure Data Lake Storage Gen2);
- programming skills in Python;
- proficiency in Spark/Databricks SQL;
- experience in collaborative work on code using Git.
Nice-to-have:
- familiar with DataOps approach;
- cloud certificates;
- good knowledge of English (spoken and written).
We offer:
- Work in a team of interdisciplinary experts and technology enthusiasts, inspired by working in a flat hierarchy;
- Permanent full-time cooperation in an extraordinary company, which has been growing dynamically for more than 20 years;
- Possibility of development in various IT projects realized for well-known and recognizable clients – leaders in their industries;
- The ability to work with the latest technologies and the highest standards of development;
- ⌚️ Flexible working hours and a hybrid or fully remote working model (different arrangements apply in different teams, we do not impose any options);
- ☁ A number of initiatives supporting knowledge sharing and development, such as: internal training, thematic guilds, Cloud training and certification opportunities (technology partnerships in four clouds);
- Possibility to learn English or German online and English lessons for teams;
- ️♂️ Multisport card and medical insurance;
- ⛵️ Sea adventures co-financed by company – we regularly sail in the Caribbean, Mediterranean or North Sea.
-
Data Engineer Databricks
3 miesięcy temu
Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etatExperis to światowy lider w rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujące projekty IT skierowane zarówno do doświadczonych ekspertów, jak i osób rozpoczynających karierę w branży IT. Obecnie, dla naszego klienta realizującego projekty w branży...
-
Senior Azure Data Engineer
2 tygodni temu
Warszawa, mazowieckie, Polska Capgemini Polska Pełny etatSenior Azure Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations...
-
Senior Data Engineer Data Platform Architect
1 tydzień temu
Warszawa, mazowieckie, Polska BlueSoft Pełny etatProject description:Due to the planned expansion of the team working on building a corporate Data Warehouses / Data Lakehouse in Azure Cloud for one of the largest retail clients in Poland, we are looking for a Senior Data Engineer/Data Platform Architect to join us in this project. Additionally, we aim to strengthen the internal Microsoft Competence Center...
-
Senior Azure Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska KPMG Pełny etatJob title descriptionBudowa chmurowych rozwiązań procesujących daneProjektowanie, utrzymanie oraz wdrażanie przepływów danych wsadowych włączając w to procesy ELT, oraz integracje pomiędzy systemami chmurowymi i systemami on-premisesProjektowanie, utrzymanie oraz wdrażanie przepływów danych strumieniowychWdrażania rozwiązań Data...
-
Azure Data Engineer
2 dni temu
Warszawa, mazowieckie, Polska Nexio Management Pełny etatNexio Management is a Polish technology company with over 16 years of experience in the market. Currently, we employ more than 500 consultants across our competency centers, providing IT services to clients worldwide. Nexio Management is headquartered in Warsaw, with additional offices located in Wrocław, Romania, and the United Kingdom. As part of our...
-
Senior Azure Data Engineer
3 dni temu
Warszawa, mazowieckie, Polska Lingaro Pełny etatTasks:Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data. Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms. Integrating and transforming data to...
-
Azure Engineer Azure Architect
1 miesiąc temu
Warszawa, mazowieckie, Polska RED Global Pełny etatRemoteUp to 200 PLN per hourOur client is for experts in the area of designing and migrating corporate applications to the Azure cloud. Key responsibilitiesdevelopment of architectural standards in the field of hybrid infrastructure,selection of appropriate hardware and system solutions with high performance in the field of hybrid infrastructure,verification...
-
Azure Support Engineer
3 dni temu
Warszawa, mazowieckie, Polska EPAM Systems Pełny etatWe are currently seeking a qualified Azure Support Engineer to join our team.As an Azure Support Engineer, you'll assist in providing Level 1 support for our current Azure DevOps pipelines, ensuring optimal performance and user satisfaction. You'll collaborate closely with development teams and vendors to troubleshoot, enhance, and maintain our Azure...
-
Mid Senior Data Scientist
2 tygodni temu
Warszawa, mazowieckie, Polska Surfshark Pełny etatOur Data Science team, working with Surfshark and Incogni products, is looking for a skilled Mid/Senior Data Scientist. Work challenges span from time series modeling and attribution models to NLP and generative AI.We are dedicated to a value-driven approach and are deeply committed to contributing to the growth and success of our products. If you are...
-
Big Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Collabera Digital Pełny etatJoin our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:-- To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…- To use Scrum...
-
Big Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Collabera Digital Pełny etatJoin our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…To use Scrum methodology,...
-
Administrator Azure
1 miesiąc temu
Warszawa, mazowieckie, Polska Bank Millennium Pełny etatZadania:Administrowanie oraz realizacja zadań związanych z prawidłowym funkcjonowaniem systemów informatycznych na platformie MS Azure ze szczególnym uwzględnieniem aspektów bezpieczeństwaPlanowanie, testowanie i wprowadzanie zmian w dużym środowisku Azure adekwatnie do postępującego rozwoju i nowych wymagań, w tym automatyzacji, delegacji...
-
Senior DevOps NET Engineer
21 godzin temu
Warszawa, mazowieckie, Polska EPAM Systems Pełny etatWe are seeking a highly skilled Senior DevOps .NET Engineer to join our dynamic team.This role involves maintaining and supporting our Azure Automatic operator and Azure functions, currently in development. The ideal candidate will focus on development, configuration, compliance, automation scripting, and documentation, ensuring smooth and efficient CI/CD...
-
Senior Data Engineering Tech Lead
3 dni temu
Warszawa, mazowieckie, Polska Lingaro Pełny etatTasks:Team Leadership, mostly in the scope of Tech Lead. Ability to work in the team of people from different companies.Business requirements understanding in order to maintain the backlog and perform data modelling activities for the dev team.Keeping the architecture of a solution clean and up to date (e.g. proper use of medallion architecture and...
-
Data Engineer
3 miesięcy temu
Warszawa, mazowieckie, Polska Procter & Gamble Pełny etatAs a Data Engineer in D&A Scaled Analytical Products, you will play a crucial role in designing, developing, and implementing data solutions that enable data-driven decision-making across the organization. You will collaborate with cross-functional teams to acquire, transform, and optimize data from various sources. Your technical expertise and innovative...
-
Starszy Inżynier Systemów PAM Senior PAM Engineer
21 godzin temu
Warszawa, mazowieckie, Polska GPW Pełny etatGiełda Papierów Wartościowych w Warszawie SA poszukuje kandydatki/kandydata na stanowisko: Starszy Inżynier Systemów PAM (Senior PAM Engineer) Miejsce pracy: Warszawa/praca hybrydowa Nr ref.: SISPAM/DI/2024 Zakres zadań: • projektowanie, rozwijanie oraz utrzymywanie bezpiecznych rozwiązań w zakresie zarządzania dostępem uprzywilejowanym, •...
-
Senior DevOps
1 miesiąc temu
Warszawa, mazowieckie, Polska Hemolens Diagnostics Pełny etatHemolens Diagnostics to polska firma, specjalizująca się w diagnostyce kardiologicznej. Nasz zespół składający się z bioinżynierów, kardiologów i specjalistów IT stworzył innowacyjną, nieinwazyjną metodę diagnostyki choroby wieńcowej serca w oparciu o algorytmy numerycznej mechaniki płynów (CFD). Technologia oferowana przez Hemolens...
-
EPM Konsultant
2 miesięcy temu
Warszawa, mazowieckie, Polska IT CONNECT Pełny etatO projekcie:Poszukujemy doświadczonych specjalistów, fanów technologii chmurowej, mogących wesprzeć zespół naszego klienta w przeprowadzaniu użytkowników przez ścieżkę transformacji cyfrowej w kierunku organizacji opartej na danych, gdzie dane przekształcone w użyteczną informację biznesową stają się jednym z najważniejszych aktywów...
-
Junior Mid Data Engineer at PeakData
2 dni temu
Warszawa, mazowieckie, Polska PeakData Pełny etatAbout Us PeakData is a Swiss-based AI startup revolutionizing healthcare by helping patients receive the best treatment available. We empower pharmaceutical companies to enhance their commercial and medical efforts through intelligent healthcare professional identification and engagement. The Opportunity We're seeking a talented Junior to Mid-level Data...
-
Senior Software Engineer for Database Service
4 miesięcy temu
Warszawa, mazowieckie, Polska Samsung R&D Institute Poland Pełny etatSenior Software Engineer for Managed Database ServiceAbout our TeamOn a daily basis, we build and maintain Samsung Private Cloud, the platform for internal company needs. We are looking for a Senior Software Engineer responsible for the development of cloud database and cloud data warehouse solutions.Role and ResponsibilitiesDelivering microservices into a...