Senior Azure Data Engineer

3 dni temu


Warszawa, mazowieckie, Polska Lingaro Pełny etat

Tasks:

  • Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
  • Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
  • Integrating and transforming data to ensure its compatibility with the target data model or format.
  • Hands-on experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems)
  • Familiarity with partitioning, compression, optimization of data storage and retrieval.
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
  • Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
  • Independence and responsibility in delivering solutions.
  • Ability to work under agile methodologies.


Requirements:

  • Proven experience in Azure cloud-based infrastructure, Databricks implementation
  • Hands on experience with of T-SQL (min. 5 years)
  • Proven experience in Python, PySpark
  • Very good level of communication including ability to convey information clearly and specifically to
  • co-workers and business stakeholders.
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
  • English at least at B2 level, ideally C1
  • Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis is a plus.


We offer:

  • Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
  • “Office as an option” model. You can choose to work remotely or in the office, depending on your location.
  • Flexibility regarding working hours and your preferred form of contract.
  • Comprehensive online onboarding program with a “Buddy” from day 1.
  • Cooperation with top-tier engineers and experts.
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly.
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
  • Internal Gallup Certified Strengths Coach to support your growth.
  • Grow as we grow as a company. 76% of our managers are internal promotions.
  • A diverse, inclusive, and values-driven community.
  • Autonomy to choose the way you work. We trust your ideas.
  • Create our community together. Refer your friends to receive bonuses.
  • Activities to support your well-being and health.
  • Plenty of opportunities to donate to charities and support the environment.
  • Modern office equipment. Purchased for you or available to borrow, depending on your location.




  • Warszawa, mazowieckie, Polska Capgemini Polska Pełny etat

    Senior Azure Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations...

  • Azure Data Engineer

    2 dni temu


    Warszawa, mazowieckie, Polska Nexio Management Pełny etat

    Nexio Management is a Polish technology company with over 16 years of experience in the market. Currently, we employ more than 500 consultants across our competency centers, providing IT services to clients worldwide. Nexio Management is headquartered in Warsaw, with additional offices located in Wrocław, Romania, and the United Kingdom. As part of our...


  • Warszawa, mazowieckie, Polska BlueSoft Pełny etat

    Project description:Due to the planned expansion of the team working on building a corporate Data Warehouses / Data Lakehouse in Azure Cloud for one of the largest retail clients in Poland, we are looking for a Senior Data Engineer/Data Platform Architect to join us in this project. Additionally, we aim to strengthen the internal Microsoft Competence Center...

  • Senior Azure Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska KPMG Pełny etat

    Job title descriptionBudowa chmurowych rozwiązań procesujących daneProjektowanie, utrzymanie oraz wdrażanie przepływów danych wsadowych włączając w to procesy ELT, oraz integracje pomiędzy systemami chmurowymi i systemami on-premisesProjektowanie, utrzymanie oraz wdrażanie przepływów danych strumieniowychWdrażania rozwiązań Data...


  • Warszawa, mazowieckie, Polska RED Global Pełny etat

    RemoteUp to 200 PLN per hourOur client is for experts in the area of designing and migrating corporate applications to the Azure cloud. Key responsibilitiesdevelopment of architectural standards in the field of hybrid infrastructure,selection of appropriate hardware and system solutions with high performance in the field of hybrid infrastructure,verification...


  • Warszawa, mazowieckie, Polska BlueSoft Pełny etat

    Responsibilities:designing and implementing extremely efficient data ingestion and wrangling pipelines from various kind of sources (volumes up to hundreds of terabytes) into Delta Lake (Azure Databricks);orchestrating data processing on various stages;creating and executing automated tests for the purposes of validation;providing insights on the latest...


  • Warszawa, mazowieckie, Polska EPAM Systems Pełny etat

    We are currently seeking a qualified Azure Support Engineer to join our team.As an Azure Support Engineer, you'll assist in providing Level 1 support for our current Azure DevOps pipelines, ensuring optimal performance and user satisfaction. You'll collaborate closely with development teams and vendors to troubleshoot, enhance, and maintain our Azure...

  • Data Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    ​As a Data Engineer in D&A Scaled Analytical Products, you will play a crucial role in designing, developing, and implementing data solutions that enable data-driven decision-making across the organization. You will collaborate with cross-functional teams to acquire, transform, and optimize data from various sources. Your technical expertise and innovative...

  • Senior Data Engineer

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Sorigo Pełny etat

    W Sorigo zajmujemy się wdrażaniem innowacyjnych rozwiązań w obszarze IT. Mamy kilkunastoletnie doświadczenie we współpracy partnerskiej z dużymi klientami. Wierzymy także, że praca powinna dawać ludziom satysfakcje, a nie być tylko obowiązkiem. Choć czasami znalezienie odpowiedniego dla siebie miejsca wymaga czasu i dobrego ukierunkowania przez...

  • Data Engineer Databricks

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Experis Manpower Group Pełny etat

    Experis to światowy lider w rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz interesujące projekty IT skierowane zarówno do doświadczonych ekspertów, jak i osób rozpoczynających karierę w branży IT. Obecnie, dla naszego klienta realizującego projekty w branży...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…To use Scrum methodology,...

  • Big Data Engineer

    3 tygodni temu


    Warszawa, mazowieckie, Polska Collabera Digital Pełny etat

    Join our team as a Big Data Engineer and bring your 5+ years of Spark and Scala expertise to build cutting-edge solutions in an Agile and DevOps environment!Roles & Responsibilities:-- To develop end-to-end ETL process with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc…- To use Scrum...

  • Senior Data Scientist

    4 tygodni temu


    Warszawa, mazowieckie, Polska BCF Software Sp. z o.o. Pełny etat

    About Us:BCF Software is at the cutting edge of AI technology, driving innovation through the development of advanced AI solutions. We are seeking a Senior AI/ML Engineer with deep expertise in transformer-based models for both text and images. If you have a passion for pushing the boundaries of AI and machine learning, this is your chance to make a...

  • Data Analyst

    19 godzin temu


    Warszawa, mazowieckie, Polska Kordian Group sp zoo Pełny etat

    About the CompanyKordian Group and our sister company, Akord LLC, extend and complement IT for marquee brands across the world.We are building and operating excellence centers for clients operating in the United States, Canada, Netherlands, Germany and several other European countries. We work with the latest technologies in data analysis, software...

  • Senior AI Engineer

    3 miesięcy temu


    Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    We are looking for a passionate Senior AI Engineer who is eager to make an impact on their career and take on a new challenge!With us, you willCollaborate with cross-functional teams: Partner with data scientists, data managers, analysts, infrastructure engineers, and peer AI Engineers to develop, integrate, and scale new algorithmic productsEvaluate new...


  • Warszawa, mazowieckie, Polska Procter & Gamble Pełny etat

    We are looking for a driven, naturally curious Senior Data Engineer to join our Digital Experiences team delivering cloud native Big Data solutions within our global Media ecosystem. Our engineering teams work with data on a massive scale and are responsible for the design, development, and continuous innovation of best-in-class solutions supporting P&G as...


  • Warszawa, mazowieckie, Polska Samsung R&D Institute Poland Pełny etat

    Senior Software Engineer for Managed Database ServiceAbout our TeamOn a daily basis, we build and maintain Samsung Private Cloud, the platform for internal company needs. We are looking for a Senior Software Engineer responsible for the development of cloud database and cloud data warehouse solutions.Role and ResponsibilitiesDelivering microservices into a...

  • Senior Data Engineer

    4 tygodni temu


    Warszawa, mazowieckie, Polska easybrain Pełny etat

    We are looking for a skilled Data Engineer to join our BI team, which is responsible for operating large-scale data pipelines, based on integrations with dozens of sources, collecting a rapidly expanding list of data points on how users interact with our games. Using this vast data, we predict a user’s value and create analytical reports for other teams to...

  • Administrator Azure

    1 miesiąc temu


    Warszawa, mazowieckie, Polska Bank Millennium Pełny etat

    Zadania:Administrowanie oraz realizacja zadań związanych z prawidłowym funkcjonowaniem systemów informatycznych na platformie MS Azure ze szczególnym uwzględnieniem aspektów bezpieczeństwaPlanowanie, testowanie i wprowadzanie zmian w dużym środowisku Azure adekwatnie do postępującego rozwoju i nowych wymagań, w tym automatyzacji, delegacji...


  • Warszawa, mazowieckie, Polska Wavestone Poland Pełny etat

    Cześć! Jeśli specjalizujesz się w analizie danych, masz doświadczenie w zarządzaniu zespołami oraz rozumiesz kluczowe znaczenie danych w procesie podejmowania decyzji biznesowych, zapraszamy do aplikowania! W ramach stanowiska, oprócz budowania i prowadzenia zespołu ekspertów, będziesz definiować i zarządzać wdrażaniem rozwiązań Microsoft...