Senior Azure Data Engineer Databricks Specialist

1 miesiąc temu


Gdańsk, Polska Xebia sp. z o.o. Pełny etat
About Xebia

Xebia is a leading digital solutions provider with a strong focus on cloud-based solutions. With a presence in multiple industries and regions, we've had the privilege of working with renowned clients like UPS, McLaren, Aviva, Deloitte, and many more.

We're passionate about innovation and technological excellence, which is reflected in our partnership with top cloud providers like Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). Our expertise has earned us recognition as the first AWS Premier Consulting Partner in Poland.

As a company, we're driven by a desire to make a difference in the world of technology. We're part of the Xebia Group, a family of interconnected companies that share a common goal of innovation and thought leadership.

Our mission is to be recognized as the authority in our field of expertise. We believe in the power of innovation, talented team members, and technological excellence. This mindset allows us to take on global, innovative projects and provide value to our clients.

We're not just about technology; we're about people. We believe in the potential of every team member and provide opportunities for growth and development. Our company culture is built on the principles of attitude, dedication to knowledge, and a belief in people's potential.

We're looking for talented individuals who share our passion for innovation and technological excellence. If you're ready to take on new challenges and contribute to our mission, we'd love to hear from you.

About the Role

We're seeking a Senior Azure Data Engineer Databricks Specialist to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and deploying large-scale infrastructure using distributed systems. You'll work closely with analysts and data scientists to understand the impact of your work on downstream data models.

Your key responsibilities will include:

  • Designing and implementing architecture patterns for data processing, workflow definitions, and system-to-system integrations using Big Data and Cloud technologies.
  • Evaluating and translating technical design into workable technical solutions/code and technical specifications at par with industry standards.
  • Driving the creation of reusable artifacts and establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation.
  • Working closely with analysts/data scientists to understand the impact of your work on downstream data models.
  • Writing efficient and well-organized software to ship products in an iterative, continual release environment.
  • Contributing and promoting good software engineering practices across the team.
  • Communicating clearly and effectively to technical and non-technical audiences.
  • Defining data retention policies and monitoring performance to advise on necessary infrastructure changes.

Requirements

To be successful in this role, you'll need:

  • 3+ years' experience with Azure (Data Factory, Databricks, SQL, Data Lake, Power BI, DevOps, Delta Lake, CosmosDB).
  • 5+ years' experience with data engineering or backend/fullstack software development.
  • Strong SQL skills and Python scripting proficiency.
  • Experience with data transformation tools - Databricks and Spark.
  • Knowledge of data manipulation libraries (such as Pandas, NumPy, PySpark).
  • Ability to elaborate and propose relational/non-relational approach.
  • Normalization/denormalization and data warehousing concepts (star, snowflake schemas).
  • Designing for transactional and analytical operations.
  • Experience with CI/CD tooling (GitHub, Azure DevOps, Harness etc), Git.
  • Good verbal and written communication skills in English.

Nice to Have

While not required, experience with the following would be beneficial:

  • Azure Event Hubs, Azure Blob Storage, Azure Synapse, Spark Streaming.
  • Data modelling tools, preferably DBT.
  • Enterprise Data Warehouse solutions, preferably Snowflake.
  • ETL tools (such as Informatica, Talend, Datastage, Stitch, Fivetran etc).
  • Containerization and orchestration (Docker, Kubernetes etc).
  • Cloud (Azure, AWS, GCP) certification.

What We Offer

We offer a competitive package that includes:

  • Development budgets of up to 6,800 PLN.
  • We fund certifications (e.g. AWS, Azure).
  • Access to Udemy, O'Reilly (formerly Safari Books Online) and more.
  • Events and technology conferences.
  • Technology Guilds.
  • Internal training.
  • Xebia Upskill.

We Take Care of Your Health

We provide:

  • Private medical healthcare.
  • MultiSport card - we subsidise a MultiSport card.
  • Mental Health Support.

We're Flexible

We offer:

  • Flexible working hours.
  • B2B or employment contract.
  • Contract for an indefinite period.

  • Senior Data Engineer

    2 tygodni temu


    Gdańsk, Polska SCALO Sp. z o.o. Pełny etat

    W Scalo zajmujemy się dostarczaniem projektów software"owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom. Obszary...


  • Gdańsk, Trójmiasto, Polska KPMG Pełny etat

    Company descriptionZespół Data Intelligence Solutions zajmuje się dostarczaniem Klientom usług z zakresu szeroko pojętej analityki danych, modelowania platform danych i Business Intelligence. Wykorzystujemy nowoczesne technologie Microsoft i Databricks, jednocześnie stale rozwijamy się i poszukujemy nowych sposobów, by zaspokoić wymagania...


  • Gdańsk, Polska Devopsbay Pełny etat

    About DevopsbayWe are a digital solutions company helping organizations around the world achieve new thresholds of business performance. Our clients come from diverse industries including banking and financial services, hi-tech and manufacturing, insurance, consumer services, and more.Our teams specialize in cutting-edge big data solutions, leveraging...

  • Senior Data Engineer

    1 miesiąc temu


    Gdańsk, Polska SCALO Sp. z o.o. Pełny etat

    W Scalo zajmujemy się dostarczaniem projektów software"owych i wspieraniem naszych partnerów w rozwijaniu ich biznesu. Tworzymy oprogramowanie, które umożliwia ludziom dokonywanie zmian, działanie w szybszym tempie oraz osiąganie lepszych rezultatów. Jesteśmy firmą, która wykorzystuje szerokie spektrum usług IT, żeby pomagać klientom. Obszary...

  • Senior Data Engineer

    4 tygodni temu


    Gdańsk, Pomerania, Polska Arla foods Pełny etat

    About the roleArla Foods seeks a skilled Senior Data Engineer to support the continuous rollout and optimization of our global Data Foundation footprint in Microsoft Azure and other platforms.The ideal candidate will have experience with cloud-based services and technologies, including Microsoft Azure and Databricks.Key responsibilities will include...

  • Azure Data Engineer

    1 miesiąc temu


    Gdańsk, Pomerania, Polska C&F S.A. Pełny etat

    Job Title: Azure Data EngineerC&F S.A. is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics, and Compliance. We are seeking an experienced Azure Data Engineer to support our global customers in building innovative big data products and services.Key Responsibilities:Collaborate with data architects...


  • Gdańsk, Polska ERGO Technology & Services Pełny etat

    About UsERGO Technology & Services S.A. (ET&S S.A.) is a leading provider of innovative IT solutions, leveraging the strengths of ERGO Group AG and Atena to support millions of customers worldwide.Job OverviewWe are seeking an experienced Technical Azure Infrastructure Specialist to join our team. The successful candidate will play a key role in designing,...

  • Senior Data Engineer

    1 miesiąc temu


    Gdańsk, Trójmiasto, Polska Sigma Software Pełny etat

    Sigma Software is seeking an experienced Data Engineer to join our growing team.If you thrive on solving complex problems with advanced cloud-based data collection, transformation, analysis, and monitoring tools, this opportunity is for you!Teamwork is one of our core values, so we would like to welcome specialists who excel in collaboration, contribute to a...

  • DevOps Engineer Azure

    2 miesięcy temu


    Gdańsk, Trójmiasto, Polska ERGO Technology & Services Pełny etat

    About UsERGO Technology & Services S.A. (ET&S S.A.) was established in January 2021 following the integration of ERGO Digital IT and Atena into one entity, leveraging both companies’ strengths and best practices. As a part of ERGO Technology & Services Management AG, the technology holding of ERGO Group AG, we support millions of internal and external...

  • Senior Data Engineer

    1 miesiąc temu


    Gdańsk, Pomerania, Polska Arla foods Pełny etat

    About the roleArla Foods is seeking a Senior Data Engineer to support the continuous rollout and optimization of our global Data Foundation footprint in Microsoft Azure and other platforms.The ideal candidate will have experience with cloud-based services and technologies, including Microsoft Azure and Databricks. They will also have a working knowledge of...

  • Data Engineer

    1 miesiąc temu


    Bernarda Chrzanowskiego , Gdańsk, Polska 7N Pełny etat

    About the RoleWe are seeking a highly skilled Data Engineer to join our team working in a global container liner shipping company. The ideal candidate will have a strong background in building and managing Data Lake infrastructures, with a focus on leveraging Databricks and Apache Spark.The successful candidate will design and implement robust data...


  • Lęborska, Gdańsk, Polska Devopsbay Pełny etat

    Job DescriptionAs a Senior Cloud Data Solutions Expert at Devopsbay, you will play a crucial role in designing and deploying cutting-edge big data solutions leveraging the Databricks platform.About the Role:10+ years of experience as a Data Architect with a strong background in cloud-based data solutions, especially with Azure and Databricks.Hands-on...


  • Centurm, Gdańsk, Polska Capgemini Polska Pełny etat

    About the RoleCapgemini Polska is seeking a highly skilled Senior Azure Data Platform Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing large-scale data platforms on Azure.Key ResponsibilitiesCollaborate with data scientists and software engineers to integrate AI models...


  • Gdańsk, Pomerania, Polska Arla foods Pełny etat

    Role SummaryWe are seeking a Senior Data Engineer to join our commercial IT organization in Gdansk, Poland. The successful candidate will be responsible for supporting the continuous rollout and optimization of our global Data Foundation footprint in Microsoft Azure and other platforms.

  • Data Engineer Lead

    1 tydzień temu


    Gdańsk, Pomerania, Polska Arla foods Pełny etat

    About the roleArla Foods, a leading global dairy company, is seeking an experienced Senior Data Engineer to join our Commercial IT organization. As a key member of our team, you will play a critical role in supporting the continuous rollout and optimization of our global Data Foundation footprint in Microsoft Azure and other platforms.The ideal candidate...


  • Centurm, Gdańsk, Polska Capgemini Polska Pełny etat

    {"h2":{"YOUR TASKS": "As a Senior Azure Data Platform Specialist at Capgemini Polska, you will be responsible for collaborating with data scientists and software engineers to integrate AI models into business applications. You will also manage, optimize, and streamline data/AI workflows using AI orchestrators like LangChain, and implement Azure Cognitive...

  • Data Engineer

    5 miesięcy temu


    Gdańsk, Polska Groupe SII Pełny etat

    We are looking for Data Engineer for one of our projects in the automotive industry. This person will be responsible for supporting new BI & Analytics use cases and implementation and design of state-of-the-art data processing to the Scrum working methodology. Don’t miss this exciting opportunity and apply! Your role Developing features Supporting...

  • Senior Data Engineer

    6 miesięcy temu


    Gdańsk, Polska Arla foods Pełny etat

    About the job Join our commercial IT organization, which is an area that benefits from an increased focus and activity. As a Senior Data Engineer you will be supporting the continuous rollout and optimization of our global Data Foundation footprint in Microsoft Azure and other platforms. The role will include: • Execute deliverables in the agile...

  • Senior Cloud Architect

    1 miesiąc temu


    Gdańsk, Pomerania, Polska Grid Dynamics Poland Pełny etat

    We are seeking a highly skilled Senior Cloud Architect to lead the development of a powerful API that will revolutionize the way we train ML models. As a key member of our innovative team, you will have the opportunity to leverage Azure Databricks and Azure DevOps while working with cutting-edge GPU technology on-premise, integrating seamlessly with Azure...


  • Gdańsk, Polska GetInData | Part of Xebia Pełny etat

    About GetInData | Part of XebiaWe are a leading data company working for international clients, delivering innovative projects related to data, AI, cloud, analytics, ML/LLM, and GenAI. Our team of 120 data & AI experts collaborates with clients from various industries, such as media, e-commerce, retail, fintech, banking, and telcos.Platform Engineer RoleAs a...