Middle Data Engineer Databricks

3 tygodni temu


Zabłocie A Kraków, Polska N-iX Pełny etat

#3112

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Scandinavian-based client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client's platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2) 
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 3-4 years as data engineer, or in a relevant field
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights
  • Cloud: Familiarity with cloud platforms (preferably Azure)
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms
  • Database Skills: Knowledge of relational databases, with proficiency in SQL
  • Big Data: Experience using Apache Spark 
  • Documentation: Experience in creating and maintaining structured documentation
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability
  • Version Control: Experience with Gitlab or equivalent tools
  • English Proficiency: B2 level or higher
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset 

Nice to have:

  • Experience with Docker and Kubernetes
  • Experience with document and graph databases
  • 3D Modeling: Familiarity with 3D matching and model refinement processes is a plus
  • Ability to travel abroad twice a year for an on-site workshops 

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits


  • Stanisława Żółkiewskiego a, Kraków, Polska Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...


  • Kraków, Lesser Poland N-iX Pełny etat

    We are seeking a proactive Strong Middle Data Engineer to join our vibrant team. In this role, you will take on a pivotal position, collaborating closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust...

  • Middle NET Engineer

    5 dni temu


    Zabłocie A, -, Kraków, Polska N-iX Pełny etat

    N-iX is a global company with Ukrainian roots that helps businesses across the world develop successful software products. Founded in 2002, N-iX has come a long way and increased its presence in eight countries spanning Europe, the US, and Latin America. Today, we are a strong community of 2,000+ professionals and a reliable partner for global industry...


  • Kraków, Polska emagine Polska Pełny etat

    At emagine Polska, we are embarking on a significant change journey, transforming our data foundation to drive business growth and innovation. We invite a skilled Data Engineer to join our team as an Agile Data Foundation Specialist.Key Responsibilities:Data Pipeline Development: Design, develop, test, and maintain robust data pipelines and ETL processes...


  • Kraków, Polska N-iX Pełny etat

    (#2703)Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...


  • Kraków, Lesser Poland CRODU Sp. z o.o. Pełny etat

    Oto przykład jak mogłoby wyglądać Twoje następne wyzwanie zawodowe: Projekty: Migracja modelu ML z różnych narzędzi AWS do DataBricksPrzetwarzanie i transformacja danych z agregacją metryk dla dwóch powiązanych zadań GlueTworzenie pipeline'ów ETL do przetwarzania danych o wizytach na platformie i użytkownikach, uwzględniających spłaszczanie...


  • Kraków, Lesser Poland GlobalLogic Pełny etat

    Our Client is one of the biggest global manufacturing companies operating in the fields of industrial systems, worker safety, health care, and consumer goods. The company is dedicated to creating the technology and products that advance every business, improve every home and enhance every life.As a Data Engineer for our Data Mesh platform, you will design,...


  • Kraków, Lesser Poland Software Mind Pełny etat

    Job DetailsAs a Cloud-Based Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks. You will work closely with clinical and technical teams to analyze user flows, optimize data integrations, and provide insights through complex data migration analysis.ResponsibilitiesDevelop and...

  • Senior Data Engineer

    3 tygodni temu


    Zabłocie A, Kraków, Polska N-iX Pełny etat

    We are seeking a proactive Senior Data Engineer to join our vibrant team.Welcome bonus: 1000$As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud...

  • Middle React Engineer

    3 tygodni temu


    Kraków, Lesser Poland N-iX Pełny etat

    We are seeking a talented and experienced  Middle React Engineer  to join our dynamic development team. As a React Engineer, you will be responsible for developing high-quality web applications using React, TypeScript, Redux, GraphQL, and styled-components. You will have the opportunity to work on exciting projects and collaborate with a team of passionate...

  • Senior Data Engineer

    1 tydzień temu


    Zabłocie A, Kraków, Polska N-iX Pełny etat

    Our client is a US-based company that provides In-flight Internet and entertainment services to aircraft across the globe, serving commercial aircrafts. At this moment we cooperate on Business Intelligence, Data Analysis, Data Science and BigData directions and look for talents who can contribute to the complex data management and analysis projects.About...

  • Data Engineer

    1 tydzień temu


    Kraków, Lesser Poland TN Poland Pełny etat

    We are seeking an experienced Data Engineer specializing in MS SQL Server to design, develop, and optimize database solutions for our Customer while ensuring data integrity and security. This role involves working closely with stakeholders to understand data requirements and implementing robust solutions using modern tools like Databricks and Data...


  • Kraków, Lesser Poland Link Group Pełny etat

    As a Senior Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and ETL processes. You will ensure data quality, security, and performance while implementing CI/CD pipelines and working extensively with Databricks.Key ResponsibilitiesDevelop and maintain robust data pipelines and ETL processes.Implement and manage...

  • Data Engineer

    5 dni temu


    Kraków, Lesser Poland Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...

  • Data Engineer

    3 tygodni temu


    Kraków, Polska Antal Sp. z o.o. Pełny etat

    We are seeking an experienced Data Engineer specializing in MS SQL Server to design, develop, and optimize database solutions for our Customer while ensuring data integrity and security. This role involves working closely with stakeholders to understand data requirements and implementing robust solutions using modern tools like Databricks and Data...

  • Middle NET Engineer

    3 tygodni temu


    Zabłocie A, Kraków, Polska N-iX Pełny etat

    #3066Product details: A comprehensive Engineering Document Management System (EDMS) designed to streamline the management of engineering documents and data throughout their lifecycle. It serves as a centralized repository, ensuring that all stakeholders have access to accurate, up-to-date information, thereby enhancing collaboration and operational...


  • Kraków, Lesser Poland VRP Consulting Pełny etat

    We are seeking a highly skilled Middle Data Analyst to join our team at VRP Consulting. As a key member of our data analytics team, you will be responsible for extracting, transforming, and loading data from multiple sources into centralized storage solutions. You will also conduct advanced exploratory data analysis and statistical modeling to uncover...

  • Data Engineer

    3 tygodni temu


    Kraków, Lesser Poland N-iX Pełny etat

    Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions...


  • Kraków, Polska N-iX Pełny etat

    N-iX is seeking a proactive Data Engineer to join our vibrant team In this role, you will take on a pivotal position, collaborating closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud...

  • Senior Data Engineer

    3 tygodni temu


    Kraków, Lesser Poland Addepto Pełny etat

    Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...