Lead Data Engineer Databricks

2 dni temu

Wroclaw, Polska N-iX Pełny etat

4151 Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users. Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client's platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group , Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S. Lead responsibilities: Ensure the team follows best practices in coding, data modeling, and system integration. Act as the primary point of contact for resolving complex technical challenges. Onboard new hires by providing hands-on guidance during their initial weeks, ensuring a smooth transition into the team (4-6 engineers). Key Responsibilities: Design, build, and maintain data pipelines using Python. Collaborate with an international team to develop scalable data solutions. Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows. Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding. Write integration tests to ensure the quality and reliability of data services. Work with Gitlab to manage code and collaborate with team members. Utilize Databricks for data processing and management. Requirements: Programming: Minimum of 5 years as data engineer, or in a relevant field. Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs. Data Skills: Structured approach to data insights. Cloud: Familiarity with cloud platforms (preferably Azure). Data Platforms: Experience with Databricks, Snowflake, or similar data platforms. Database Skills: Knowledge of relational databases, with proficiency in SQL. Big Data: Experience using Apache Spark. Documentation: Experience in creating and maintaining structured documentation. Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability. Version Control: Experience with Gitlab or equivalent tools. English Proficiency: B2 level or higher. Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset. Nice to have: Experience with Docker and Kubernetes. Experience with document and graph database. Ability to travel abroad twice a year for an on-site workshops.

  • Databricks Data Engineer

    2 dni temu

    Wroclaw, Polska Link Group Pełny etat

    We are looking for an experienced Data Engineer who is passionate about building scalable data solutions and working with modern big data technologies. If you have solid expertise in data engineering, hands-on experience with Databricks, and enjoy turning complex data challenges into efficient, business-oriented solutions – we'd love to hear from you!...

  • Data Engineer AWS

    2 tygodni temu

    Wroclaw, Polska Holisticon Insight Pełny etat

    We are looking for a Data Engineer with expertise in AWS & Databricks to join an exciting project for our client – a leading Swedish provider of transport solutions. You will be part of a small, agile team responsible for the end-to-end implementation of optimization and machine learning projects, as well as maintaining and improving a cutting-edge...

  • Data Engineer Databricks

    2 dni temu

    Wroclaw, Polska HiQo Solutions Pełny etat

    Hello! It's nice to have you here! Let us introduce ourselves At HiQo Solutions we focus on developing entire IoT systems. We are US-based company, headquartered in Atlanta with delivery centers in Europe. Since 2007, we have delivered top-tier software engineering and IT consulting across healthcare, finance, logistics, and manufacturing. Our teams work on...

  • Databricks Data Engineer

    2 dni temu

    Wroclaw, Polska UPVANTA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    Databricks Data Engineer / Architect Miejsce pracy: Wrocław Technologies we use Expected Databricks SQL Python Optional AWS Microsoft Azure Google Cloud Platform About the project We're looking for an experienced Senior Data Engineer to join our team. If you're passionate about data, modern platforms, and solving complex problems at scale, this opportunity...

  • Mid-Level Data Engineer Azure Databricks

    2 dni temu

    Wroclaw, Polska emagine Polska Pełny etat

    General Information: Industry: Healthcare Rate: up to 150 PLN/h Location: 100% remote This position seeks a skilled Data Engineer with a minimum of 3 years of experience specializing in Azure Data Services and Databricks. The ideal candidate will have a strong proficiency in SQL and Python, along with a solid understanding of data modeling and architectural...

  • Senior Data Engineer with Databricks

    2 dni temu

    Wroclaw, Polska KMD Poland Pełny etat

    Location: Warsaw (Inflancka 4A) or Remote Work (Poland) B2B Contract, Targeted Salary: 160 - 180 PLN Net/Hour Python ApacheSpark Databricks MSSQL Git CI/CD Docker Azure Kubernetes Are you ready to join our international team as a Senior Data Engineer with Databricks ? We shall tell you why you should What products do we develop? KMD Elements is a cloud-based...

  • Senior Azure Data Engineer with Databricks

    2 tygodni temu

    Wroclaw, Polska Xebia sp. z o.o. Pełny etat

    Senior Azure Data Engineer with Databricks Miejsce pracy: Wrocław Technologie, których używamy System operacyjny Windows macOS O projekcie We are seeking an experienced and self-driven Data Engineer to design, build, and maintain the modern data infrastructure that supports our analytics, data science, and product teams. In this role, you will develop...

  • Data Engineer AWS

    2 dni temu

    Wroclaw, Polska Holisticon Insight Pełny etat

    Holisticon Insight (former Nexer Insight) is a division of http://nexergroup.com focused on IoT, AI, and advanced analytics. We assist our customers in developing IoT services, portals, and mobile apps and, above all, analyze data using AI and advanced analytics to reduce costs, streamline, and find new opportunities for the business. Our goal is to grow...

  • Senior Azure Data Engineer with Databricks

    3 tygodni temu

    Wroclaw, Polska Xebia sp. z o.o. Pełny etat

    Senior Azure Data Engineer with Databricks Miejsce pracy: Wrocław Technologie, których używamy System operacyjny Windows macOS O projekcie We are seeking an experienced and self-driven Data Engineer to design, build, and maintain the modern data infrastructure that supports our analytics, data science, and product teams. In this role, you will develop...

  • Data Engineer with Databricks

    2 tygodni temu

    Wroclaw, Polska Holisticon Insight Pełny etat

    Holisticon Insight is a division of http://nexergroup.com focused on IoT, AI, and advanced analytics. We assist our customers in developing IoT services, portals, and mobile apps and, above all, analyze data using AI and advanced analytics to reduce costs, streamline, and find new opportunities for the business. Our goal is to grow strong but rather in...