Data Engineer Databricks
4 tygodni temu
Hello It's nice to have you here Let us introduce ourselves At HiQo Solutions we focus on developing entire IoT systems. We are US-based company, headquartered in Atlanta with delivery centers in Europe. Since 2007, we have delivered top-tier software engineering and IT consulting across healthcare, finance, logistics, and manufacturing. Our teams work on cutting-edge projects in software development, IoT, data science, and more, constantly exploring new ways to solve problems.We are looking for a skilled and proactive Senior Data Engineer with deep expertise in Databricks to join our data platform team. You will be responsible for designing, building, and optimizing scalable data pipelines and lakehouse architectures that power analytics, reporting, and machine learning across the organization.******This role is part of a US-based project and follows the US Central Time schedule. We expect candidates to be available from 4 PM to at least 8 PM CET/CEST. Priority will be given to candidates who can meet these hours.ResponsibilitiesDevelop and maintain robust ETL/ELT pipelines using Databricks and Apache SparkDesign and implement Delta Lake architectures for structured and semi-structured dataCollaborate with data analysts, scientists, and product teams to deliver clean, reliable datasetsOptimize performance of Spark jobs and manage cluster resources efficientlyAutomate workflows using Databricks Jobs, WorkflowsEnsure data quality, lineage, and governance using Unity Catalog and monitoring toolsDocument data models, pipeline logic, and architectural decisionsParticipate in code reviews and contribute to engineering best practicesRequired skills and experience4+ years of experience as a Data Engineer or in a similar roleStrong hands-on experience with Databricks, including Delta Lake, Spark SQLProficiency in Python and SQL for data manipulation and pipeline developmentSolid understanding of Apache Spark internals and performance tuningExperience with cloud platforms (Azure, AWS,GCP)Knowledge of data modeling, partitioning, and lakehouse principlesAbility to work with large-scale datasets and optimize storage and compute costsStrong communication skills and ability to collaborate across teamsEnglish proficiency- at least B2 levelHighly desirable: availability to work from 4pm to at least 8pm CET/CESTNice to haveExperience with Azure Data Factory or AirflowProficiency with modern data warehouses and tools including Snowflake, Synapse, Red GateExposure to data governance frameworks and tools (e.g., Unity Catalog, Purview)Understanding of machine learning workflows and integration with data pipelinesExperience with BI tools (Power BI, Tableau) and supporting analytics teamsContributions to open-source projects or technical blogsWe offer:It’s a unique opportunity to join our offices in Cracow or Wroclaw (only if you want to)Do you prefer working 100% remotely?- That’s totally possibleWe work only with foreign customers and our team is multicultural- a good way to study and improve your English skills.Simple structure and 'open door' way of communicationFlexible working time - you can agree on it within the teamNecessary tools and equipmentFull-time English teachersMedical insurance for employeesHiQo University- internal education and training programsHIQO COINS - We have a system of rewarding employees for extracurricular activities
-
Databricks Data Engineer
4 tygodni temu
Kraków, małopolskie, Polska Link Group Pełny etat 22 zł - 680 złWe are looking for an experienced Data Engineer who is passionate about building scalable data solutions and working with modern big data technologies. If you have solid expertise in data engineering, hands-on experience with Databricks, and enjoy turning complex data challenges into efficient, business-oriented solutions – we’d love to hear from...
-
Senior Databricks Engineer
3 tygodni temu
Kraków, małopolskie, Polska CRODU Pełny etat 30 zł - 240 złCześć! Dla naszego klienta z USA poszukujemy Azure DataBrick Engineerów. Prace dotyczą działań w obszarach m.in. migracji, zbierania danych i optymalizacji rozwiązań opartych na DataBricks. Klient posiada stałe zapotrzebowanie na specjalistów. Projekty, które prowadzą przeważnie są krótkoterminowe (ze sporym prawdopodobieństwem na...
-
Mid Data Engineer Databricks
2 tygodni temu
Kraków, małopolskie, Polska N-iX Pełny etat 4 zł - 500 zł#4362Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...
-
Lead Data Engineer Databricks
4 tygodni temu
Kraków, małopolskie, Polska N-iX Pełny etat 8 zł#4151Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...
-
Senior Databricks Engineer
2 tygodni temu
Kraków, małopolskie, małopolskie, Polska ENTRADA AI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etatSenior Databricks EngineerMiejsce pracy: KrakówTechnologies we useExpectedDatabricksPythonSQLETLApache SparkOptionalBigDataAzureSnowflakeDBTAirflowAbout the projectEntrada AI, Inc. is looking for a highly skilled Senior Databricks Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and...
-
Kraków, małopolskie, Polska Kolomolo Pełny etatLead Data Platform Engineer (Databricks/ Data Mesh Architecture) Location: European Union (Remote or Hybrid) Full-TimeJoin the Future of Digital Tech with KolomoloAt Kolomolo, we don’t just follow trends - we set them. As a global supplier of IT services and digital modernization solutions, we help businesses embrace cutting-edge technology to optimize...
-
Senior Data Engineer – AWS Databricks Python
4 tygodni temu
Kraków, małopolskie, Polska Upvanta sp. z o.o. Pełny etat 23 zł - 100 złPoszukujemy doświadczonego Senior Data Engineera, który będzie odpowiedzialny za projektowanie, rozwój i utrzymanie nowoczesnych rozwiązań w zakresie przetwarzania i integracji danych. Osoba na tym stanowisku będzie blisko współpracować z analitykami, data scientistami oraz inżynierami ML, wspierając rozwój innowacyjnych projektów danych.Zakres...
-
Data Engineer
3 dni temu
Kraków, małopolskie, małopolskie, Polska Sollers Consulting Pełny etatData Engineer (with Snowflake/Databricks)Miejsce pracy: KrakówTechnologies we useExpectedAzureAWSSQLPythonAbout the projectVersatility is the keyword when it comes to what we do in IT. Data Competency is one of our initiatives to support digital transformation of financial sector, enabling our customers to become truly data-driven companies. Our mission is...
-
Databricks Tech Lead
2 tygodni temu
Kraków, małopolskie, małopolskie, Polska KPMG Pełny etatDatabricks Tech Lead - Zespół Data & CloudMiejsce pracy: KrakówTechnologie, których używamyWymaganeDatabricksData LakeAzure Data FactoryAzure DevOpsCI/CDPythonSQLBIO projekcieZespół Data & Cloud zajmuje się dostarczaniem naszym Klientom usług z zakresu szeroko pojętej analityki danych, modelowania platform danych i Business Intelligence....
-
Senior Data Engineer
4 tygodni temu
Kraków, małopolskie, Polska hubQuest Pełny etat 28 zł - 500 złWe are a team of experts bringing together top talents in IT and analytics. Our mission is to build high-performing data and technology teams — from the ground up or by scaling existing ones — to help our partners become truly data-driven organizations.Currently, we are looking for a Senior Data Engineer to join the Global Analytics Unit, a global,...
