Data Engineer with Databricks
5 dni temu
Location: Warsaw (Inflancka 4A) or Remote Work (Poland) B2B Contract, Targeted Salary: 150 - 170 PLN Net/Hour Python ApacheSpark Databricks MSSQL Git CI/CD Docker Azure Kubernetes Are you ready to join our international team as a Data Engineer with Databricks ? We shall tell you why you should What products do we develop? KMD Elements is a cloud-based solution tailored for the energy and utility market. It offers a highly efficient way to handle complex data validation and advanced formula-based settlements on time series. Designed for the international market, KMD Elements automates intricate calculation and billing processes. Key features include an advanced configuration engine, robust automation capabilities, multiple integration options, and a customer-centric interface. More info can be found here How do we work? Agile Scrum Teamwork CleanCode CodeReview E2Eresponsibility ConstantImprovement Your responsibilities: Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python. Have end-to-end responsibility for the full lifecycle of features you develop. Design technical solutions for business requirements from the product roadmap. Ensure optimal performance Refactor existing code and enhance system architecture to improve maintainability and scalability. Design and evolve the test automation strategy, including technology stack and solution architecture. Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development. Ideal candidate: Has 3 years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT). Is proficient in Python, with a solid understanding of data processing challenges. Has experience working with Apache Spark and Databricks. Is familiar with MSSQL databases or other relational databases. Has some experience working with distributed systems on a cloud platform. Has worked on large-scale systems and understands performance optimization. Is comfortable with Git and CI/CD practices, and can contribute to deployment processes for data pipelines. Is proactive, eager to learn, and has a strong can-do attitude. Communicates fluently in English and Polish, both written and spoken. Is a team player with excellent collaboration and communication skills. Nice to Have: Experience with Azure Experience working with SSIS Familiarity with Azure PostgreSQL Knowledge of Docker and Kubernetes Exposure to Kafka or other message brokers and event-driven architecture Experience working in Agile/Scrum environments
-
Data Engineer
16 godzin temu
Krakow, Polska Addepto Pełny etatData Engineer (Databricks) Miejsce pracy: Kraków Technologies we use Expected Python Databricks SQL Microsoft Azure Optional Airflow Dagster Apache Spark Microsoft Power BI Azure Event Hub Kafka Terraform Operating system Windows macOS About the project As a Data Engineer, you will have the exciting opportunity to work with a team of technology experts on...
-
Data Engineer
5 dni temu
Krakow, Polska Sollers Consulting Pełny etatData Engineer (with Snowflake/Databricks) Miejsce pracy: Kraków Technologies we use Expected Azure AWS SQL Python About the project Versatility is the keyword when it comes to what we do in IT. Data Competency is one of our initiatives to support digital transformation of financial sector, enabling our customers to become truly data-driven companies. Our...
-
Senior Data Engineer- Databricks
5 dni temu
Krakow, Polska HIQO SOLUTIONS sp. z o.o. Pełny etatSenior Data Engineer- Databricks Miejsce pracy: Kraków Technologies we use Expected Databricks Delta Lake Spark SQL Python SQL Apache Spark Microsoft Azure AWS Google Cloud Platform Optional Azure Data Factory Apache Airflow Snowflake Data Cloud Synapse Red Gate Unity Catalog Purview Microsoft Power BI Tableau About the project We are looking for a skilled...
-
Senior Databricks Engineer
4 tygodni temu
Krakow, Polska ENTRADA AI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etatSenior Databricks Engineer Miejsce pracy: Kraków Technologies we use Expected Databricks Python SQL ETL Apache Spark Optional BigData Azure Snowflake DBT Airflow About the project Entrada AI, Inc. is looking for a highly skilled Senior Databricks Engineer to join our growing team of consultants. In this role, you will be responsible for designing,...
-
Senior Data Engineer
16 godzin temu
Krakow, Polska Addepto Pełny etatSenior Data Engineer (Databricks) Miejsce pracy: Kraków Technologies we use Expected Python Databricks SQL Microsoft Azure Optional Airflow Dagster Apache Spark Microsoft Power BI Azure Event Hub Kafka Terraform Operating system Windows macOS About the project As a Senior Data Engineer, you will have the exciting opportunity to work with a team of...
-
Mid Data Engineer Databricks
2 tygodni temu
Krakow, Polska N-iX Pełny etat4362 Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...
-
Krakow, Polska Kolomolo Pełny etatLead Data Platform Engineer (Databricks/ Data Mesh Architecture) Location: European Union (Remote or Hybrid) Full-Time Join the Future of Digital Tech with Kolomolo At Kolomolo , we don't just follow trends - we set them. As a global supplier of IT services and digital modernization solutions, we help businesses embrace cutting-edge technology to optimize...
-
Senior Data Engineer – AWS Databricks Python
3 tygodni temu
Krakow, Polska Upvanta sp. z o.o. Pełny etatPoszukujemy doświadczonego Senior Data Engineera , który będzie odpowiedzialny za projektowanie, rozwój i utrzymanie nowoczesnych rozwiązań w zakresie przetwarzania i integracji danych. Osoba na tym stanowisku będzie blisko współpracować z analitykami, data scientistami oraz inżynierami ML, wspierając rozwój innowacyjnych projektów danych....
-
Data Engineer
2 tygodni temu
Krakow, Polska Caspian One Pełny etatLocation: Krakow (Hybrid) Rate: Up to 2000 PLN/day Duration: 6-month rolling contract Overview: Excellent opportunity to work with a highly reputable financial services company in Poland! We're seeking a skilled Spark Software Engineer to join a dynamic agile team focused on building the strategic backbone between Dealstores and Operations/Regulatory...
-
Senior Data
3 tygodni temu
Krakow, Polska CLOUDFIDE Pełny etatYou are As a Senior Data & Observability Engineer , you will take ownership of developing advanced Databricks solutions and Azure-based observability capabilities for one of our key enterprise clients. The role is predominantly hands-on ( 75% Databricks, 25% Power BI ) with strong emphasis on autonomy, problem-solving, and proactive influence on the...
