Senior Databricks Engineer

2 tygodni temu

Kraków małopolskie, małopolskie, Polska ENTRADA AI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat
Senior Databricks EngineerMiejsce pracy: KrakówTechnologies we useExpected
  • Databricks
  • Python
  • SQL
  • ETL
  • Apache Spark
Optional
  • BigData
  • Azure
  • Snowflake
  • DBT
  • Airflow
About the project

Entrada AI, Inc. is looking for a highly skilled Senior Databricks Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence. You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our client’s Databricks solution.

Your responsibilities
  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
  • Develop and maintain documentation for data systems, including data models, flow diagrams, and operational procedures.
  • Mentor and guide junior data engineers, providing technical leadership and support.
  • Stay current with emerging technologies and trends in data engineering, and apply them to improve existing systems.
Our requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems
  • 3+ years of experience with Databricks.
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
  • Strong understanding of data warehousing concepts, data modeling, and schema design.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work effectively in a team-oriented environment.

  • Senior Databricks Engineer

    3 tygodni temu

    Kraków, małopolskie, Polska CRODU Pełny etat 30 zł - 240 zł

    Cześć! Dla naszego klienta z USA poszukujemy Azure DataBrick Engineerów. Prace dotyczą działań w obszarach m.in. migracji, zbierania danych i optymalizacji rozwiązań opartych na DataBricks. Klient posiada stałe zapotrzebowanie na specjalistów. Projekty, które prowadzą przeważnie są krótkoterminowe (ze sporym prawdopodobieństwem na...

  • Data Engineer Databricks

    4 tygodni temu

    Kraków, małopolskie, Polska HiQo Solutions Pełny etat

    Hello! It's nice to have you here! Let us introduce ourselves At HiQo Solutions we focus on developing entire IoT systems. We are US-based company, headquartered in Atlanta with delivery centers in Europe. Since 2007, we have delivered top-tier software engineering and IT consulting across healthcare, finance, logistics, and manufacturing. Our teams work on...

  • Senior Machine Learning Engineer

    2 tygodni temu

    Kraków, małopolskie, małopolskie, Polska ENTRADA AI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    Senior Machine Learning EngineerMiejsce pracy: KrakówTechnologie, których używamyWymaganeMachine LearningDatabricksPythonMLflowMLOpsMile widzianeTensorFlowPytorchscikit-learnAWSAzure DevOpsO projekcieEntrada AI, Inc. is seeking an experienced Senior Machine Learning Engineer to join our growing team of consultants. In this role, you will be responsible...

  • Senior Data Engineer – AWS Databricks Python

    4 tygodni temu

    Kraków, małopolskie, Polska Upvanta sp. z o.o. Pełny etat 23 zł - 100 zł

    Poszukujemy doświadczonego Senior Data Engineera, który będzie odpowiedzialny za projektowanie, rozwój i utrzymanie nowoczesnych rozwiązań w zakresie przetwarzania i integracji danych. Osoba na tym stanowisku będzie blisko współpracować z analitykami, data scientistami oraz inżynierami ML, wspierając rozwój innowacyjnych projektów danych.Zakres...

  • Databricks Data Engineer

    4 tygodni temu

    Kraków, małopolskie, Polska Link Group Pełny etat 22 zł - 680 zł

    We are looking for an experienced Data Engineer who is passionate about building scalable data solutions and working with modern big data technologies. If you have solid expertise in data engineering, hands-on experience with Databricks, and enjoy turning complex data challenges into efficient, business-oriented solutions – we’d love to hear from...

  • Data Engineer

    3 dni temu

    Kraków, małopolskie, małopolskie, Polska Sollers Consulting Pełny etat

    Data Engineer (with Snowflake/Databricks)Miejsce pracy: KrakówTechnologies we useExpectedAzureAWSSQLPythonAbout the projectVersatility is the keyword when it comes to what we do in IT. Data Competency is one of our initiatives to support digital transformation of financial sector, enabling our customers to become truly data-driven companies. Our mission is...

  • Mid Data Engineer Databricks

    2 tygodni temu

    Kraków, małopolskie, Polska N-iX Pełny etat 4 zł - 500 zł

    #4362Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...

  • Senior Data Engineer

    2 tygodni temu

    Kraków, małopolskie, małopolskie, Polska ITEAMLY SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    Senior Data EngineerMiejsce pracy: KrakówTechnologies we useExpectedSQLPythonJavaScalaSparkFlinkAWSYour responsibilitiesDesign and maintain efficient data pipelines, data lakes, and data warehouses.Build and optimize ETL processes to ensure seamless data flow across platforms.Manage and monitor database performance, ensuring data quality, security, and...

  • Lead Data Engineer Databricks

    4 tygodni temu

    Kraków, małopolskie, Polska N-iX Pełny etat 8 zł

    #4151Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality...

  • Senior Data Engineer

    4 tygodni temu

    Kraków, małopolskie, Polska hubQuest Pełny etat 28 zł - 500 zł

    We are a team of experts bringing together top talents in IT and analytics. Our mission is to build high-performing data and technology teams — from the ground up or by scaling existing ones — to help our partners become truly data-driven organizations.Currently, we are looking for a Senior Data Engineer to join the Global Analytics Unit, a global,...