Senior Data Engineer

5 dni temu

Warszawa, Mazovia, Polska Addepto Pełny etat
Senior Data Engineer (Databricks), WarszawaLocation:Job Category:

Information Technology

EU work permit required:

Yes

Job Reference:

2cnhbryv

Job Description:

Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI companies.

As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Here are some of the projects we are seeking talented individuals to join:

Design and development of a universal data platform for global aerospace companies. This Azure and Databricks powered initiative combines diverse enterprise and public data sources. The data platform is at the early stages of the development, covering design of architecture and processes as well as giving freedom for technology selection.

Data Platform Transformation for energy management association body. This project addressed critical data management challenges, boosting user adoption, performance, and data integrity. The team is implementing a comprehensive data catalog, leveraging Databricks and Apache Spark/PySpark, for simplified data access and governance.

Design of the data transformation and following data ops pipelines for global car manufacturer. This project aims to build a data processing system for both real-time streaming and batch data. We'll handle data for business uses like process monitoring, analysis, and reporting, while also exploring LLMs for chatbots and data analysis.

Your main responsibilities:

  • Design and optimize scalable data processing pipelines for both streaming and batch workloads using Big Data technologies such as Databricks, Apache Airflow, and Dagster.
  • Architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability.
  • Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
  • Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources, ensuring efficiency and scalability.
  • Collaborate with Data Science teams on Machine Learning projects, including text/image analysis, feature engineering, and predictive model deployment.
  • Design and manage complex data transformations using Databricks, DBT, and Apache Airflow, ensuring data integrity and consistency.
  • Translate business requirements into scalable and efficient technical solutions while ensuring optimal performance and data quality.
  • Ensure data security, compliance, and governance best practices are followed across all data pipelines.

What you'll need to succeed in this role:

  • At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
  • Strong programming skills in Python: writing clean code, OOP design.
  • Strong SQL skills, including performance tuning and query optimization.
  • Experience in designing and implementing data governance and data management processes.
  • Deep expertise in Big Data technologies, including Apache Airflow, Dagster, Databricks, Spark, DBT, and other modern data orchestration and transformation tools.
  • Experience implementing and deploying solutions in cloud environments (with a preference for Azure).
  • Knowledge of how to build and deploy Power BI reports and dashboards for data visualization.
  • Excellent understanding of dimensional data and data modeling techniques.
  • Consulting experience and the ability to guide clients through architectural decisions, technology selection, and best practices.
  • Ability to work independently and take ownership of project deliverables.
  • Master's or Ph.D. in Computer Science, Data Science, Mathematics, Physics, or a related field.

Work in a supportive team of passionate enthusiasts of AI & Big Data. Engage with top-tier global enterprises and cutting-edge startups on international projects. Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.

Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences, including a partnership with Databricks.

Choose from various employment options: B2B, employment contracts, or contracts of mandate. Make use of 20 fully paid days off available for B2B contractors and individuals under contracts of mandate.

Participate in team-building events and utilize the integration budget. Celebrate work anniversaries, birthdays, and milestones. Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.

Get full work equipment for optimal productivity, including a laptop and other necessary devices. With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups.

Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.

Please note that if you are NOT a passport holder of the country for the vacancy you might need a work permit.

#J-18808-Ljbffr

  • Senior Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data Engineer We seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Senior Data Engineer @

    3 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data EngineerWe seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Senior Data Engineer

    3 dni temu

    Warszawa, Mazovia, Polska TransferGo Pełny etat

    Senior Data EngineerWarszawaWarsaw, Masovian Voivodeship, PolskaJoin us on our journey as a Senior Data Engineer to play a pivotal role in shaping how money is sent worldwide. You will work in a team of bright-minded individuals looking after data delivery on time for a wide range of questions. If you want to significantly impact the fintech industry, drive...

  • Senior Data Engineer Position

    1 dzień temu

    Warszawa, Mazovia, Polska Jit Team Pełny etat

    We are seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for defining and maintaining data transformation processes using Scala and Spark. You will work closely with cross-functional teams, including DevOps, QA, and Product Management, to deliver high-quality results.Responsibilities:Designing...

  • Senior Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Senior Data Engineer (finance)lokalizacja: Warszawa (mazowieckie)numer referencyjny: 1192369/jobs.plHays IT Contracting is a cooperation based on B2B rules. We connect IT specialists with the most interesting, technological projects on the market.Join the group of 500 satisfied Contractors working for Hays' clientsFor our Client we are currently looking for...

  • Senior Data Engineer

    1 dzień temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Senior Data Engineer - Backend Developer with GCPThe project focuses on designing, developing, and optimizing data pipelines and architectures for clinical research and AI model training.Your responsibilitiesEnsuring data quality, accuracy, and integrity by continuously monitoring and optimizing ETL processesEstablishing a seamless data flow from endpoint...

  • Senior Data Engineer

    3 dni temu

    Warszawa, Mazovia, Polska emagine dla Konsultantów IT Pełny etat

    Senior Data EngineerWarszawaWarsaw, Masovian Voivodeship, PolskaTechnologies we useExpectedPythonSQLAzure Data StackApache SparkTerraformKubernetesDockerAbout the projectAs a Senior Data Engineer, you will design and build scalable Data Hubs that support analytical, reporting, operational, and Generative AI use cases. This role involves defining standards,...

  • Senior Data Collection Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Integral Solutions Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Data Collection Engineer to join our team at Integral Solutions. As a key member of our development team, you will be responsible for designing, developing, and maintaining our data collection infrastructure.Your primary focus will be on collaborating with the backend team to optimize data collection...

  • Senior Data Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    Our mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a satisfying experience....

  • Senior Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska 7N Sp z o.o. Pełny etat

    Senior Data Engineer (pharma)93_8110ObowiązkiApply data engineering practices and standards to develop robust and maintainable data pipelines Analyze and organize raw data ingestion pipelines Evaluate business needs and objectives Support senior  business stakeholders in defining new data product use cases and their value Take ownership of data product...

  • Senior Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    The project focuses on designing, developing, and optimizing data pipelines and architectures for clinical research and AI model training.Senior Data Engineer - Backend Developer with GCPYour responsibilitiesEnsuring data quality, accuracy, and integrity by continuously monitoring and optimizing ETL processes Establishing a...

  • Senior Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Rutkowski Pełny etat

    Join to apply for the Senior Data Engineer role at Tomasz Rutkowski Solo Law Firm.Join a Company That Invests in You. Seeking Alpha is the world's leading community of engaged investors. We're the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we're...

  • Senior Data Scientist Engineer

    1 dzień temu

    Warszawa, Mazovia, Polska Addepto Pełny etat

    Job SummaryWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will have at least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.The ideal candidate will have strong programming skills in Python, including writing clean code and OOP design. They will also have strong SQL...

  • Senior Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska TransferGo Pełny etat

    technologies-expected : SQL Microsoft Power BI Snowflake Data Cloud technologies-optional : AWS about-project : Join us on our journey as a Senior Data Engineer to play a pivotal role in shaping how money is sent worldwide. You will work in a team of bright-minded individuals looking after data delivery on time for a wide range of questions. If you want to...

  • Senior Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    3 weeks ago Be among the first 25 applicantsOur mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and...

  • Data Engineer

    3 dni temu

    Warszawa, Mazovia, Polska Digital Hub Warsaw at Bayer Pełny etat

    Company OverviewBayer's Digital Hub Warsaw is a state-of-the-art innovation center focused on data-driven solutions. As a Senior Data Engineer, you will be part of this dynamic team that combines cutting-edge technology with business expertise to drive growth and success.

  • Senior Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Bunge Iberica SA Pełny etat

    Bunge, a global leader in agribusiness, has an exciting opportunity available for a Senior Data Engineer. As part of a global team, you will work on challenging and meaningful projects that directly impact core business activities. Since 1818, Bunge has been connecting farmers to consumers, delivering essential food, feed, and fuel to the world. Looking...

  • Middle Senior Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    Data Engineer (Azure & Databricks)Responsibilities:Manage data pipelines and optimize query performance.Develop and maintain Azure Pipelines and Databricks jobs.Collaborate with senior stakeholders to define and improve solutions.Build robust data pipelines using DBT and implement performance optimizations.Requirements:4+ years of experience in database...

  • Senior Data Engineer Position

    7 dni temu

    Warszawa, Mazovia, Polska Mira Search Pełny etat

    We are seeking an experienced senior data engineer to lead our team in designing and implementing cloud-based data solutions. As a key member of our IT department, you will work closely with business stakeholders, data scientists, and IT leadership to ensure effective collaboration and communication.This role involves developing and maintaining complex ETL...

  • Senior Data Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    Our mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a satisfying experience....