Senior Data Engineer
2 tygodni temu
Warszawa
Warsaw, Masovian Voivodeship, Polska
Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.
CUSTOMER
Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries.
PROJECT
Within an internal project at Sigma Software, we have two primary goals: to automate reporting and to create a self-service data analytics system for our company.
You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset, and other roles consuming such data. Additionally, you'll work with various other team members who rely on this data. Part of your task will involve transitioning our on-premises solution to a cloud-based environment.
REQUIREMENTS
- Conceptual knowledge of data analytics fundamentals, e. g. , dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
- Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
- Experience in database development and data modeling, ideally with Databricks/Spark
- Experience with Python
- Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
- Experience debugging and optimizing Spark jobs
- Strong written and verbal communication skills
- At least an Upper-Intermediate level of English
- BS in Computer Science or a related field
- Experience with a Business Intelligence tool is a nice-to-have
Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.
CUSTOMER
Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries.
PROJECT
Within an internal project at Sigma Software, we have two primary goals: to automate reporting and to create a self-service data analytics system for our company.
You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset, and other roles consuming such data. Additionally, you'll work with various other team members who rely on this data. Part of your task will involve transitioning our on-premises solution to a cloud-based environment.
, [Our goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources, Lay down the foundation and model the data, Develop a platform for building and maintaining data pipelines that collect data from different sources, Create Data Warehouse, Analyze and prepare domain descriptions in collaboration with Business analytics, Create Data Marts, Design a permission model with flexible control over vertical and horizontal access to data] Requirements: SQL, Python, Databricks, ETL, Spark, BS Senior Data Engineer (Internal Project) @ Sigma SoftwareWarszawa
Warsaw, Masovian Voivodeship, Polska
Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.
CUSTOMER
Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries.
PROJECT
Within an internal project at Sigma Software, we have two primary goals: to automate reporting and to create a self-service data analytics system for our company.
You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset, and other roles consuming such data. Additionally, you'll work with various other team members who rely on this data. Part of your task will involve transitioning our on-premises solution to a cloud-based environment.
REQUIREMENTS
- Conceptual knowledge of data analytics fundamentals, e. g. , dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
- Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
- Experience in database development and data modeling, ideally with Databricks/Spark
- Experience with Python
- Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
- Experience debugging and optimizing Spark jobs
- Strong written and verbal communication skills
- At least an Upper-Intermediate level of English
- BS in Computer Science or a related field
- Experience with a Business Intelligence tool is a nice-to-have
Seeking Senior Data Engineer to lead a small team, modernize a simple data platform into a cloud-based self-service analytics project.
CUSTOMER
Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries.
PROJECT
Within an internal project at Sigma Software, we have two primary goals: to automate reporting and to create a self-service data analytics system for our company.
You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset, and other roles consuming such data. Additionally, you'll work with various other team members who rely on this data. Part of your task will involve transitioning our on-premises solution to a cloud-based environment.
, [Our goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources, Lay down the foundation and model the data, Develop a platform for building and maintaining data pipelines that collect data from different sources, Create Data Warehouse, Analyze and prepare domain descriptions in collaboration with Business analytics, Create Data Marts, Design a permission model with flexible control over vertical and horizontal access to data] Requirements: SQL, Python, Databricks, ETL, Spark, BSFirma: Sigma Software
Dodano:
Praca na stanowisku - aktualna
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Reckitt Pełny etatSenior Data Engineer City: Warszawa About Us We're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data...
-
Senior Data Engineer @
2 tygodni temu
Warszawa, Mazovia, Polska Sunscrapers Pełny etatSenior Data Engineer @ Sunscrapers Warsaw, Masovian Voivodeship Senior Data Engineer @ Sunscrapers Warszawa Warsaw, Masovian Voivodeship, Polska Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etatDla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcieSenior Data EngineerTwój zakres obowiązkówOdpowiedzialność za architekturę danych komenrcyjnych w Azure Rozwój modelu danych w chmurze na rzecz procesów BI w...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska LITE E-COMMERCE sp. z o.o. Pełny etatSenior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :PythonSQLtechnologies-optional :PubSubKafkaTerraformDockerabout-project :We are currently looking for a Senior Data Engineer, who will become Lite's hero or heroine in the mission of technological development of the worldresponsibilities :designing and building a...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska YourITeams Pełny etatWe are currently seeking a Senior Data Engineer to join our team! As a Senior Data Engineer, you will be responsible for creating and maintaining the infrastructure, tools, and processes necessary for our organization to handle large amounts of data effectively.This position offers the flexibility of remote work and is available on a contract...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Ecovadis Pełny etatSenior Data Engineer at EcoVadis We are seeking a Senior Data Engineer to be part of our expanding data platform unit at EcoVadis. Our team needs a skilled professional who can aid in the development and upkeep of data infrastructures and processing solutions crucial for our data scientists and internal data users. One of the core tasks involves building...
-
Senior Data Engineer
4 tygodni temu
Warszawa, Mazovia, Polska Reckitt Pełny etatAbout UsWe're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data driven thinkers to make it happen....
-
Senior Data Engineer
1 miesiąc temu
Warszawa, Mazovia, Polska Reckitt Pełny etatAbout UsWe're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data driven thinkers to make it happen....
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etatSenior Data Engineer Warszawa Warszawa, mazowieckie, Polska Dla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcie Twój zakres obowiązków Odpowiedzialność za architekturę danych komenrcyjnych w AzureRozwój modelu...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Alter Solutions Pełny etatJob DescriptionThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4 years (senior) of experience working with ETL, data...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska ALTER SOLUTIONS Pełny etatJob Description The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions. Qualifications Minimum 4 years (senior) of experience working with ETL , ...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Alter Solutions Group Pełny etatThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting.The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4years (senior) of experience working with ETL, data modeling, and data...
-
Senior Data Engineer @
2 tygodni temu
Warszawa, Mazovia, Polska Capgemini Polska Sp. Z O.o. Pełny etatSenior Data Engineer Capgemini Engineering is a world leader in engineering and R& D services.We combine our broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds.Every day, we help our clients to accelerate their journey towards Intelligent Industry.At Capgemini, we are a...
-
Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska DATA MART Consulting GmbH Pełny etatOverview:SOFTSWISS continues to expand the team and is looking for a middle Data Engineer. We need a true, experienced, and accomplished professional who shares our culture and values.Key responsibilities:Design, construct, install, test, and maintain datasets for the team, ensuring data availability and accessibility Assist in the design and maintenance of...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Circle K Business Centre Pełny etatThe Senior Data Engineer will be pivotal in creating data exchange interfaces for critical business applications within the global fuels logistic processes. This role will involve technical proficiency in developing and maintaining ETL processes the same as strategic thinking in terms of architecture and overall project ownership.This is an exciting...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska GetInData | Part of Xebia Pełny etatSenior Data Engineer (GCP) @ GetInData | Part of Xebia Warsaw, Masovian Voivodeship Senior Data Engineer (GCP) @ GetInData | Part of Xebia Warszawa Warsaw, Masovian Voivodeship, Polska A Data Engineer's role involves crafting, constructing, and upholding the structure, tools, and procedures essential for an organization to gather, store, modify, and...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska HCLTech Pełny etatSenior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska Responsibilities• Partner with leadership, engineers, program managers and data scientists to understand data needs.• Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time...
-
Senior Data Engineer z
2 tygodni temu
Warszawa, Mazovia, Polska dmTECH Polska Pełny etatSenior Data Engineer z j.niemieckim Warszawa, mazowieckie Senior Data Engineer z j.niemieckim Warszawa Warszawa, Województwo mazowieckie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska Digital Turbine Pełny etatSenior Data Engineer Warsaw, PolandEMEA – Tech - Data /Full-time /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences...
-
Senior Data Engineer
2 tygodni temu
Warszawa, Mazovia, Polska The Codest Pełny etatSenior Data Engineer Warszawa Warsaw, Polska Salary brackets: PLN net / month (B2B)Who we're looking for?? Key Requirements:Extensive experience with Python programming language and with data engineering projects (around 7 years of commercial experience)Experience with data orchestration tools such as Airflow and PrefectGood familiarity with...
