Data Engineer
4 dni temu
We are looking for a Data Engineer for our client in the technology industry
The position is hybrid, with 2-3 days per week in the office in Warsaw.
Data Engineer performs various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesign processes and operations, developing and implementing planned solutions for refactoring of existing code and object inventory, creating end-to-end testing and implementation scenarios, through validation of migrated data, assisting with the repointing of tools and applications.
Responsibilities:
· Perform tasks related to migration and modernization of data warehouses for large projects (business analyses, collecting requirements and translating into technical solution, design, and development specifications)
· Understand existing business process and discover entities, attributes, relationships, dependencies and business rules from functional experts and user community
· Understand Business Data Model and logical mappings (source mappings, LDM mappings) and technical Source-Target mappings
· Collection and analysis of business requirements
· Develop and implement code changes for ETL Repoint, Refactor and Redesign as needed (Data Ingestion, Data Transformation/Load, ETL Tool Repointing, History Load, DDL Conversion and BI Application usage)
· Development of scripts and processes for data migration (Data profiling, analysis, data preparation and pruning)
· Perform unit testing and package jobs to be prepared for deployment
· Automate manual tasks to bring efficiency & value-add to the project
· Support testing activities and provide technical support on resolution of customer issues
· Support post-migration data validation
· Perform analysis related to queries and application workloads
· Stabilize & optimize the deployed solution with ongoing and incremental improvements
· Knowledge transfer of implemented solution to the customer teams
· Participate in Code Reviews and Contribute for planning and implementing standards for Software Quality Assurance.
· Master Data Management expertise: Support to build a system for collecting information and rules for identification unique records as a master data records. Specify methods for unification and consolidation records for custom build techniques or for reusing external systems. Support to build a system for reference data lifecycle management as input.
Requirements:
· Experience providing consulting services for development and deployment of Cloud Migration, Data Warehousing or Data Integration projects
· ETL development, implementation, documentation and testing experience.
· Familiarity with collecting business requirements and transforming them to the technical solution
· Scripting & Programming experience
· Sound knowledge in Teradata Tools and Utilities (TTU), specifically TPT/BTEQ, in data integration projects
· Excellent SQL know-how
· Understanding of modeling methodologies and conceptual, logical and physical models
· Familiarity with the creation/modification of a Data Model and Mappings or Technical ETL specifications (Source to Target Mapping)
· Master Data Management expertise: Understanding of business, technical or operational metadata collection and use.
Practical experience with data unification and consolidation techniques.
Experience with proprietary solution for MDM and RDM or with third party tools like Collibra, Informatica Metadata manager, etc.
Knowledge of Teradata products for MDM and RDM as well as DataDNA for metadata processing.
Nice To Have:
· Working knowledge of at least one ETL tool (DataStage, Informatica, Ab Initio, ODI, SSIS, etc.) and best practices
· Experience with Business Intelligence tools
· Working knowledge of CSPs (AWS/Azure/Google Cloud), Object Stores (S3, Azure Blob Storage, ADLS Gen2, Google Cloud Storage) and Open Table Formats (Iceberg, Delta Lake, Hudi)
· Teradata Vantage Functionality
· Databases & Users
· Physical Database Design
· Use of Statistics
· Performance Analysis with DBQL
· Teradata Native Object Store (NOS) capability to access data in object stores
· Knowledge of Teradata Ecosystem Applications/Tools
· QueryGrid Teradata-to-Teradata connector
· Data Mover
· Viewpoint
· Knowledge of DevOps processes and CI/CD Tools
· CI/CD pipelines with Jenkins
· Repositories (GitHub, BitBucket)
· Schedulers
· Working Knowledge of VantageCloud Lake
· Experience working with Issue Tracking Tools (such as JIRA, ALM)
· MDM expertise: knowledge of Teradata products for MDM and RDM as well as DataDNA for metadata processing
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Clouds on Mars Sp. z o.o. Pełny etatYour responsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer’s sideDesiging DWH architectureDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating of DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh concepts We...
-
Data Engineer
1 tydzień temu
Warszawa, mazowieckie, Polska RITS Professional Services Pełny etatWe are looking for Data Engineer! Hybrid work model - 2-3 times a week from the Warsaw or Prague office.As a Data Engineer, you will perform various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesigning processes and operations, developing and implementing planned solutions...
-
Senior Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Link Group Pełny etatJob Overview:We are looking for a Data Engineer with a strong background in analytics to join our expanding team. In this role, you will take the lead in developing a solid data foundation that drives data-driven strategies and unlocks the full potential of investment data. You will play a key role in optimizing data pipelines, enhancing data integration,...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAbout the role:We are seeking a Senior Data Engineer with strong experience in DBT, data warehousing, and SQL. In this role, you'll work collaboratively to optimize data solutions and lead the transition of stored procedures to DBT models. ✔️ Key responsibilities:Analyze existing stored procedures to identify candidates for migration to DBT.Convert...
-
Data Engineer
2 dni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatFor our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etatJoin our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...
-
Data Platform Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatThe ChallengeAs an enterprise producing millions of connected appliances each year, we are generating massive amounts of data. As part of our data mesh journey, your task as a Data Platform Engineer is to build, develop, operate, and maintain a self-serve data platform that will support data and AI products. You will establish foundational capabilities for...
-
Senior Data Engineer
1 dzień temu
Warszawa, mazowieckie, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska capital.com Pełny etatWe are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talent team. As a Data Engineer, you...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Samba TV Pełny etatAbout Us:Samba TV tracks streaming and broadcast video across the world with our proprietary data and technology. We are on a mission to fundamentally transform the viewing experience for everyone. Our data enables media companies to connect with audiences for new shows and movies, and enables advertisers to engage viewers and measure reach across all their...
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska LLInformatics Pełny etatLLInformatics is an IT consulting company with dozens of satisfied clients across Europe and North America. We serve businesses that expect their challenging projects to be delivered according to plan, with impeccable quality, and under strict compliance requirements. Our remote-first team of 100+ experts specializes in building high-quality digital...
-
Data Engineer Bank Fraud
2 miesięcy temu
Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you:have hands-on experience building complex data pipelines,have strong experience in data processing and optimization using Apache Spark,have good knowledge of data manipulation and transformation, have experience with Apache Airflow, Python, SQL, have knowledge of software engineering best practices, have deployment and...
-
Senior Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska NeoGames Pełny etatNeoGames is a leader in the iLottery and iGaming space offering solutions spanning game studios, game aggregation, lotteries, online casino, sportsbook, bingo, and managed services offered through an industry leading core platform.The Data & BI team owns the group’s Data & Analytics platforms spanning Data Engineering,Analytical Engineering and Business...
-
Data Engineer with Azure
4 tygodni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatWe’re looking for an experienced Data Engineer skilled in Azure and data pipeline optimization to design, build, and streamline scalable data pipelines and storage solutions that support analytics and machine learning.✔️ Key responsibilities:Design, deploy, and maintain data solutions on Azure (Data Factory, Databricks, SQL Database, Synapse).Manage...
-
Senior Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Aristocrat Interactive Pełny etatJoin Aristocrat in Bringing Joy to Life Through the Power of Play. Be part of our growing global team where people come first because they fuel our success. Here, it’s All About the Player and we create a world of its own for everyone, everywhere with premium casino and world-class digital and mobile products. Our value of Good Business, Good Citizen...
-
Data Engineer in Product Analytics
1 miesiąc temu
Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you have:hands-on experience building complex data pipelines,strong experience in data processing and optimization using Apache Spark, good knowledge of data manipulation and transformation,experience with Apache Airflow, Python, SQL, knowledge of software engineering best practices, deployment and provisioning automation tools...
-
Data Engineer AWSSnowflake
1 miesiąc temu
Warszawa, mazowieckie, Polska Lingaro Pełny etatWe are seeking an experienced Cloud Data Engineer proficient with Snowflake and AWS. The ideal candidate will have hands-on experience in designing and implementing data pipelines, data warehousing solutions, and ETL workflows. Tasks:Designing and implementing data processing systems using distributed frameworks like Snowflake. This involves writing...
-
Senior Data DevOps Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska INTER-TEAM Sp. z o.o. Pełny etatMekonomen Group – a network of leading automotive spare parts and service chains across Northern Europe (Sweden, Poland, Denmark, Norway, Finland, Estonia, and beyond) – is seeking a DevOps Engineer to lead the architecture and management of a modern data platform. This platform will support essential business functions like finance, marketing, sales,...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska VISA Pełny etatVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network,...