Senior Data Engineer
2 miesięcy temu
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.
Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
The Sr. Data Engineer (Hadoop Development) within the Sales Analytics Delivery team will be responsible for designing, developing and implementing Data integration and Analytics solutions on Hadoop and using BI tools, Data mining and/or Machine learning provide insights on the data. This position requires close collaboration with business partners to understand their business goals, understand requirements, design, develop and implement Data Analytics solutions following SDLC and agile methodologies.
Ideal candidate for this position will have a minimum of five years of experience in development and delivery of Analytics projects and three years development experience on Hadoop.
Responsibilities:
- Participate in technology project delivery activities such as gathering Business requirements, conceptual approach, design, development, test case preparation, unit/integration test execution, support process documentation
- Develop the source to target mapping documents and ETL code to load data from source to target systems
- Develop workflows and ETL using Hive scripts, Spark, Airflow, NiFi, Sqoop, Oozie and other utilities on Hadoop
- Build analytical applications using Hadoop eco system using packaged or open source technologies
- Partner with IT groups such as CIT, Engineering, Product, Security, and Infrastructure on project delivery activities
- Provide insights from data and present to IT and non-technical users to improve operations and productivity
- Unit test data loads and write scripts for data validation
- Support QA, UAT and performance testing phases of development cycle and implement DevOps principles from development to deployment to production
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.
- Bachelor’s Degree in Computer Science or related discipline
- Proven experience in Hadoop development and data integration on Hadoop is required, preferably Hive, Spark ,Presto, Airflow, Sqoop, NiFi etc.
- Two Years of experience in BI/ Analytics Tools – Power BI or Tableau or any BI tools
- Experience in RDBMS (Oracle and SQLServer) is required and knowledge of emerging technologies (NoSQL/Graph Database(neo4j)/Time Series) nice to have
- Experience in writing complex SQL and Hive QL queries is required
- Experience in Python, Shell/ Perl scripting, scheduling and version control, CI/CD technologies is required
- Experience in real time data ingestion using Kafka/Spark Streaming
- Experience in Advanced Analytics, Machine learning and data mining is nice to have.
- Experience in at least one ETL technology is required – Pentaho, Talend, Informatica
- Strong follow-through, problem identification, analysis and problem solving skills
- Demonstrated ability to learn new Information technologies and apply quickly
- Exceptional communication and customer facing skills, able to interact effectively with diverse groups of global stakeholders, both technical and business users
- Experience in Payment Processing, CRM (Salesforce/Microsoft Dynamics), Genesys Call Center domain are nice to have
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
-
Senior Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Senior Data Engineer
4 dni temu
Warszawa, mazowieckie, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...
-
Data Engineer
5 dni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatFor our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etatJoin our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAbout the role:We are seeking a Senior Data Engineer with strong experience in DBT, data warehousing, and SQL. In this role, you'll work collaboratively to optimize data solutions and lead the transition of stored procedures to DBT models. ✔️ Key responsibilities:Analyze existing stored procedures to identify candidates for migration to DBT.Convert...
-
Senior Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska NeoGames Pełny etatNeoGames is a leader in the iLottery and iGaming space offering solutions spanning game studios, game aggregation, lotteries, online casino, sportsbook, bingo, and managed services offered through an industry leading core platform.The Data & BI team owns the group’s Data & Analytics platforms spanning Data Engineering,Analytical Engineering and Business...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Clouds on Mars Sp. z o.o. Pełny etatYour responsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer’s sideDesiging DWH architectureDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating of DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh concepts We...
-
Senior Data Engineer
3 tygodni temu
Warszawa, mazowieckie, Polska Aristocrat Interactive Pełny etatJoin Aristocrat in Bringing Joy to Life Through the Power of Play. Be part of our growing global team where people come first because they fuel our success. Here, it’s All About the Player and we create a world of its own for everyone, everywhere with premium casino and world-class digital and mobile products. Our value of Good Business, Good Citizen...
-
Data Engineer with Azure
1 miesiąc temu
Warszawa, mazowieckie, Polska Billennium Pełny etatWe’re looking for an experienced Data Engineer skilled in Azure and data pipeline optimization to design, build, and streamline scalable data pipelines and storage solutions that support analytics and machine learning.✔️ Key responsibilities:Design, deploy, and maintain data solutions on Azure (Data Factory, Databricks, SQL Database, Synapse).Manage...
-
Senior Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Falck Digital Technology Poland Pełny etatAs an member of our People & Culture & ESG domain team serving Group Functions, you will be joining forces on ESG compliance data projects & data solutions regarding Falck global workforce. Example: Provide safety department with qualitative insights into workforce accidents. This role entails seamlessly integrating with source systems and establishing data...
-
Senior Data DevOps Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska INTER-TEAM Sp. z o.o. Pełny etatMekonomen Group – a network of leading automotive spare parts and service chains across Northern Europe (Sweden, Poland, Denmark, Norway, Finland, Estonia, and beyond) – is seeking a DevOps Engineer to lead the architecture and management of a modern data platform. This platform will support essential business functions like finance, marketing, sales,...
-
Data Engineer
2 tygodni temu
Warszawa, mazowieckie, Polska RITS Professional Services Pełny etatWe are looking for Data Engineer! Hybrid work model - 2-3 times a week from the Warsaw or Prague office.As a Data Engineer, you will perform various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesigning processes and operations, developing and implementing planned solutions...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Link Group Pełny etatJob Overview:We are looking for a Data Engineer with a strong background in analytics to join our expanding team. In this role, you will take the lead in developing a solid data foundation that drives data-driven strategies and unlocks the full potential of investment data. You will play a key role in optimizing data pipelines, enhancing data integration,...
-
Data Engineer
7 dni temu
Warszawa, mazowieckie, Polska RITS Professional Services Pełny etatWe are looking for a Data Engineer for our client in the technology industry!The position is hybrid, with 2-3 days per week in the office in Warsaw. Data Engineer performs various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesign processes and operations, developing and...
-
Data Platform Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatThe ChallengeAs an enterprise producing millions of connected appliances each year, we are generating massive amounts of data. As part of our data mesh journey, your task as a Data Platform Engineer is to build, develop, operate, and maintain a self-serve data platform that will support data and AI products. You will establish foundational capabilities for...
-
Senior Cloud Data Engineer SEB
2 tygodni temu
Warszawa, mazowieckie, Polska SEB Pełny etatAt least 3 years of experience working as Data Engineer with a strong tech background, you are passionate about development and developing solutions that bring value to the business. Proficiency in: data integration, data modelling, data pipelines in the cloud Experience working in: SQL and Python; Version Control (i.e. Git) and Agile development; Testing...
-
Cloud Data Engineer Webellian
2 tygodni temu
Warszawa, mazowieckie, Polska Webellian Pełny etatHard skills we are looking for: Improve and refine data ingestion and transformation pipelines (ETL/ELT). Proficiency in Python with focus on PySpark Excellence in SQL and relational databases Experience with Databrick, Azure Data Services is a plus Continuous integration, deployment, and delivery practitioner (GitHub knowledge) General understanding of...
-
Senior SDET Engineer
5 dni temu
Warszawa, mazowieckie, Polska DCV Technologies Pełny etatDear Consultant,We are looking for an experienced Senior SDET Engineer to join our multinational clients team on a B2B basis for a 6-month project. This is a fully remote opportunity, perfect for someone passionate about automation and testing with a proven track record in delivering high-quality solutions.Key Responsibilities:Design, develop, and execute...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska capital.com Pełny etatWe are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talent team. As a Data Engineer, you...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Samba TV Pełny etatAbout Us:Samba TV tracks streaming and broadcast video across the world with our proprietary data and technology. We are on a mission to fundamentally transform the viewing experience for everyone. Our data enables media companies to connect with audiences for new shows and movies, and enables advertisers to engage viewers and measure reach across all their...