Senior Data Engineer
4 tygodni temu
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.
Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.
Job Description The Sr. Data Engineer (Hadoop Development) within the Sales Analytics Delivery team will be responsible for designing, developing and implementing Data integration and Analytics solutions on Hadoop and using BI tools, Data mining and/or Machine learning provide insights on the data. This position requires close collaboration with business partners to understand their business goals, understand requirements, design, develop and implement Data Analytics solutions following SDLC and agile methodologies.
Ideal candidate for this position will have a minimum of five years of experience in development and delivery of Analytics projects and three years development experience on Hadoop.
Responsibilities:
Participate in technology project delivery activities such as gathering Business requirements, conceptual approach, design, development, test case preparation, unit/integration test execution, support process documentation
Develop the source to target mapping documents and ETL code to load data from source to target systems
Develop workflows and ETL using Hive scripts, Spark, Airflow, NiFi, Sqoop, Oozie and other utilities on Hadoop
Build analytical applications using Hadoop eco system using packaged or open source technologies
Partner with IT groups such as CIT, Engineering, Product, Security, and Infrastructure on project delivery activities
Provide insights from data and present to IT and non-technical users to improve operations and productivity
Unit test data loads and write scripts for data validation
Support QA, UAT and performance testing phases of development cycle and implement DevOps principles from development to deployment to production
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.
Qualifications Bachelor’s Degree in Computer Science or related discipline
Proven experience in Hadoop development and data integration on Hadoop is required, preferably Hive, Spark ,Presto, Airflow, Sqoop, NiFi etc.
Two Years of experience in BI/ Analytics Tools – Power BI or Tableau or any BI tools
Experience in RDBMS (Oracle and SQLServer) is required and knowledge of emerging technologies (NoSQL/Graph Database(neo4j)/Time Series) nice to have
Experience in writing complex SQL and Hive QL queries is required
Experience in Python, Shell/ Perl scripting, scheduling and version control, CI/CD technologies is required
Experience in real time data ingestion using Kafka/Spark Streaming
Experience in Advanced Analytics, Machine learning and data mining is nice to have.
Experience in at least one ETL technology is required – Pentaho, Talend, Informatica
Strong follow-through, problem identification, analysis and problem solving skills
Demonstrated ability to learn new Information technologies and apply quickly
Exceptional communication and customer facing skills, able to interact effectively with diverse groups of global stakeholders, both technical and business users
Experience in Payment Processing, CRM (Salesforce/Microsoft Dynamics), Genesys Call Center domain are nice to have
Additional Information Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
-
Senior Data Engineer
5 miesięcy temu
Warsaw, Polska VGW Pełny etatSenior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games. We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...
-
Senior Data Engineer
1 tydzień temu
Warsaw, Polska Sunscrapers sp. z o.o. Pełny etatAre you ready to take the challenge?We’re looking for a Senior Data Engineer to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust...
-
Senior Data Engineer
4 miesięcy temu
Warsaw, Polska Chabre IT Services Sp. z.o.o Pełny etatWorking as a Senior Data Engineer, you will:Design and develop geospatial data pipelinesIntegrate various data sources to support construction site analyticsTake leading role in defining requirements, data architecture design and planningCollaborate with a team of developers and DevOps to enhance platform capabilitiesMaintain high quality and performance of...
-
Senior Data Engineer
6 miesięcy temu
Warsaw, Polska Ecovadis Pełny etatDescription We are looking for a Senior Data Engineer to join our growing data platform team. We need a skilled engineer who will help us develop and maintain data architectures and processing solutions that power our data scientists, BI analytics and many other internal data consumers. One major role of the team is to prepare and maintain self-serve...
-
Senior Data Engineer
1 miesiąc temu
Warsaw, Polska IT Performance Pełny etatPoszukujemy kandydatów na stanowisko Senior Data Engineer. Praca jest dedykowana dla międzynarodowej firmy z obszaru technologii medycznych/farmacji.ObowiązkiProjektowanie, rozwijanie i utrzymywanie solidnych, skalowalnych i wydajnych Data/ETL PipelinówTworzenie i utrzymywanie modeli oraz architektury danych w celu zapewnienia integralności i optymalnej...
-
Senior Data Engineer
5 miesięcy temu
Warsaw, Polska emagine Consulting Pełny etatIndustry: Banking Work model: hybrid in Warsaw office (2 days a week working from home) Assignment Type: B2B Project Length: 12 months (extendable) Start Date: ASAP Project Language: English About a role: As a Senior Data Engineer, you will join a team that is part of the data platforms and services department. The domain is responsible...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska BEC Poland Pełny etatSenior Data Engineer For this role, we are looking for someone to join Nykredit – one of the banks BEC Poland works closely with. Nykredit is both a bank and a mortgage provider owned by an association of customers. Being customer-owned, they are in a unique position to give something back to their customers when they are doing well. Together they can...
-
Senior Data Engineer
2 miesięcy temu
Warsaw, Polska Alter Solutions Pełny etatJob DescriptionThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4 years (senior) of experience working with ETL, data...
-
Senior Azure Data Engineer
6 miesięcy temu
Warsaw, Polska C&F S.A. Pełny etatC&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry. Senior Azure Data...
-
Senior Data Engineer
2 miesięcy temu
Warsaw, Polska ALTER SOLUTIONS Pełny etatCompany Description Our mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a...
-
Senior Cloud Data Engineer
4 miesięcy temu
Warsaw, Polska hirely Pełny etatSpółkę HIRELY tworzą profesjonaliści, którzy posiadają wiele lat doświadczenia w takich obszarach jak: IT, BI, zarządzanie projektami i przedsiębiorstwami. Cechuje nas wysoka jakość i efektywność realizowanych projektów poprzez właściwe dopasowanie kandydata do profilu poszukiwanego stanowiska i kultury organizacyjnej panującej w...
-
Senior Data Engineer
1 dzień temu
Warsaw, Polska Chabre IT Services Sp. z.o.o Pełny etatWorking as a Senior Data Engineer, you will:Collaborate with customers to design, build, and maintain comprehensive data platforms, ensuring smooth data sourcing and availability for usersTake responsibility for orchestration, security, and user adoption of data solutionsDevelop and design a reliable, user-friendly, and easily manageable data platform within...
-
Senior Data Platform Engineer
2 miesięcy temu
Warsaw, Polska RITS Pełny etatWe are looking for a Senior Data Platform Engineer to join remotely one of the exciting projects within a global, American, market-leading, NYSE-listed trading platform. We (at RITS) work in the cooperation/partnership model where we see our consultants as clients as well. Currently, we are an exclusive Polish vendor for this particular client which is a...
-
Field Tech Senior Analyst
5 miesięcy temu
Warsaw, Polska NTT DATA Pełny etatJob Description Req ID: 287191 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Field Tech Senior Analyst to join our team in warsaw, Mazowieckie (PL-MZ), Poland (PL).Onsite...
-
Senior Data Engineer
5 miesięcy temu
Warsaw, Polska Intuition Machines, Inc. Pełny etatIntuition Machines uses AI/ML to build enterprise security products. We apply our research to systems that serve hundreds of millions of people, with a team distributed around the world. You are probably familiar with our best-known product, the hCaptcha security suite. Our approach is simple: low overhead, small teams, and rapid iteration.We are seeking a...
-
Data Engineer w/ Databricks
2 tygodni temu
Warsaw, Polska IT LeasingTeam Sp. z o.o. Pełny etatIT LeasingTeam realizuje usługi w zakresie pozyskiwania dla organizacji wysokiej klasy specjalistów i kadry zarządzającej z obszaru IT a także rozwija i wdraża nowoczesne rozwiązania IT w ramach outsourcingu procesów. IT LeasingTeam wspiera procesy biznesowe firm, umożliwiając im zwiększenie elastyczności i budowanie przewagi konkurencyjnej....
-
Senior Data Scientist
4 tygodni temu
Warsaw, Polska Bosch Pełny etatJob Description We are seeking a highly skilled and experienced Senior Data Scientist / AI Engineer to join our team. As a Senior Data Scientist / AI Engineer, you will be responsible for developing and implementing cutting-edge solutions using Python, Machine Learning, LLMs, and classical NLP methodologies. You will work closely with our team of experts...
-
Data Engineer w/ Snowflake
1 miesiąc temu
Warsaw, Polska IT LeasingTeam Sp. z o.o. Pełny etatIT LeasingTeam realizuje usługi w zakresie pozyskiwania dla organizacji wysokiej klasy specjalistów i kadry zarządzającej z obszaru IT a także rozwija i wdraża nowoczesne rozwiązania IT w ramach outsourcingu procesów. IT LeasingTeam wspiera procesy biznesowe firm, umożliwiając im zwiększenie elastyczności i budowanie przewagi konkurencyjnej....
-
Senior Data Engineer
6 miesięcy temu
Warsaw, Polska YourITeams Pełny etatWe are looking for a Senior Data Engineer, whose role involves crafting, constructing, and upholding the structure, tools, and procedures essential for an organization to gather, store, modify, and scrutinize extensive data amounts.Remote work.Contract: B2B, UoP DutiesWorking alongside Platform Engineers to assess and choose suitable technologies and...
-
Senior Data Engineer
3 miesięcy temu
Warsaw, Polska Siemens Healthcare Sp. z o.o. Pełny etatSenior DataConversion Engineer (f/m/d) Location:Poland Doyou want to help create the future of healthcare? Our name, SiemensHealthineers, was selected to honor our people who dedicate their energy andpassion to this cause. It reflects their pioneering spirit combined with ourlong history of engineering in the ever-evolving healthcare industry. We...