Data Engineer with GCP
2 miesięcy temu
Tasks:
- You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery)
- Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed. The role will include direct contact with clients.
- Modelling the data from various sources and technologies. Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities.
- Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems. Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval. Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
- Identifying and resolving issues related to data processing, storage, or infrastructure. Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations.
- Train and mentor junior data engineers, providing guidance and knowledge transfer.
Requirements:
Must have:
- At least 4 years of experience as a Data Engineer, including min. 3 years of experience working with GCP cloud-based infrastructure & systems.
- Strong knowledge in cloud computing platforms - Google Cloud - Candidate should be able to design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms.
- Programming skills (SQL, Python, other scripting).
- Proficient in data modeling techniques and database optimization. Knowledge of query optimization, indexing, and performance tuning is necessary for efficient data retrieval and processing.
- Proficient in database management systems such as SQL (Big Query is a must), NoSQL, Candidate should be able to design, configure, and manage databases to ensure optimal performance and reliability.
- Knowledge of at least one orchestration and scheduling tool (like Airflow).
- Experience with data integration tools and techniques, such as ETL and ELT Candidate should be able to integrate data from multiple sources and transform it into a format that is suitable for analysis.
- Knowledge of modern data transformation tools (such as DBT, Dataform).
- Excellent communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders. Ability to convey technical concepts to non-technical stakeholders in a clear and concise manner.
- Tools knowledge: Git, Jira, Confluence, etc.
- Open to learn new technologies and solutions.
- Experience in multinational environment and distributed teams.
- English: C1
Good to have:
- Certifications in big data technologies or/and cloud platforms.
- Experience with BI solutions (e.g. Power BI, Tableau).
- Experience with ETL tools: e.g. Talend, Alteryx.
- Experience with Azure cloud-based infrastructure & systems.
We offer:
- Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
- “Office as an option” model. You can choose to work remotely or in the office.
- Great Place to Work® certified employer.
- Flexibility regarding working hours and your preferred form of contract.
- Comprehensive online onboarding program with a “Buddy” from day 1.
- Cooperation with top-tier engineers and experts.
- Unlimited access to the Udemy learning platform from day 1.
- Certificate training programs. Lingarians earn 500+ technology certificates yearly.
- Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
- Grow as we grow as a company. 76% of our managers are internal promotions.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
- Create our community together. Refer your friends to receive bonuses.
- Activities to support your well-being and health.
- Plenty of opportunities to donate to charities and support the environment.
- Modern office equipment. Purchased for you or available to borrow, depending on your location.
-
Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatFor our Client from banking industry we are looking for Data Engineer (medior and senior). Technical skills are similar for both, Medior and Senior roles, and80%-90% of responsibility is data pipelines developmentMust have:pySparkManaging Spark clustersGCP (other cloud providers are not relevant)Overall implementation of data pipelines is fine, their...
-
Data Engineer PKO Finat
1 miesiąc temu
Warszawa, mazowieckie, Polska PKO Finat Pełny etatPoszukiwane kompetencje: 1. Co najmniej 5-letnie doświadczenie jako Developer ETL w obszarze procesów integracji danych na on-prem : Biegłe posługiwanie się narzędziami ETL na on-prem na poziomie zaawansowanym : Informatic Power Center , ** NIFI Ekspercka znajomość relacyjne bazy danych Oracle, PostgeSQL , ScyllaDB (projektowanie, budowa i tiuning...
-
DevOps GCP
1 tydzień temu
Warszawa, mazowieckie, Polska Upvanta Pełny etatAre you ready to take your career to the next level? We’re looking for DevOps to support a new global project with a top-tier client. Your responsibilites:Integrate automated testing, code quality checks, and security scans into the pipeline.Manage, and optimize Azure DevOps pipelines for automated deployment of GCP resources.Write and maintain Terraform...
-
Senior Data Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Craftware Pełny etatAre you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer, where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization.This position offers the opportunity to work on diverse projects...
-
Data Engineer Bank Fraud
3 miesięcy temu
Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you:have hands-on experience building complex data pipelines,have strong experience in data processing and optimization using Apache Spark,have good knowledge of data manipulation and transformation, have experience with Apache Airflow, Python, SQL, have knowledge of software engineering best practices, have deployment and...
-
DATA Engineer
6 dni temu
Warszawa, mazowieckie, Polska PAYBACK Pełny etatPAYBACK is the world’s leading multi-partner loyalty program. As an international player, we operate in German, Italian, Mexican, and Austrian markets. More than 10 million active customers already use the German PAYBACK app and mobile PAYBACK services via their smartphones.PAYBACK is a top player in data-driven marketing. With the ability to develop...
-
Data Engineer with Azure
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatWe’re looking for an experienced Data Engineer skilled in Azure and data pipeline optimization to design, build, and streamline scalable data pipelines and storage solutions that support analytics and machine learning.✔️ Key responsibilities:Design, deploy, and maintain data solutions on Azure (Data Factory, Databricks, SQL Database, Synapse).Manage...
-
Data Engineer in Product Analytics
2 miesięcy temu
Warszawa, mazowieckie, Polska ING Hubs Poland Pełny etatWe are looking for you, if you have:hands-on experience building complex data pipelines,strong experience in data processing and optimization using Apache Spark, good knowledge of data manipulation and transformation,experience with Apache Airflow, Python, SQL, knowledge of software engineering best practices, deployment and provisioning automation tools...
-
Data Engineer
5 dni temu
Warszawa, mazowieckie, Polska Semantive Pełny etatWe are an independent multi-cloud services company that helps enterprises and SMB companies build new foundations for future growth through successful cloud transformation and breadth of expertise in applying cloud technologies to unlock new possibilities. Today's digital and technological revolution is an important part of our business - we are not only...
-
SRE DevOps Engineer GCP
2 tygodni temu
Warszawa, mazowieckie, Polska emagine Polska Pełny etatWork mode: occasional office visits:Krakow and the surrounding area – 5 times a monthWarsaw and the surrounding area – 3 times a month (office in Warsaw)Outside Warsaw and Krakow – once a month or 3x quarterly (if someone prefers to come once for 3 days).⏰Start: ASAP/ 1 month.⏳Contract: B2B - min. 12 months contracts + extensions.Project language:...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska Aristocrat interactive Pełny etatResponsibilities:Create data pipelines – both as batch and in real-time - to ingest data from dissimilar sourcesCollaborate with the other teams to address data sourcing and provision requirementsDesign and monitor robust, recoverable data pipelines following best practices with an eye out for performance, reliability, and monitoringInnovation drives us -...
-
Senior Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAs a Senior Data Engineer, you’ll be responsible for designing, developing, and maintaining our data infrastructure to ensure scalability and efficiency. Working closely with data scientists, analysts, and stakeholders, you’ll optimize data flows, enhance data quality, and support analytics and machine learning projects.✔️ Key responsibilities:Build...
-
Data Engineer
1 miesiąc temu
Warszawa, mazowieckie, Polska RITS Professional Services Pełny etatWe are looking for Data Engineer! Hybrid work model - 2-3 times a week from the Warsaw or Prague office.As a Data Engineer, you will perform various tasks during the Data Warehouse migration and modernization implementations such as analyses, gathering business requirements, redesigning processes and operations, developing and implementing planned solutions...
-
Data Software Engineer Upskilling position for Python Developers
2 miesięcy temu
Warszawa, mazowieckie, Polska EPAM Systems Pełny etatIf you are an experienced Python Developer yearning to expand your skills in the data field, we present an extraordinary opportunity to scale up as a Data Software Engineer!You’ll broaden your skills set, enhance your career potential, and work with top trending technologies in a fascinating domain. This is a chance to step up, embrace change, and...
-
Senior Data Engineer
3 miesięcy temu
Warszawa, mazowieckie, Polska Volkswagen Financial Services Pełny etatJoin our newly created European Data & Analytics HUB!This strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently and compliantly in their business decisions.D&A originally has been set up as central HQ function...
-
AI Engineer
4 tygodni temu
Warszawa, mazowieckie, Polska Billennium Pełny etatJoin our team as an AI Engineer and work on cutting-edge solutions in AI and machine learning. If you're passionate about coding, have hands-on experience in NLP, and are excited to solve complex problems, we'd love to hear from you.Responsibilities:Develop and optimize AI models and solutions, with a focus on natural language processing (NLP).Write...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska capital.com Pełny etatWe are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talent team. As a Data Engineer, you...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Billennium Pełny etatAbout the role:We are seeking a Senior Data Engineer with strong experience in DBT, data warehousing, and SQL. In this role, you'll work collaboratively to optimize data solutions and lead the transition of stored procedures to DBT models. ✔️ Key responsibilities:Analyze existing stored procedures to identify candidates for migration to DBT.Convert...
-
Data Engineer Python
1 dzień temu
Warszawa, mazowieckie, Polska Antal Sp. z o.o. Pełny etatKey Responsibilities:Develop and implement data quality controls using Python to ensure data integrity.Design and create Power BI dashboards to help monitor and visualize data management processes.Conduct workshops with data domain teams to understand business data needs and deploy the Data Management Framework.Automate workflows to execute controls and...
-
Data Engineer
2 miesięcy temu
Warszawa, mazowieckie, Polska Samba TV Pełny etatAbout Us:Samba TV tracks streaming and broadcast video across the world with our proprietary data and technology. We are on a mission to fundamentally transform the viewing experience for everyone. Our data enables media companies to connect with audiences for new shows and movies, and enables advertisers to engage viewers and measure reach across all their...