Data Engineer with GCP

4 tygodni temu

Warsaw, Polska Lingaro Pełny etat

Tasks:
You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery)
Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed. The role will include direct contact with clients.
Modelling the data from various sources and technologies. Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities.
Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems. Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval. Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
Identifying and resolving issues related to data processing, storage, or infrastructure. Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations.
Train and mentor junior data engineers, providing guidance and knowledge transfer.

Requirements:
Must have:
At least 4 years of experience as a Data Engineer, including min. 3 years of experience working with GCP cloud-based infrastructure & systems.
Strong knowledge in cloud computing platforms - Google Cloud - Candidate should be able to design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms.
Programming skills (SQL, Python, other scripting).
Proficient in data modeling techniques and database optimization. Knowledge of query optimization, indexing, and performance tuning is necessary for efficient data retrieval and processing.
Proficient in database management systems such as SQL (Big Query is a must), NoSQL, Candidate should be able to design, configure, and manage databases to ensure optimal performance and reliability.
Knowledge of at least one orchestration and scheduling tool (like Airflow).
Experience with data integration tools and techniques, such as ETL and ELT Candidate should be able to integrate data from multiple sources and transform it into a format that is suitable for analysis.
Knowledge of modern data transformation tools (such as DBT, Dataform).
Excellent communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders. Ability to convey technical concepts to non-technical stakeholders in a clear and concise manner.
Tools knowledge: Git, Jira, Confluence, etc.
Open to learn new technologies and solutions.
Experience in multinational environment and distributed teams.
English: C1

Good to have:
Certifications in big data technologies or/and cloud platforms.
Experience with BI solutions (e.g. Power BI, Tableau).
Experience with ETL tools: e.g. Talend, Alteryx.
Experience with Azure cloud-based infrastructure & systems.

We offer:
Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
“Office as an option” model. You can choose to work remotely or in the office.
Great Place to Work® certified employer.
Flexibility regarding working hours and your preferred form of contract.
Comprehensive online onboarding program with a “Buddy” from day 1.
Cooperation with top-tier engineers and experts.
Unlimited access to the Udemy   learning platform from day 1.
Certificate training programs. Lingarians earn 500+ technology certificates yearly.
Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
Grow as we grow as a company. 76% of our managers are internal promotions.
A diverse, inclusive, and values-driven community.
Autonomy to choose the way you work. We trust your ideas.
Create our community together. Refer your friends to receive bonuses.
Activities to support your  well-being and health.
Plenty of opportunities to donate to charities and support the environment.
Modern office equipment. Purchased for you or available to borrow, depending on your location.

  • GCP Data Engineer

    6 miesięcy temu

    Warsaw, Polska ING Pełny etat

    We are looking for you,if you: have Infrastructure as Code mindset (Terraform knowledge preferred with Azure DevOps pipelines), have experience with public cloud networking, have experience with managed cloud services (GCP preferred: GKE, GCS, BQ, Dataproc), have hands-on distributed monitoring and logging experience (Prometheus, Elastic...

  • GCP Senior Data Engineer

    3 tygodni temu

    Warsaw, Polska RITS Pełny etat

    Opis roliPoszukujemy doświadczonego inżyniera danych na stanowisko GCP Senior Data Engineer, który dołączy do naszego zespołu w RITS Group. Osoba na tym stanowisku będzie odpowiedzialna za prowadzenie wczesnych prac z Google Cloud Platform, w tym za pozyskiwanie danych z AWS i DBx oraz tworzenie kilku ścieżek przetwarzania danych z AWS do GCP z...

  • Senior DevOps Engineer with GCP

    5 miesięcy temu

    Warsaw, Polska Daxx Pełny etat

    Grid Dynamics is a leading provider of cutting-edge technological solutions for businesses across various industries. We are seeking an experienced Senior DevOps Engineer to join our team and contribute to the delivery of our world-class services. The Senior DevOps Engineer will be responsible for developing, deploying, and maintaining our infrastructure...

  • GCP Data Architect

    3 tygodni temu

    Warsaw, Polska RITS Pełny etat

    Opis roliJako GCP Data Architect w RITS Group, będziesz pełnił kluczową rolę w projektowaniu i wdrażaniu zaawansowanych rozwiązań danych. Twoje codzienne obowiązki będą obejmować tworzenie wysokopoziomowych (HLD) oraz szczegółowych (LLD) projektów architektury potoków danych w środowisku GCP. Będziesz pracować w dynamicznym środowisku z...

  • Senior Data Engineer

    1 tydzień temu

    Warsaw, Polska Craftware Pełny etat

    Are you a skilled data engineer ready to tackle complex challenges and build cutting-edge data solutions? Join our team as a Senior Data Engineer , where you will leverage your expertise in Snowflake, data pipelines, and analytics to enable data-driven decision-making across our organization. This position offers the opportunity to work on diverse...

  • Senior Cloud Engineer with GCP

    4 miesięcy temu

    Warsaw, Polska GFT Technologies SE Pełny etat

    What will you do?   Cloud Engineer tasks will include e xecution of tasks related to the analysis and implementation of updates and improvements to existing public cloud environments and Infrastructure as Code (IaC) solutions – Terraform. Execution of tasks recognized and addressed by the Bank in the area of public clouds and...

  • GCP Infrastructure Engineer

    6 miesięcy temu

    Warsaw, Polska Endava Pełny etat

    Job DescriptionOur infrastructure specialists are responsible for designing and implementing back-end services. They ensure reliability, security, and scalability for all platform layers within our solutions. Infrastructure teams provide expertise across virtualization, cloud services, storage solutions, cybersecurity, and scripting and...

  • Data Engineer

    3 miesięcy temu

    Warsaw, Polska Orange Business Services Pełny etat

    about the role Design, development and optimization of data models Building and maintaining databases, data warehouses, data processing and storage systems Creating and managing ETL/ELT processes Cleaning, transforming and processing data to ensure its quality, consistency and compliance with business requirements Creating scripts and procedures...

  • Senior Data Platform Engineer

    3 miesięcy temu

    Warsaw, Polska RITS Pełny etat

    We are looking for a Senior Data Platform Engineer to join remotely one of the exciting projects within a global, American, market-leading, NYSE-listed trading platform. We (at RITS) work in the cooperation/partnership model where we see our consultants as clients as well. Currently, we are an exclusive Polish vendor for this particular client which is a...

  • Data Services Engineer

    2 miesięcy temu

    Warsaw, Polska Devoteam Global Managed Services Pełny etat

    Job DescriptionWe are looking for a highly motivated Data Engineer (Mid level)  to use their experience in the public cloud to interpret our customers’ needs and extract value from their data using GCP and its suite of tools. You will primarily work as part of the data team.You will be involved in building upon our customers’ cloud infrastructure and...

  • Data Scientist

    1 miesiąc temu

    Warsaw, Polska auticon Pełny etat

    Data Scientist / Data Engineer – Join Our Inclusive Team at auticonLocation: Poland (Remote/Hybrid options available)Full-Time PositionAbout auticonauticon is a German-Norwegian social enterprise dedicated to empowering neurodivergent talent by integrating individuals on the autism spectrum into technical and IT-related roles. For over 15 years, we’ve...

  • Data Services Engineer

    2 miesięcy temu

    Warsaw, Polska Devoteam Pełny etat

    Company Description Devoteam , a group of 8000+ digital transformakers, consists of multiple business units and entities spread around the world in 25+ countries. Poland is one of them! As #1 partner of the GCP in the EMEA region, we are blazing trails across the world by partnering with Google to provide cloud solutions for thousands of businesses...

  • Lead Data Engineer

    7 miesięcy temu

    Warsaw, Polska JPMorgan Chase & Co. Pełny etat

    Join our digital bank, Chase, a trusted name in the US and rapidly growing in the UK. We're revolutionizing mobile banking with a start-up mentality, offering you the chance to make a significant impact. Our culture values diversity, fostering a team that truly represents the communities we serve. Our Data Engineering team is central to this mission,...

  • Data Engineer Bank Fraud

    7 miesięcy temu

    Warsaw, Polska ING Pełny etat

    We are looking for you, if you: have hands-on experience building complex data pipelines, have strong experience in data processing and optimization using Apache Spark, have good knowledge of data manipulation and transformation, have experience with Apache Airflow, Python, SQL, have knowledge of software engineering best practices, have...

  • Data Engineer

    1 miesiąc temu

    Warsaw, Polska Intetics Pełny etat

    Designing and building data pipelines consuming from our Enterprise Data Platform and providing data for insights, profiling, and advanced analytics.Requirements Highly skilled data engineer with basic understanding of data science, machine learning and Al needs from the data perspective. Strong computer science background and coding skills. Java, Python &...

  • Data Engineer

    1 miesiąc temu

    Warsaw, Polska Aristocrat Interactive Pełny etat

    We are currently looking for a Data Engineer who likes the sound of all that! In this role, you would be part of the Data & Analytics team and would evaluate requirements, design, code, and maintain high-performance data systems to drive informed decision-making. What You'll Do Create data pipelines to ingest data from dissimilar sources (performance,...

  • Data Engineer Domestic Bank Fraud

    7 miesięcy temu

    Warsaw, Polska ING Pełny etat

    We are looking for you, if you: have hands-on experience building complex data pipelines, have strong experience in data processing and optimization using Apache Spark, have good knowledge of data manipulation and transformation, have experience with Apache Airflow, Python, SQL, have knowledge of software engineering best practices, have...

  • Data Engineer

    1 miesiąc temu

    Warsaw, Polska EAGERDEVS Pełny etat

    Poszukujemy Data Engineera, który wesprze zespół w projektowaniu, budowie i optymalizacji potoków danych, koncentrując się na wydajności i utrzymaniu czystości architektury danych. Obowiązki: Projektowanie i rozwijanie potoków danych na platformie Databricks.Implementacja transformacji danych przy użyciu SQL (widoki, widoki...

  • Data Engineer

    4 tygodni temu

    Warsaw, Polska Intetics Pełny etat

    Our Client:A global logistics and transportation provider that offers a comprehensive range of services, including freight forwarding, supply chain management, and warehousing solutions. The company operates across air, sea, and road transportation, catering to diverse industries worldwide. It is known for its ability to deliver tailored logistics solutions,...

  • Mid/Senior Data Engineer with GCP/AWS and Python

    7 miesięcy temu

    Warsaw, Polska CodiLime Pełny etat

    Your role As a part of the project team, you will be responsible for: • Designing and implementing features in GCP's BigQuery and Cloud Functions (Python) • Implementing solutions suitable for either OLTP or OLAP approaches • Investigating possible bottlenecks and improving overall databases’ performance • Taking part in technical...