Cloud Data Administrator

4 tygodni temu

Warsaw, Polska NATEK POLAND Pełny etat

technologies-expected :
Spark
Yarn
Python
Pyspark
Azure Cloud
Spark SQL

technologies-optional :
Grafana
Prometheus

about-project :
BI Development Team is in the process of moving into Azure Cloud. One of the main areas is to administrate Spark Clusters (PaaS). Join us and be part of the Global BI Admin Team.

responsibilities :
Setup Synapse Linked Services and MS Synapse workspaces including Spark Clusters using Terraform
Spark version upgrades
Using Kafka, Oracle, etc.
Resource Management, Memory usage, optimizing CPU and resource usage for Spark Application
Launching and running executors on worker nodes
Monitor executor performance and scalability
Detecting handle worker node failures
Reallocating resources and restarting spark jobs
Monitoring the Spark cluster health, resource utilization, and job execution metrics
Monitoring by using Grafana and Prometheus
Performance tuning by fine-tuning Spark parameters
Working with Developers and helping to for improvement of code
IT Team Management

requirements-expected :
Min. 4 years of experience with Apache Spark: Advanced knowledge of Spark architecture, including components (RDDs, DataFrames, Datasets)
Very good knowledge of Spark SQL
Proficiency in setting up, configuring, and maintaining Spark clusters
Understanding of YARN
Ability to optimize Spark jobs, memory usage, and parallelism
Familiarity with monitoring tools (preferred: Grafana and Prometheus)
Hadoop: HDFS, Hive, and other related technologies
Proficiency in Python, pyspark and spark SQL
Knowledge of securing Spark clusters and data.
Ability to troubleshoot
Experience in managing an IT team
Good communication with developers, data engineers, and stakeholders.
Experience in cross-functional teams

offered :
Long-term cooperation based on our values: education, partnership and responsibility,
Work on projects dedicated to the world's largest brands,
Possibility to exchange experiences in an international environment and develop projects implemented in Poland or other countries: Slovakia, Czech Republic, Bulgaria,
Working in a modern environment with innovative technologies,
Flexible working hours,
Private medical care,
Multisport or My Cafeteria card,
Life insurance,
NATEK loyalty Club,
Opportunity to join a socially responsible community and participate in company initiatives,
For contractors - entitlement to 23 additional days of service provision per year,
An additional paid day off for volunteering for salaried employees.

benefits :
sharing the costs of sports activities
private medical care
life insurance
remote work opportunities
flexible working time
integration events
employee referral program
extra leave

  • Senior Cloud Solutions Architect

    3 miesięcy temu

    Warsaw, Polska NTT DATA Pełny etat

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Snowflake cloud administrator

    3 tygodni temu

    Warsaw, Polska Sigma IT Poland Pełny etat

    Sigma IT Poland is a division within NEXER GROUP - a custom software development company. We started in Poland in 2017 and are now a team of over 180 people with offices in Wrocław, Warsaw, and Cracow. We have the opportunity to work with world-renowned brands from Scandinavia, the UK, and Western Europe. Our goal is to grow stronger, in competence rather...

  • Cloud Infrastructure Administrator

    1 miesiąc temu

    Warsaw, Polska Ecco Pełny etat

    about-project : Cloud Infrastructure Administrator will be responsible for the IT cloud end-to-end and will have to configure, implement and manage the systems that comprise the underlying IT cloud platform. As Claud Infrastructure Administrator you will be part of the IT Operation team with focus on Daily S&I Operations, delivery, performance and support...

  • Cloud Infrastructure Administrator

    1 miesiąc temu

    Warsaw, Polska ECCO Pełny etat

    Do you want to become an ambassador for a globally recognized high quality brand? Are you ready for the new challenges? Join ourorganization in Warsaw and help us build the best in class global IT function that is technologically sound, future proof and can react quickly to ever-changing demands! Some career choices have more impact than others....

  • Administrator Infrastruktury Cloud

    2 miesięcy temu

    Warsaw, Polska Bank Gospodarstwa Krajowego Pełny etat

    technologies-expected : Microsoft Azure Google Cloud Platform Docker Kubernetes Terraform Windows Server Active Directory about-project : Jako Cloud Administrator , będziesz odpowiedzialny za zarządzanie i utrzymanie infrastruktury chmurowej dla naszej organizacji. Będziesz współpracować z zespołem inżynierów i developerów, aby zapewnić...

  • Cloud Data Architect

    5 dni temu

    Warsaw, Polska KEMPURI SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    about-project : We're seeking a seasoned Cloud Data Architect with a deep understanding of Microsoft Azure and Databricks. As a key member of our team, you'll leverage your expertise in data engineering, modeling, and ETL pipelines to deliver innovative, scalable data solutions that drive business value. responsibilities : Databricks & Data Engineering:...

  • Junior Cloud Data Engineer

    3 tygodni temu

    Warsaw, Polska SIX Pełny etat

    What You Will Do engage with business stakeholders to understand their data needs, challenges, and objectives to later translate that to data-related business requirements evaluate cloud offerings (e.g., Azure, GCP) to identify the best services and architectures for data solutions design, develop, and implement data solutions using Python, PySpark, SQL, and...

  • Senior Cloud Data Engineer

    2 miesięcy temu

    Warsaw, Polska hirely Pełny etat

    Spółkę HIRELY tworzą profesjonaliści, którzy posiadają wiele lat doświadczenia w takich obszarach jak: IT, BI, zarządzanie projektami i przedsiębiorstwami. Cechuje nas wysoka jakość i efektywność realizowanych projektów poprzez właściwe dopasowanie kandydata do profilu poszukiwanego stanowiska i kultury organizacyjnej panującej w...

  • Senior Data Engineer

    3 tygodni temu

    Warsaw, Polska ITDS Pełny etat

    Become a pioneer in smart crop science development with us! Warsaw-based opportunity with possibility to work remotely (with min. 2 visits in the office per month) As a Senior Data Engineer, you will work for our Client - a global enterprise using science and imagination to advance health and nutrition. You will be working on cutting-edge solutions in the...

  • IT Administrator

    1 dzień temu

    Warsaw, Polska SKY ENGINE sp. z o.o. Pełny etat

    technologies-expected : Linux Windows Server technologies-optional : Ansible Docker Terraform about-project : We are currently seeking an experienced IT Administrator to join our vibrant team. This is a chance for you to get in on the ground of an exhilarating AI venture developing state-of-the-art technologies powering synthetic data cloud with...

  • Cloud Engineer

    2 miesięcy temu

    Warsaw, Polska Mettler Toledo Pełny etat

    Our Opening and Your Responsibilities ...

  • OpenShift Administrator

    4 miesięcy temu

    Warsaw, Polska ARHS Pełny etat

    OpenShift Administrator Full-time Company Description Arηs is a fully  independent  group of companies specialized in managing complex  IT projects and systems  for  large organisations , focusing on state-of-the-art software development, digital trust, cloud, data science, mobile development, machine learning and infrastructure services. ...

  • Administrator Sieci IT

    2 miesięcy temu

    Warsaw, Polska Medicover Pełny etat

    technologies-expected : Microsoft Azure Cisco technologies-optional : PowerShell Bash Ansible responsibilities : Instalacja, konfiguracja oraz utrzymanie sprzętu sieciowego Utrzymanie oraz rozwój wielu obszarów sieci korporacyjnej w ramach Data Center, LAN, WAN oraz Cloud Administrowanie środowiskiem Data Center opartym na Cisco ACI Administrowanie...

  • Senior Salesforce Administrator

    3 miesięcy temu

    Warsaw, Polska 1dea Pełny etat

    For one of our key Clients we're looking for a specialist for the position of:Senior Salesforce Administrator Terms of engagement: Area: Media / EntertainmentLocalisation: 100% remoteStart: ASAP (max 3 month notice period)Salary rate (determined individually): 145 - 160 PLN net + VAT / hTerms: B2B (outsourcing via 1dea), full-time, long-term Recruitment...

  • Administrator Sieci IT

    3 tygodni temu

    Warsaw, Polska Medicover Pełny etat

    technologies-expected : Microsoft Azure technologies-optional : PowerShell Bash Ansible Zabbix responsibilities : Instalacja, konfiguracja oraz utrzymanie sprzętu sieciowego Utrzymanie oraz rozwój wielu obszarów sieci korporacyjnej w ramach Data Center, LAN, WAN oraz Cloud Administrowanie środowiskiem Data Center opartym na Cisco ACI Administrowanie...

  • Cloud Native Data Engineer

    3 tygodni temu

    Warsaw, Polska skills matter sp. z o. o. Pełny etat

    your future employerOur Client operates the electricity transmission system in the north and east of Germany, which it expands as needed for the energy transition. Their extra high voltage grid has an electrical circuit length of more than 10,600 kilometres, or the distance between Berlin and Rio de Janeiro!!!.You will take a part in The Transition Smart...

  • Cloud Data Engineer

    1 miesiąc temu

    Warsaw, Polska Lumicode Pełny etat

    Kim jesteśmy?Lumicode Sp. z o.o. należy do Grupy Pentacomp, która jest producentem rozwiązań informatycznych i dostawcą profesjonalnych usług IT dla dużych przedsiębiorstw i sektora publicznego.Jako Pentacomp tworzymy rozwiązania IT łączące innowacyjność z latami doświadczeń - a ich mamy całkiem sporo. Istniejemy na rynku prawie 30 lat i...

  • Cloud Engineer Devops

    2 tygodni temu

    Warsaw, Polska ITDS Polska Sp. z o.o. Pełny etat

    technologies-expected : Microsoft Azure Google Cloud Platform Azure DevOps Ansible Jenkins Terraform Chef Windows Server Linux Git Jira Confluence Kubernetes Docker technologies-optional : Hadoop Kubeflow about-project : As a Cloud Engineer DevOps/Admin, you will be working for our client, a leader in online banking. In this role, you will be instrumental...

  • MSSQL Database Administrator

    1 tydzień temu

    Warsaw, Polska Paymentology Pełny etat

    Paymentology is the first truly global issuer-processor, giving banks and fintechs the technology, team and experience to rapidly issue and process Mastercard, Visa and UnionPay cards across more than 50 countries, at scale. Our advanced, multi-cloud platform, offering both shared and dedicated processing instances, vast global presence and richer,...

  • MSSQL Database Administrator

    6 dni temu

    Warsaw, Polska Paymentology Pełny etat

    Paymentology is the first truly global issuer-processor, giving banks and fintechs the technology, team and experience to rapidly issue and process Mastercard, Visa and UnionPay cards across more than 50 countries, at scale. Our advanced, multi-cloud platform, offering both shared and dedicated processing instances, vast global presence and richer,...