Aktualne oferty pracy związane z Big Data Infrastructure Specialist - Warszawa - Kevin Edward

  • Data Infrastructure Specialist

    6 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    We are seeking a highly skilled Data Infrastructure Specialist to join our team at TN Poland.Job Description:The ideal candidate will have a strong background in building and managing data platforms, with experience in cloud infrastructure, data processing, and machine learning.Responsibilities include designing and implementing data pipelines, developing...

  • Big Data Developer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Sii Polska Pełny etat

    Join a new team of Engineers at one of the largest financial institutions in the world as a Big Data Specialist. You will work in the area of traded risk on a strategic project to deliver a strategic aggregation platform for Risk managers and utilize a new vendor product in a cloud and on-premises hybrid environment.- At least 5 years of experience as a...

  • Big Data Systems Architect

    3 dni temu

    Warszawa, Polska Kevin Edward Pełny etat

    Kevin EdwardWe are seeking a seasoned Big Data Systems Architect to join our team. The ideal candidate will have extensive experience with Hadoop, Spark, and Kafka, along with a solid understanding of distributed computing principles and data storage systems.Key Responsibilities:Hadoop Cluster Management:Deploy, manage, and scale Hadoop clusters in...

  • Senior Big Data Infrastructure Specialist

    7 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    About the Job:The Staff Site Reliability Engineer role involves performing Big Data Administration and Engineering activities on multiple open-source platforms such as Hadoop, Kafka, HBase, and Spark. The successful candidate will possess strong troubleshooting and debugging skills.You will be responsible for effective root cause analysis of major production...

  • Big Data Technology Lead

    3 dni temu

    Warszawa, Mazovia, Polska Rutkowski Pełny etat

    Rutkowski is seeking a highly skilled Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the infrastructure required to analyze large data sets. Our ideal candidate has strong experience with big data technologies, such as Spark, Hadoop, and NoSQL databases.Key Responsibilities:Closely...

  • Data Infrastructure Specialist

    3 dni temu

    Warszawa, Mazovia, Polska Asana Pełny etat

    The Data Infrastructure Specialist will serve as both a hands-on technical expert and a technical leader, guiding a team of engineers in building and scaling our distributed storage systems.About the TeamCollaborate with a world-class team of engineers on building software-driven reliability for Asana's online storage infrastructure and solving challenges...

  • Data Infrastructure Specialist

    2 dni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Data Infrastructure SpecialistOverviewWe are Square One Resources Sp. z o.o., a company dedicated to delivering top-notch data solutions.About the JobWe are seeking an experienced Data Engineer to join our team and contribute to the development of our data infrastructure.The successful candidate will be responsible for designing, building, and maintaining...

  • Big Data Engineering Expert

    5 dni temu

    Warszawa, Mazovia, Polska Cubestech Ltd Pełny etat

    We are seeking a Senior Data Engineering Specialist to join our team at Cubestech Ltd. As a Senior Data Engineering Specialist, you will design and implement scalable data pipelines using AWS services such as S3, Lambda, and Glue. Your expertise in cloud-based data engineering will help us build a robust and efficient data architecture.Job DescriptionDesign...

  • Big Data

    9 godzin temu

    Warszawa, Mazovia, Polska ITMAGINATION Sp. z o. o. Pełny etat

    We're hiring a Big Data & Cloud Developer (Hybrid work from Warsaw, Poland) at ITMAGINATION, join our team of 400+ developers, analysts and testers ITMAGINATION helps its Clients by becoming a true extension of their software and data development capabilities. Through the readily set up, comprehensive, and self-governing teams, we let our Clients focus on...

  • Big Data Transformation Specialist

    3 dni temu

    Warszawa, Polska Addepto Pełny etat

    At Addepto, a leading consulting and technology company specializing in AI and Big Data, we empower clients to deliver innovative data projects. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI companies.We are seeking a highly skilled Data Engineer to join our team of technology experts on challenging...

  • Big Data Engineer for AI Innovations

    4 tygodni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Job Title: Big Data Engineer for AI InnovationsWe are seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative AI solutions.About the Role:Design and develop scalable Big Data infrastructure to support the development of AI models.Create efficient processes for data ingestion, processing, and integration from...

  • Senior Data Infrastructure Specialist

    5 dni temu

    Warszawa, Mazovia, Polska Capgemini Pełny etat

    As a Senior Data Infrastructure Specialist at Capgemini, you will play a crucial role in building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.Key ResponsibilitiesDeveloping new functionality within the Python-based ETL pipelineOngoing...

  • Big Data Developer

    4 tygodni temu

    Warszawa, Polska Sii Sp. z o.o. Pełny etat

    Big Data Developer Miejsce pracy: Warszawa Technologies we use Expected - Java - Spark - Google Cloud Platform Optional - Scala About the project Join a new team of Engineers at one of the largest financial institutions in the world as a Big Data Specialist. You will work in the area of traded risk on a strategic project to deliver a strategic...

  • Big Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska Capgemini Pełny etat

    Capgemini is seeking a talented Big Data Engineer to join our team. As a Big Data Engineer, you will design, implement, and maintain big data platforms, data architecture, and design techniques to work with large data sets. You will be empowered to shape your career in the way you'd like and supported by a collaborative community of colleagues around the...

  • Chief Data Infrastructure Specialist

    3 dni temu

    Warszawa, Polska emagine Polska Pełny etat

    Company OverviewWe are emagine Polska, a technology and IT services company based in Warsaw.About the RoleThe Chief Data Infrastructure Specialist will design and implement the architecture for our data hubs to support analytical, reporting, operational, and Generative AI use cases. This role ensures data quality, governance, and system scalability while...

  • Big Data Engineering Manager

    5 dni temu

    Warszawa, Mazovia, Polska Cyclad Pełny etat

    Key ResponsibilitiesThe successful candidate will have the following responsibilities:Oversee the design and development of data engineering solutions, ensuring quality and efficiency.Lead the development and implementation of data governance strategies, including data quality, master data management, data cataloging, and lineage.Represent Cyclad as a...

  • Big Data Engineer

    3 dni temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    Big Data Engineer (Long term US Business Travel)Grid Dynamics, a global software services company driving enterprise-level digital transformation solutions for Fortune 1000 corporations, is looking for an experienced Big Data Engineer.Essential functionsResponsibilities:Build data pipelines to enable training of LLMs.Work with technical and non-technical...

  • Big Data Developer

    4 tygodni temu

    Warszawa, Mazovia, Polska Sii Sp. z o.o. Pełny etat

    Big Data DeveloperMiejsce pracy: WarszawaTechnologies we useExpected- Java- Spark- Google Cloud PlatformOptional- ScalaAbout the projectJoin a new team of Engineers at one of the largest financial institutions in the world as a Big Data Specialist. You will work in the area of traded risk on a strategic project to deliver a strategic aggregation platform for...

  • Big Data Professional

    2 dni temu

    Warszawa, Mazovia, Polska Atos SE Pełny etat

    Role OverviewWe are seeking an experienced Software/Data Engineer to join our team for a significant project with a prominent German client in the energy sector. The ideal candidate will have a strong background in data engineering and cloud solutions, with hands-on experience in big data architectures and Kubernetes.Your Key AccountabilitiesDevelop and...

  • Cloud Infrastructure Specialist

    2 dni temu

    Warszawa, Mazovia, Polska Standard Chartered Pełny etat

    Job DescriptionWe're looking for a Cloud Infrastructure Specialist to join our team. As a key member of the DevOps team, you'll work closely with engineers and architects to design and implement scalable and secure cloud infrastructure solutions.You'll be responsible for designing and implementing DevOps processes and tools to improve efficiency and...

Big Data Infrastructure Specialist

1 tydzień temu

Warszawa, Polska Kevin Edward Pełny etat
Kevin Edward

We are seeking a skilled Big Data Infrastructure Specialist to join our team. The ideal candidate will have in-depth experience with Hadoop, Spark, and Kafka, along with a strong background in troubleshooting, deployment, and management of large-scale big data environments.

Key Responsibilities:
  • Hadoop, Spark, and Kafka Administration:
  • Manage and support the deployment, configuration, and scaling of Hadoop, Spark, and Kafka clusters in production environments.
  • Administer distributed storage systems and ensure that Hadoop clusters are highly available and perform optimally.
  • Configure, monitor, and troubleshoot issues related to Apache Spark jobs and Kafka streams.
  • Perform regular maintenance of big data platforms and associated components to ensure data integrity and availability.
  • Deployment & Patching:
  • Lead the deployment of new services and solutions within the big data infrastructure.
  • Ensure the timely installation of patches and updates across hosts and systems to maintain security and performance.
  • Develop and automate deployment pipelines for big data services using tools like Ansible, Terraform, or Jenkins.
  • Troubleshooting & Performance Tuning:
  • Troubleshoot and resolve issues related to the big data infrastructure, including performance bottlenecks, data loss, system outages, and other operational incidents.
  • Monitor the health of Hadoop, Spark, and Kafka systems using appropriate tools (e.g., Cloudera Manager, Grafana, etc.) and take corrective action as needed.
  • Conduct performance tuning for data workflows, ensuring efficient and reliable data processing in the environment.
  • Monitoring & Maintenance:
  • Set up and configure monitoring and alerting tools to track system performance, data quality, and usage metrics.
  • Proactively monitor system logs, disk usage, network throughput, and other resources to avoid system failures.
  • Perform regular backup and recovery tasks to ensure the integrity and availability of data stored in Hadoop, Spark, and Kafka.
  • Capacity Planning & Scaling:
  • Plan and manage the capacity and growth of the big data ecosystem, including scaling clusters as data volume increases.
  • Ensure that all systems are optimized for high-performance data processing and can handle large-scale, high-volume workloads.
  • Security & Compliance:
  • Implement and maintain appropriate security measures across big data platforms, including user access control, data encryption, and compliance with data protection regulations.
  • Work with security teams to conduct audits and maintain access controls across systems.
Required Skills and Qualifications:
  • Proven experience as a Big Data Administrator or System Administrator with strong expertise in Hadoop, Spark, and Kafka.
  • Hands-on experience deploying, managing, and scaling Hadoop clusters, Apache Spark jobs, and Kafka brokers in production environments.
  • Strong knowledge of Linux/Unix system administration, with experience in configuring and maintaining data infrastructure.
  • Expertise in troubleshooting, resolving issues, and optimizing the performance of big data environments.
  • Experience with deployment automation tools (e.g., Terraform, Jenkins).
  • Familiarity with data ingestion and ETL processes in a big data context.
  • Knowledge of cloud-based environments (e.g., AWS, GCP, Azure) for managing big data clusters.
  • Familiarity with monitoring tools like Ambari, Grafana.
  • Strong scripting skills (e.g., Bash, Python, or other shell scripting languages) for automation and troubleshooting.
  • Solid understanding of distributed computing principles and data storage systems (e.g., HDFS, S3, etc.).
  • Strong communication skills and the ability to collaborate with engineering, development, and operations teams.