Hadoop and Spark Specialist

7 dni temu


Warszawa, Mazovia, Polska BRAVER IT SPÓŁKA AKCYJNA Pełny etat
Key Responsibilities

We are looking for a skilled Hadoop and Spark Specialist to join our team in Warsaw. As a key member of our big data engineering group, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Hadoop, Hive, and Apache Spark.

You will work closely with our cross-functional teams to ensure the efficient processing of large datasets in real-time. Your expertise in Big Data technologies, including Spark and Hive, will be crucial in achieving our goals.

In addition to your technical skills, you will also have excellent communication and collaboration skills, allowing you to work effectively with both technical and non-technical stakeholders.

  • Develop and optimize data pipelines using Hadoop, Hive, and Apache Spark.
  • Process large datasets in real-time using Hadoop, Hive, and Spark SQL.
  • Maintain version control and collaboration using Git/Bitbucket.
Requirements
  • At least 5 years of experience in Hadoop, Hive, and Apache Spark development.
  • Solid understanding of Big Data technologies like Spark and Hive.
  • Strong knowledge of SQL, including writing and optimizing queries in T-SQL, PL/SQL, and Spark SQL.


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    Key Skills and QualificationsTo succeed in this role, you should possess strong native SQL skills, experience with Hadoop, Hive, and related technologies, as well as proficiency in Spark and Scala.A minimum of 3 years of experience working with low-latency systems, handling large datasets, and developing scalable solutions is required.Additionally, you...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    Salary: 1000-1250 PLN/day on B2BWork model: elastic hybrid from Gdynia / Gdańsk / Warszawa  (at least 1 day per week from the office)Why choose this offer?You can expect a flexible work organizationThe international work environment will give you the opportunity to interact with the English language on a daily basisScandinavian organizational...


  • Warszawa, Mazovia, Polska B2B S.A Pełny etat

    We are looking for an experienced Scala/Spark Developer to join a project in the banking sector. The main responsibilities include developing and optimizing Scala/Spark jobs for data transformation and aggregation within the Hadoop ecosystem, as well as implementing CI/CD processes. The candidate will work in an agile environment, collaborating with the team...


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    Main Responsibilities:Perform Big Data Administration and Engineering activities on multiple open-source platforms.Develop and maintain knowledge of the Hadoop ecosystem, including Zookeeper, HDFS, Yarn, HIVE, and SPARK.Troubleshoot and debug issues on both Hadoop platform and applications.


  • Warszawa, Mazovia, Polska TN Poland Pełny etat

    TN Poland is seeking a highly skilled Backend Spark Developer to join our team. As a key member of our development team, you will be responsible for designing, developing, and deploying scalable backend systems using Spark and Scala.About the RoleDesign and implement efficient ETL processes using Spark/Scala.Work collaboratively with Solution Designers,...

  • Backend Spark developer @

    2 tygodni temu


    Warszawa, Mazovia, Polska Axiom software solutions Pełny etat

    As a Backend Spark developer, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.   Required qualifications At least 2 years of experience working with Spark...

  • Spark Developer

    3 dni temu


    Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat

    **Job Requirements:**We are looking for a skilled Spark Developer to join our team at Axiom Software Solutions Limited. As a Backend Spark developer, you will be responsible for developing, testing, and deploying technical and functional specifications from the Solution Designers/Business Architects/Business Analysts, ensuring correct operability and...

  • Spark Developer

    6 dni temu


    Warszawa, Mazovia, Polska TN Poland Pełny etat

    TN Poland is seeking a talented Spark Developer to join our team. As a Senior Backend Software Engineer, your primary responsibility will be to design, develop, and deploy scalable backend systems using Spark and Scala.About the RoleDesign and implement efficient ETL processes using Spark/Scala.Work collaboratively with Solution Designers, Business...


  • Warszawa, Mazovia, Polska Infosys Pełny etat

    We are seeking an experienced Big Data Expert with Hadoop Skills to join our team at Infosys.Talent Acquisition Executive (UK & Europe) at Ampstek, UKThe successful candidate will have hands-on experience with Hadoop and be able to design and implement complex big data solutions.Strong understanding of relevant tools and technology is essential.Key...


  • Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat

    About the Role:We are seeking a highly experienced Senior Backend Spark Engineer to join our team. As a key member of our engineering department, you will be responsible for designing, developing, and deploying large-scale data processing systems using Apache Spark.In this role, you will work closely with our Solution Designers, Business Architects, and...


  • Warszawa, Mazovia, Polska Tietoevry Pełny etat

    Tietoevry is seeking a highly experienced Senior IT Specialist to lead our team's efforts in developing and maintaining large-scale data processing systems. The ideal candidate will have 5+ years of development experience with Python, as well as expertise in database technologies such as Hadoop, Spark, and Big Data.In this role, you will be responsible for...


  • Warszawa, Mazovia, Polska ITMAGINATION Sp. z o. o. Pełny etat

    We're hiring a Backend Developer with Spark and Scala (hybrid from Warsaw, Poland) at ITMAGINATION, join our team of 400+ developers, analysts and testersITMAGINATION helps its Clients by becoming a true extension of their software and data development capabilities. Through the readily set up, comprehensive, and self-governing teams, we let our Clients focus...


  • Warszawa, Mazovia, Polska Cubestech Ltd Pełny etat

    Cubestech Ltd is looking for a Big Data Engineering Expert to join our team. As a Senior Data Engineering Specialist, you will be responsible for designing and implementing scalable data pipelines using Hadoop and Spark. Your expertise in big data engineering will help us build a robust and efficient data architecture.Job RequirementsDesign and develop...


  • Warszawa, Mazovia, Polska Tietoevry Pełny etat

    Job DescriptionTietoevry CreateWe are seeking a highly skilled Senior Software Engineer-Machine Learning Engineer/Data Engineer to join our team in Warsaw. As a key member of our team, you will be responsible for developing and maintaining ETL/ELT pipelines using Python and SQL.Design, train, test, and deploy ML models using Python frameworksWork with...


  • Warszawa, Mazovia, Polska Tietoevry Pełny etat

    We are looking for a talented Data Scientist and Developer to join our team. In this role, you will work on developing and maintaining ETL/ELT pipelines using Python and SQL, as well as working with Hadoop, Spark, and Big Data technologies for large-scale data processing.The ideal candidate will have 4+ years' experience with database technologies, ideally...


  • Warszawa, Mazovia, Polska Capco Poland Pełny etat

    *We are looking for Poland based candidate.  Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a...


  • Warszawa, Mazovia, Polska Tietoevry Pełny etat

    Technical RequirementsWe are seeking a highly skilled Senior Software Engineer-Machine Learning Engineer/Data Engineer to join our team in Warsaw. As a senior engineer, you will play a crucial role in designing, developing, and deploying machine learning models using Python frameworks.Develop and maintain ETL/ELT pipelines using Python and SQLWork with...


  • Warszawa, Mazovia, Polska Tietoevry Pełny etat

    Job SummaryTietoevry Create is seeking a Senior Software Engineer-Machine Learning Engineer/Data Engineer to join our team in Warsaw. As a key member of our team, you will be responsible for working with Hadoop, Spark, and Big Data technologies for large-scale data processing.Design, train, test, and deploy ML models using Python frameworksImplement best...


  • Warszawa, Mazovia, Polska KBC Technologies Group Pełny etat

    The ideal candidate is a self-motivated, multi-tasker, and demonstrated team-player. You will be a lead developer responsible for the development of new software products and enhancements to existing products. You should excel in working with large-scale applications and frameworks and have outstanding communication and leadership skills.ResponsibilitiesYou...


  • Warszawa, Mazovia, Polska Talan Pełny etat

    Company DescriptionTalan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€.We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities:CONSULTING in management and innovation: supporting...