Senior Big Data Engineer

2 tygodni temu

Wrocław, Województwo dolnośląskie, Polska Grid Dynamics Poland Pełny etat
technologies-expected :
  • Scala
  • Java
  • Apache Hadoop
  • SQL
  • MySQL
  • MongoDB
about-project :
  • We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and proactive problem-solving to deliver robust and scalable data solutions.
responsibilities :
  • Design and Develop Big Data Solutions: Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements.
  • Data Ingestion and Processing: Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats.
  • Optimize Data Pipelines: Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency.
  • Cluster Management and Optimization: Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications.
  • Real-Time Data Processing: Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making.
  • Data Quality and Governance: Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems.
  • Performance Tuning and Monitoring: Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.
requirements-expected :
  • Strong Programming Skills: Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala.
  • Expertise in Big Data Technologies: Extensive experience with Apache Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, and HBase.
  • Advanced Spark Knowledge: In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics.
  • Data Modeling and ETL: Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies.
  • Cluster Management Tools: Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling.
  • SQL and NoSQL Databases: Proficiency in SQL for querying and analyzing data stored in relational databases (e. g. , MySQL, PostgreSQL) and NoSQL databases (e. g. , MongoDB, Cassandra).
offered :
  • Opportunity to work on bleeding-edge projects
  • Work with a highly motivated and dedicated team
  • Benefits package - medical insurance, sports
  • Corporate social events
  • Well-equipped office
benefits :
  • private medical care
  • flexible working time
  • corporate gym
  • video games at work
  • coffee / tea
  • employee referral program
  • opportunity to obtain permits and licenses
Firma: Grid Dynamics Poland

Dodano:
Praca na stanowisku - aktualna

#J-18808-Ljbffr

  • Senior Big Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Scalac Pełny etat

    We are looking for a Senior Big Data Engineer with Spark who will be working on an external project in the fintech area. But what's more important is that you will still be an integral part of the Scalac team and work with the best specialists As a Big Data Engineer, you will:Work on an external project and develop an application that is based on the Hadoop...

  • Big Data Engineer

    1 miesiąc temu

    Wrocław, dolnośląskie, Polska Wargaming Pełny etat

    Job OverviewWe are looking for a Big Data Engineer/ETL Developer for the DWH department!The Data Warehouse department is aimed at helping projects to make smart business decisions by integrating and processing huge amounts of data and providing efficient calculations and reports based on stored information. Our team of experienced data-enthusiastic engineers...

  • Big Data Engineer

    4 tygodni temu

    Wrocław, dolnośląskie, Polska Wargaming Pełny etat

    Job OverviewWe are looking for a Big Data Engineer/ETL Developer for the DWH department!The Data Warehouse department is aimed at helping projects to make smart business decisions by integrating and processing huge amounts of data and providing efficient calculations and reports based on stored information. Our team of experienced data-enthusiastic engineers...

  • Senior Backend Big Data Developer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Ciklum Pełny etat

    Description Ciklum is looking for a Senior Backend Big Data Developer to join our team full-time in Poland. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts...

  • Senior Data Engineer z jniemieckim

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska dmTECH Polska Pełny etat

    Senior Data Engineer z jniemieckim Wrocław, Lower Silesian Voivodeship Senior Data Engineer z jniemieckim Wrocław Wrocław, Dolnośląskie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....

  • Senior Data Engineer @

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska SNI Pełny etat

    SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.We're on the lookout for a Senior Data Engineer for one of our key clients.Job details:Full-time 1st contract till the end of 2024 Location: pref. Wroclaw area or close locations but open for 100% remote...

  • Senior Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Shaped Thoughts Sp. Z O.o. Pełny etat

    Technologies-expected : Amazon Redshift Snowflake Google Big Query SQL Python Java technologies-optional : AWS Glue Apache Spark Apache Flink Kinesis Kafka about-project : We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector.responsibilities : help...

  • Senior Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Rite NRG Pełny etat

    Senior Data Engineer Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dołącz do naszej ekipy Rite NRG jako Senior Data Engineer i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi.Jakimi umiejętnościami możesz się pochwalić?Jesteś...

  • Senior Data Engineer Flink

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska GetInData | Part of Xebia Pełny etat

    Senior Data Engineer Flink Wrocław, Województwo dolnośląskie Senior Data Engineer Flink Wrocław Wrocław, Lower Silesian Voivodeship, Polska Informacje: Lokalizacja: Wrocław Wrocław, Lower Silesian Voivodeship, Polska Dodano: Praca na stanowisku - aktualna Praca Wrocław - Ciekawe oferty pracy w okolicy:WrocławOferty pracy w okolicznych...

  • Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Addepto Pełny etat

    We are Addepto where you can feel a startup atmosphere We believe that the only constant in life is change, so we try to keep developing and improving to become better at what we do every day We act outside the box and create and deliver the best solutions in Big Data, Machine Learning and Artificial Intelligence . For our team based in Warsaw and...

  • Senior Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Scalo Sp. z o.o. Pełny etat

    Senior Data Engineer (DataBricks + SQL + Python) Wrocław, Województwo dolnośląskie Senior Data Engineer (DataBricks + SQL + Python) Wrocław Wrocław, Lower Silesian Voivodeship, Polska uczestnictwo w międzynarodowym projekcie z branży automotive, w odniesieniu do usprawnienia systemu do zarządzania materiałami, przygotowania raportu Power BI, który...

  • Big Data Developer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Dorwij Nerda Sp. z o. o. Pełny etat

    Big data developerHome Office Miejsce PracyPracuj wygodnie z dowolnego miejsca Polski. Wynagrodzenie$ 35-40 /h Czego oczekujemy?Wyższe wykształcenie techniczne, Biegła znajomość języka angielskiego, Minimum 6 lat aktywnego doświadczenia w programowaniu w Java, Hadoop, Spark, Hive, Posiadanie podstawowych umiejętności związanych z komponentami...

  • Senior Project Manager BI/Big Data

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Capgemini Pełny etat

    At Capgemini, we're proud to be a global leader in working with companies to transform and manage their business by harnessing the power of technology. We are guided everyday by the purpose of unleashing human energy through technology for an inclusive and sustainable future. We are a responsible and diverse organization, with a strong 55-year heritage and...

  • Senior Azure Data Engineer

    4 tygodni temu

    Wrocław, dolnośląskie, Polska C&F S.A. Pełny etat

    C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Senior Azure Data...

  • Senior Azure Data Engineer

    1 miesiąc temu

    Wrocław, dolnośląskie, Polska C&F S.A. Pełny etat

    C&F is a technology services company providing innovative solutions in Data Management, Big Data, Advanced Analytics and Compliance. With a highly integrated team of 400+ experts, for over 20 years C&F has been delivering superior engineering and premium operations to Fortune 500 companies, primarily in the Life Science industry.Senior Azure Data...

  • Senior Backend Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Kalepa Pełny etat

    Who are we?Kalepa is a fully remote startup dedicated to enhancing underwriting performance and driving profitable premium growth for the commercial insurance industry. Kalepa's AI-powered Copilot software enables underwriters to focus on the highest ROI opportunities and quickly evaluate and optimally select risk. Kalepa is backed by IA Ventures, Inspired...

  • Big Data Analyst

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska InPost Pełny etat

    Role Overview:As a Big Data Analyst, you will be at the forefront of analyzing vast volumes of real-time data from diverse systems, including parcel lockers, package lifecycle, transportation, user communication and similar topics relative to InPost Group products. This role spans across Poland and extends to 7 international markets, offering a unique...

  • Senior Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Aptitude Software Pełny etat

    Fynapse, a pioneering finance data and accounting platform, is in the process of developing a Modern Data Stack and is seeking a highly skilled Data Engineer to lead this transformation. The role involves building from the ground up - including data lakes, data warehouses, and implementing tools for data transformation and orchestration. We're looking for...

  • Mid Senior Data Engineer

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska TransferGo Pełny etat

    TransferGo is a growing fintech scale-up on a mission to make the world a fairer place for migrants. We strive to provide tailored, more affordable financial services that make people's hard-earned money go further. Now in our 12th year, with over 370 employees in offices across Europe, we're crafting a brilliant, relevant product that makes a difference in...

  • Senior Data Engineer Analyst

    2 tygodni temu

    Wrocław, Województwo dolnośląskie, Polska Sunscrapers Pełny etat

    Are you ready to take on the challenge?We're looking for a Senior Data Engineer/Analyst to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and...