Senior Big Data Engineer

2 tygodni temu

Warszawa, Mazovia, Polska Grid Dynamics Poland Pełny etat

Technologies-expected : Scala Java Apache Hadoop Apache Spark Kubernetes SQL My SQL Postgre SQL Mongo DB Cassandra about-project : We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company.


The role involves a mix of technical proficiency, strategic thinking, collaboration, and proactive problem-solving to deliver robust and scalable data solutions.


responsibilities :
Design and

Develop Big Data Solutions:

Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements.


Data Ingestion and Processing:

Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats.


Optimize Data Pipelines:

Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency.


Cluster Management and Optimization:
Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications.

Real-Time Data Processing:
Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making.

Data Quality and Governance:

Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems.


Performance Tuning and Monitoring:

Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.

requirements-expected :

Strong Programming Skills:
Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala.

Expertise in Big Data Technologies:
Extensive experience with Apache Hadoop ecosystem components such as HDFS, Map Reduce, Hive, Pig, and HBase.

Advanced Spark Knowledge:

In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics.

Data Modeling and

ETL:
Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies.

Cluster Management Tools:

Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling.


SQL and No SQL Databases:

Proficiency in SQL for querying and analyzing data stored in relational databases (e.g., My SQL, Postgre SQL) and No SQL databases (e.g., Mongo DB, Cassandra).


offered :
Opportunity to work on bleeding-edge projects Work with a highly motivated and dedicated team Competitive salary Flexible schedule Benefits package - medical insurance, sports Corporate social events Professional development opportunities Well-equipped office benefits : private medical care flexible working time fruits integration events corporate gym corporate library no dress code video games at work coffee / tea leisure zone employee referral program opportunity to obtain permits and licenses

  • Senior Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Scalac Pełny etat

    Senior Big Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska We are looking for a Senior Big Data Engineer with Spark who will be working on an external project in the fintech area. But what's more important is that you will still be an integral part of the Scalac team and work with the best specialists As a Big Data Engineer, you will:Work on an...

  • Senior Big Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Neontri Pełny etat

    Senior Big Data Engineer @ Neontri Warszawa, mazowieckie Cześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach:tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności) głównie z obszaru: finansowego, bankowego,...

  • Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Smartchoice International Pełny etat

    Job Title: Big Data EngineerLocation: Warsaw, PolandEmployment Type: B2BRole Description:We are seeking a highly skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with Spark and Scala in a Cloud PaaS environment, specifically with AWS, Databricks, and Snowflake. The role requires proficiency in the...

  • Senior Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Neontri Pełny etat

    Minimum 5 lat doświadczenia na stanowisku Data EngineeraUkończone studia wyższe (tytuł licencjata lub magistra na kierunku informatyki lub fizyki)Konieczna znajomość jednego z języków - Python, Scala, JavaDoświadczenie z technologiami Big DataWymagana znajomość j. ang na poziomie min. B2+/C1Praca hybrydowa (2-3 dni w tygodniu w biurze, centrum...

  • Senior Big Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Neontri Pełny etat

    Cześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy naszych...

  • Senior Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Sunscrapers Pełny etat

    Senior Data Engineer @ Sunscrapers Warsaw, Masovian Voivodeship Senior Data Engineer @ Sunscrapers Warszawa Warsaw, Masovian Voivodeship, Polska Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska SQUARE ONE RESOURCES sp. z o.o. Pełny etat

    Senior Data Engineer Warszawa Warsaw, Masovian Voivodeship, Polska technologies-expected :DataflowGittechnologies-optional :PythonScalaJavaabout-project :For one of our clients in the pipeline management industry, we are seeking experienced Senior Data Engineers / Infrastructure Programmers.Suitable candidates should have experience in pipeline...

  • Senior Data Engineer z

    2 tygodni temu

    Warszawa, Mazovia, Polska dmTECH Polska Pełny etat

    Senior Data Engineer z j.niemieckim Warszawa, mazowieckie Senior Data Engineer z j.niemieckim Warszawa Warszawa, Województwo mazowieckie, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie....

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etat

    Dla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcieSenior Data EngineerTwój zakres obowiązkówOdpowiedzialność za architekturę danych komenrcyjnych w Azure Rozwój modelu danych w chmurze na rzecz procesów BI w...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We're a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and data...

  • Expert Big Data Infrastructure Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Nordea Bank Pełny etat

    Job ID: 22943 Would you like to be an infrastructure engineer architecting and implementing tomorrow's Big Data capabilities? We are now looking for a subject matter expert to assess new platform capabilities, harden security, improve availability, automate new self service capabilities and support strengthening operational stability. At Nordea, we know our...

  • Expert Big Data Infrastructure Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska Nordea Bank Pełny etat

    Job ID: 22943 Would you like to be an infrastructure engineer architecting and implementing tomorrow's Big Data capabilities? We are now looking for a subject matter expert to assess new platform capabilities, harden security, improve availability, automate new self service capabilities and support strengthening operational stability. At Nordea, we know our...

  • Senior Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Sunscrapers Pełny etat

    Advance your professional path with Sunscrapers, a key player in software development, currently broadening its influence in a data-centric setting. Join our journey to assist clients in expanding and innovating through a robust tech stack and impactful data-driven projects. Enjoy a competitive salary package reflecting your expertise while being part of a...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska ALTER SOLUTIONS Pełny etat

    Job Description The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions. Qualifications Minimum 4 years (senior) of experience working with ETL , ...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Alter Solutions Pełny etat

    Job DescriptionThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4 years (senior) of experience working with ETL, data...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    The position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting.The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4years (senior) of experience working with ETL, data modeling, and data...

  • Senior Data Engineer z jniemieckim

    2 tygodni temu

    Warszawa, Mazovia, Polska dmTECH Polska Pełny etat

    Senior Data Engineer z jniemieckim Warszawa, Mazowieckie Senior Data Engineer z jniemieckim Warszawa Warsaw, Masovian Voivodeship, Polska dmTECH to międzynarodowy zespół ponad tysiąca ekspertek i ekspertów z różnych obszarów IT i technologii wspierających e-commerce pracujących dla dm – jednej z największych sieci drogerii w Europie. Nasza...

  • Big Data DevOps Engineer, Data Tooling team

    2 tygodni temu

    Warszawa, Mazovia, Polska Nordea Bank Norge ASA Pełny etat

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Big Data DevOps Engineer, Data Tooling team Job ID: 24291 We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. As one of the...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska P&P Solutions Sp. z o.o. Pełny etat

    Senior Data Engineer Warszawa Warszawa, mazowieckie, Polska Dla naszego klienta z branży lotniczej poszukujemy Data Engineer. Jesteśmy otwarci zarówno na Juniorów jak i Seniorów. Dołącz do naszego zespołu i rozwijaj się w ciekawym projekcie Twój zakres obowiązków Odpowiedzialność za architekturę danych komenrcyjnych w AzureRozwój modelu...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Commerzbank Pełny etat

    Join our team as a Senior Data EngineerAs a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area. You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts...