Senior Big Data Engineer
2 miesięcy temu
technologies-expected :
Scala
Java
Apache Hadoop
Apache Spark
Kubernetes
SQL
MySQL
PostgreSQL
MongoDB
Cassandra
about-project :
We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and proactive problem-solving to deliver robust and scalable data solutions.
responsibilities :
Design and Develop Big Data Solutions: Architect, design, and implement scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies to meet business requirements.
Data Ingestion and Processing: Develop robust data ingestion processes to acquire, clean, and transform large volumes of structured and unstructured data from various sources into usable formats.
Optimize Data Pipelines: Build and optimize data pipelines and workflows for efficient data processing, storage, and retrieval, ensuring high performance and low latency.
Cluster Management and Optimization: Manage and optimize Hadoop cluster resources to ensure high availability, reliability, and scalability of big data applications.
Real-Time Data Processing: Implement real-time data processing solutions using Spark Streaming or other similar technologies to enable real-time analytics and decision-making.
Data Quality and Governance: Establish and enforce data quality standards, data governance policies, and best practices to ensure data accuracy, consistency, and integrity across systems.
Performance Tuning and Monitoring: Monitor system performance, troubleshoot bottlenecks, and conduct performance tuning of Spark jobs and Hadoop clusters to optimize resource utilization and job execution times.
requirements-expected :
Strong Programming Skills: Proficiency in Scala and Java, including a deep understanding of functional programming concepts in Scala.
Expertise in Big Data Technologies: Extensive experience with Apache Hadoop ecosystem components such as HDFS, MapReduce, Hive, Pig, and HBase.
Advanced Spark Knowledge: In-depth knowledge of Apache Spark, including Spark Core, Spark SQL, Spark Streaming, and MLlib for large-scale data processing and analytics.
Data Modeling and ETL: Experience with data modeling, schema design, and implementing efficient ETL (Extract, Transform, Load) processes using big data technologies.
Cluster Management Tools: Hands-on experience with cluster management tools like Apache YARN, Apache Mesos, or Kubernetes for resource allocation and job scheduling.
SQL and NoSQL Databases: Proficiency in SQL for querying and analyzing data stored in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
offered :
Opportunity to work on bleeding-edge projects
Work with a highly motivated and dedicated team
Competitive salary
Flexible schedule
Benefits package - medical insurance, sports
Corporate social events
Professional development opportunities
Well-equipped office
benefits :
private medical care
flexible working time
fruits
integration events
corporate gym
corporate library
no dress code
video games at work
coffee / tea
leisure zone
employee referral program
opportunity to obtain permits and licenses
-
Senior Data Engineer to work with Big Data
5 dni temu
Warsaw, Polska Nordea Bank Pełny etatJob ID: 25161 #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...
-
Senior Big Data Engineer
4 tygodni temu
Warsaw, Polska Grid Dynamics Poland Pełny etatExpected, Scala, Java, Apache Hadoop, Apache Spark, Kubernetes, SQL, MySQL, PostgreSQL, MongoDB, Cassandra Operating system, Windows About the project, We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic...
-
Senior Big Data Engineer
3 miesięcy temu
Warsaw, Polska Daxx Pełny etatOur client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...
-
Senior Big Data Engineer
4 tygodni temu
Warsaw, Polska Daxx Pełny etatOur client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...
-
Site Reliability Engineer
4 tygodni temu
Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etattechnologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...
-
Site Reliability Engineer
4 tygodni temu
Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etattechnologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...
-
Mid Big Data Engineer @ Capco Poland
4 dni temu
Warsaw, Polska Capco Poland Pełny etatWHY JOIN CAPCO? Employment contract and/or Business to Business - whichever you prefer Possibility to work remotely Speaking English on daily basis, mainly in contact with foreign stakeholders and peers Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance) Access to 3.000+ Business Courses Platform (Udemy) Access to...
-
Senior Big Data Engineer @ Neontri
4 tygodni temu
Warsaw, Polska Neontri Pełny etatCześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy...
-
Senior Big Data Engineer @ Neontri
4 tygodni temu
Warsaw, Polska Neontri Pełny etatCześć, Z tej strony Neontri - jesteśmy firmą liczącą około 120 osób, która specjalizuje się w 2 obszarach: tworzymy systemy, które zlecają nam nasi Klienci (najczęściej tworzymy coś od zera, albo dodajemy w pełni nowe funkcjonalności ) głównie z obszaru: finansowego, bankowego, fin-tech, e-commerce - choć nie tylko :) -wspieramy...
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska VGW Pełny etatSenior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games. We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...
-
Specjalista Big Data
2 tygodni temu
Warsaw, Polska Algoteque Pełny etatALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....
-
Specjalista Big Data
2 miesięcy temu
Warsaw, Polska Algoteque Pełny etatALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....
-
Specjalista Big Data
4 tygodni temu
Warsaw, Polska Algoteque Pełny etatALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....
-
Big Data Engineer
4 dni temu
Warsaw, Polska Integer Group Services Sp. z o.o Pełny etatBig Data Engineer Miejsce pracy: Warszawa Your responsibilities Building a platform for processing large amounts of data Building streaming solutions Construction and maintenance of data lake solutions, NoSQL databases Building CI/CD solutions, test automation CI/CD solutions, test automation Designing and maintaining ETL/ELT Applying good practices, code...
-
Big Data Engineer @ Orange Polska
4 tygodni temu
Warsaw, Polska Orange Polska Pełny etatAs a Big Data Engineer at Orange you will use your expertise in the field of Data solutions and data pipeline development to enable the processing of a significant volume of data for various stakeholders (including Data Visualization, Data Scientists, and Data Analysts) in the GSP (Global Support for Performance which is the GBS Finance of the Orange Group)....
-
Senior Data Engineer
2 tygodni temu
Warsaw, Polska Allegro Pełny etatThe salary range for this position is PLN in gross terms (contract of employment)A hybrid work model that incorporates solutions developed by the leader and the teamWe are looking for a Senior Data Engineer with a focus on the data processing and preparation, deployment and maintenance of our ML/data projects. Join our team to enhance your skills related to...
-
Senior Data Engineer
1 miesiąc temu
Warsaw, Polska Reckitt Pełny etatSenior Data Engineer City: Warszawa About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...
-
Senior Data Engineer
4 tygodni temu
Warsaw, Polska Reckitt Pełny etatSenior Data Engineer City: Warszawa About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...
-
Big Data DevOps Engineer, Data Tooling team
2 tygodni temu
Warsaw, Polska Nordea Bank Pełny etatJob ID: 24291 We are Nordea. We have a 200-year history of supporting and growing the Nordic economies and our values are deeply rooted in these open, progressive and collaborative societies. As one of the biggest employers in the Nordics, Poland and Estonia, you have excellent opportunities to evolve, develop and move forward with us. We enable...
-
Senior Data Engineer
4 dni temu
Warsaw, Polska SwingDev Pełny etatWe are a Polish branch of a fast-growing InsurTech product company from Silicon Valley - Hippo Insurance. Our mission is to revolutionize home insurance in the US, starting from IoT monitoring devices to our industry-leading software. How do we want to get there? We need a top-notch talent, just like you! Putting a lot of effort into hiring top-tier...
