Senior Big Data Engineer Scala Spark
2 tygodni temu
Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.
We are looking for an experienced Big Data Engineer.
Responsibilities:
- Design, develop, and maintain robust data pipelines using: Scala, Spark, HDFS, Gradle, Kubernetes and Airflow
- Implement scalable and efficient data workflows to support data ingestion, processing, and analysis.
- Develop and maintain continuous reporting systems and dashboards to provide real-time insights.
- Collaborate with cross-functional teams to understand data requirements and deliver data solutions.
- Optimize and tune data processing systems for performance and reliability.
- Ensure data quality and integrity throughout the data lifecycle.
- Troubleshoot and resolve data processing and pipeline issues.
- Stay up-to-date with industry trends and emerging technologies to drive innovation in data engineering.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in Spark, HDFS, Airflow
- Solid programming skills in Java and/or Scala.
- Experience with data pipeline architecture and implementation.
- Expertise in building and maintaining continuous reporting systems and dashboards.
- Familiarity with data warehousing concepts and technologies.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Ability to work independently and in a remote team environment.
We offer:
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us:
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
-
Senior Mid Big Data Engineer Scala or PySpark
1 dzień temu
Kraków, Lesser Poland Yard Corporate Pełny etatCurrently We are looking for Big Data Engineer for one of our clients based in Kraków. The role is hybrid 2 days a week in Kraków office. OUR ROLE & RESPONSIBILITIES Architect, implement, and optimize data processing pipelines using Scala or PySpark, Hadoop, and SQL for both real-time and batch data workflows. Partner with various teams to assess data...
-
Senior Big Data Engineer
3 tygodni temu
Kraków, Lesser Poland TN Poland Pełny etatSocial network you want to login/join with:Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions. It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams...
-
Hadoop and Spark Developer
2 tygodni temu
Kraków, Lesser Poland TN Poland Pełny etatSenior Big Data Engineer Job Description:We are seeking a highly skilled Senior Big Data Engineer to join our team at TN Poland. The successful candidate will be responsible for designing and developing big data solutions using Scala, Hadoop, and Spark technologies.Key Responsibilities:Design and develop big data solutions that meet business...
-
Big Data Engineer
1 tydzień temu
Kraków, Polska Grid Dynamics Poland Pełny etatWe are looking for a skilled Big Data engineer with expertise in Scala and Java to join our team. Our company, Grid Dynamics, is a leading provider of technology consulting services and we specialize in enterprise AI, cloud & DevOps, application modernization, and customer experience.The ideal candidate will have prior experience as a Backend Engineer with a...
-
Big Data Solutions Architect
2 tygodni temu
Kraków, Lesser Poland TN Poland Pełny etatAbout the Role:We are seeking an experienced Big Data Engineer to join our team at TN Poland. As a Senior Big Data Engineer, you will be responsible for designing and developing scalable and reliable big data solutions using Scala, Hadoop, and Spark technologies.Key Responsibilities:Design and develop big data solutions that meet business requirementsDevelop...
-
Senior Mid Big Data Engineer Scala or PySpark
3 tygodni temu
Kraków, Lesser Poland Yard Corporate Pełny etatCurrently We are looking for Big Data Engineer for one of our clients based in Kraków. The role is hybrid 2 days a week in Kraków office.OUR ROLE & RESPONSIBILITIESArchitect, implement, and optimize data processing pipelines using Scala or PySpark, Hadoop, and SQL for both real-time and batch data workflows.Partner with various teams to assess data...
-
Kraków, Polska Yard Corporate Pełny etatCurrently We are looking for Big Data Engineer for one of our clients based in Kraków. The role is hybrid 2 days a week in Kraków office.OUR ROLE & RESPONSIBILITIESArchitect, implement, and optimize data processing pipelines using Scala or PySpark, Hadoop, and SQL for both real-time and batch data workflows.Partner with various teams to assess data...
-
Big Data Engineer for Data-Driven Innovation
5 dni temu
Kraków, Polska Yard Corporate Pełny etatAt Yard Corporate, we are seeking a talented Big Data Engineer to join our team in Kraków. The ideal candidate will be responsible for designing, implementing, and optimizing data processing pipelines using Scala or PySpark, Hadoop, and SQL for both real-time and batch data workflows.About the RoleThe role involves partnering with various teams to assess...
-
Big Data Engineer
2 tygodni temu
Kraków, Lesser Poland Alliance-TK Pełny etatHybrid, Monday-Wednesday in the office in KrakowRequirements:3+ years of experience in backend or data engineering roles.Proficiency in programming languages such as Python, Java, or Scala.Strong experience with big data technologies like Spark, Hadoop, or Kafka.Seniority levelMid-Senior levelEmployment typeFull-timeJob functionEngineering and Information...
-
Senior Big Data Specialist
4 dni temu
Kraków, Lesser Poland Addepto Pełny etat**About Us**">At Addepto, we are a leading consulting and technology company specializing in AI and Big Data. Our mission is to help clients deliver innovative data projects by partnering with top-tier global enterprises and pioneering startups.We have a unique approach to solving complex data challenges, combining expertise in AI, Big Data, and cloud...
-
Big Data Engineer
2 tygodni temu
Kraków, Lesser Poland Tesco Technology Pełny etatJob Title: Big Data Engineer - KrakówJob Type: Full-timeLocation: Kraków, PolandAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Kraków, Poland. The ideal candidate will have a strong background in big data processing, data storage, and workflow management.Responsibilities:Design and implement big data pipelines using...
-
Big Data Engineer
1 dzień temu
Kraków, Lesser Poland Yard Corporate Pełny etatJob OverviewThe Yard Corporate is seeking a seasoned Big Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and optimizing complex data processing pipelines using Scala or PySpark, Hadoop, and SQL.Main Responsibilities- Design and develop scalable and high-performance data...
-
Senior Machine Learning Engineer Scala + Spark
1 tydzień temu
al. Maja , Kraków, Polska Grid Dynamics Poland Pełny etatWe're seeking a highly experienced Senior Machine Learning Engineer with a proven track record in deep learning research and implementation. If you thrive on tackling complex challenges and pushing the boundaries of AI, we want to hear from you.Essential functions:Research & Development: Design, develop, and implement advanced deep learning models for...
-
Big Data Engineer Position
3 dni temu
Kraków, Lesser Poland Alliance-TK Pełny etatAs a mid-senior level big data expert, you will be working on designing, implementing, and maintaining large-scale data processing systems.You will have the opportunity to work with hybrid technologies such as Spark, Hadoop, and Kafka, and collaborate with cross-functional teams to drive business outcomes.About the JobThis is a full-time position that...
-
Scala / Spark Developer
1 tydzień temu
Kraków, Lesser Poland HSBC Service Delivery Sp. z o.o. Pełny etatScala / Spark Developer Miejsce pracy: Kraków Technologies we use Expected GitHub Jira Confluence Scala Spark About the project Enterprise Technology brings together all areas of financial crime risk management at HSBC including anti- money laundering, transaction monitoring, screening, risk assessment etc. and is dedicated to implement the most effective...
-
Data Engineer Spark
1 tydzień temu
Kraków, Lesser Poland Addepto Pełny etatAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...
-
Experienced Scala Engineer Wanted for Big Data Projects
2 tygodni temu
Kraków, Polska Sii Sp. z o.o. Pełny etatAbout UsSii Sp. z o.o. is a leading technology consulting and digital transformation vendor in Poland, employing over 7,500 professionals who work on projects across various industries for clients worldwide.At Sii, we prioritize creating a friendly work environment that fosters growth and innovation. Our Great Place to Work title, awarded ten times in a row,...
-
Data Engineer Spark
4 tygodni temu
Kraków, Polska Addepto Pełny etatAddepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top...
-
Big Data Innovator
2 tygodni temu
Kraków, Lesser Poland ITDS Business Consultants Pełny etatThe RoleWe are seeking a highly skilled Data Engineer to join our team at ITDS Business Consultants. This is an exciting opportunity to work on a high-impact data platform that supports business decision-making and regulatory compliance.About the JobYou will be responsible for designing and developing scalable data pipelines using big data technologies...
-
Big Data Engineer Leader
4 dni temu
Kraków, Lesser Poland Addepto Pełny etatAs a Senior Data Engineer, you will be part of our team working on innovative data projects for top-tier clients.Our team uses cutting-edge technologies to deliver complex data solutions, and we are looking for an experienced professional to join our team.About This RoleYou will be responsible for developing and maintaining large-scale data processing...