Data Engineer

7 dni temu

Warszawa, Mazovia, Polska Nityo Infotech Pełny etat

Direct message the job poster from Nityo Infotech.

We're looking for a Big Data Lead Engineer to:

  • Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively.
  • Transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques.
  • Develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.
  • Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.
  • Build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues.
  • Understand, represent, and advocate for client needs.
  • Codify best practices, methodology and share knowledge with other engineers.
  • Shape the Data and Distribution architecture and technology stack within our new cloud-based datalake-house, being a hands-on contributor and senior lead in the big data and data lake space, capable of collaborating and influencing architectural and design principles across batch and real-time flows.
  • Have a continuous improvement mindset, who is always on the lookout for ways to automate and reduce time to market for deliveries.

Your Expertise

  • Experience in building Data Processing pipelines using various ETL/ELT design patterns and methodologies to Azure data solution, building solutions using ADLSv2, Azure Data Factory, Databricks, Python, and PySpark.
  • Experience with at least one of the following technologies: Scala/Java or Python.
  • Deep understanding of the software development craft, with focus on cloud-based (Azure), event-driven solutions and architectures, with key focus on Apache Spark batch and streaming, Datalakehouses using medallion architecture. Knowledge of DataMesh principles is an added plus.
  • Ability to debug using tools like Ganglia UI, expertise in optimizing Spark Jobs.
  • The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate datasets.
  • Expert in creating data structures optimized for storage and various query patterns, e.g., Parquet and Delta Lake.
  • Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD) / ETL tools (Azure Data Factory, Informatica).
  • Experience in data modeling at least one database technology such as Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL).
  • Understanding of Information Security principles to ensure compliant handling and management of data.
  • Ability to clearly communicate complex solutions.
  • Strong problem-solving and analytical skills.
  • Working experience in Agile methodologies (SCRUM).
  • A proven team player with strong leadership skills, who can work in a collaborative way across business units, teams, and regions.
Seniority level

Mid-Senior level

Employment type

Contract

Job function

Information Technology

Industries

IT Services and IT Consulting

#J-18808-Ljbffr

  • Data Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Sunscrapers Pełny etat

    Are you ready to take on the challenge?We're looking for a Data Engineer to join our team in Warsaw or remotely.Advance your career with Sunscrapers, a leading force in software development that is now expanding its presence in a data-centric environment. Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust...

  • Data Engineer

    7 dni temu

    Warszawa, Mazovia, Polska Vwfs Pełny etat

    Join to apply for the Data Engineer (with SAP BW/4HANA) role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data...

  • Data Engineer

    18 godzin temu

    Warszawa, Mazovia, Polska VW FS Pełny etat

    Join to apply for the Data Engineer role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently...

  • Data Engineer

    13 godzin temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    We are looking for a Data Engineer with a strong background in ETL pipelines, database management, and data integrations. The ideal candidate will have hands-on experience with Python and SQL to develop and maintain data processing workflows, ensuring data integrity, performance, and security.This role involves building integrations with both external APIs...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a skilled Data Engineer to join our Site Service Data & Insights (SSDI) DataOne project. The role involves ingesting data from source systems using technologies such as Python and Talend, modeling data following the Data Vault methodology.Data Engineer - BI Reporting with Tableau / ThoughtspotYour responsibilitiesData Engineering &...

  • Data Engineer

    6 godzin temu

    Warszawa, Mazovia, Polska Clouds On Mars sp. z o.o Pełny etat

    ResponsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer's sideDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh conceptsWe are looking forStrong Data Design and...

  • Data Engineer

    7 dni temu

    Warszawa, Mazovia, Polska ALGOTEQUE Innovation Hub Pełny etat

    About company :ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive,...

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Tylko Pełny etat

    We are looking for an experienced Data Engineer who is ready to work within a team, but also autonomously and make independent decisionsAbout the TeamThe Data Engineer, together with the Analysts, is a key member of the team who supports other departments with planning and decision-making by providing expert insights. We are the proud owners of our data...

  • Data Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Digital Hub Warsaw at Bayer Pełny etat

    Company OverviewBayer's Digital Hub Warsaw is a state-of-the-art innovation center focused on data-driven solutions. As a Senior Data Engineer, you will be part of this dynamic team that combines cutting-edge technology with business expertise to drive growth and success.

  • Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are Square One. For 30 years, we have specialized in IT recruitment and understand exactly what IT experts like you need. If you're looking for new challenges, aren't afraid of projects that enhance your skills, and want to stay at the forefront of technology – you're in the right placeWe are looking for a Data Engineer with experience in Big Data or...

  • Data Platform Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etat

    Data Platform EngineerAbout Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...

  • Data Platform Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etat

    Data Platform Engineer About Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...

  • Data Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    We are looking for a Data Engineer with a strong background in analytics to join our expanding team. In this role, you will take the lead in developing a solid data foundation that drives data-driven strategies and unlocks the full potential of investment data. You will play a key role in optimizing data pipelines, enhancing data integration, and supporting...

  • Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska Newxel Pełny etat

    Are you ready to revolutionize the Sports Tech industry? We're on the hunt for a Data Engineer to join our client's dynamic team in Warsaw. This is your chance to work at the intersection of cutting-edge technology, including AI, ML, and video editing, while shaping the future of sports entertainment. Be part of a team that's Fuelling the Fandom worldwide by...

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Data Engineer47_R000116703ObowiązkiDesign, develop, and implement data solutions that acquire, transform, and optimize data from diverse sources.Build scalable data pipelines to enable efficient data processing and analysis.Ensure data quality and integrity by implementing data validation and cleansing processes.Troubleshoot data related issues.Analyze and...

  • Data Engineer @

    4 tygodni temu

    Warszawa, Mazovia, Polska Devire Pełny etat

    Devire IT Outsourcing is a form of cooperation dedicated to IT professionals, based on the principles of own business - B2B, implementing projects for clients running innovative and modern projects. Our client is one of the world's largest food and beverage companies. As a key step in scaling up our Client's Supply Chain Analytics team, we are looking for a...

  • Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska TECHBIZ GLOBAL OÜ Pełny etat

    About TechBiz GlobalWe are a leading recruitment and software development company with a diverse, globally distributed team. Our primary focus is on making our partners achieve their business goals successfully.Our tech stack includes Cloud & Infrastructure: AWS (S3, EKS, Quicksight, and monitoring tools), Data Engineering & Analytics: Apache Spark (Scala...

  • Senior Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data Engineer We seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Data Engineer

    7 dni temu

    Warszawa, Mazovia, Polska Noda Introduces Pełny etat

    Join to apply for the Data Engineer role at Noda.Hi We're on the lookout for a vibrant Data Engineer to join Noda, a licensed UK Payment Institution and the brains behind an innovative Open Banking payments platform. If you're fueled by fintech excitement and seek a global career journey, keep readingWhat is Noda?Noda is reshaping online payments, allowing...

  • Big Data Engineer

    4 dni temu

    Warszawa, Mazovia, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    About ACAISOFT POLAND Sp. z o.o.: We are a cutting-edge software house dedicated to delivering innovative solutions that meet the evolving needs of our clients.We are currently looking for a seasoned Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring seamless data...