Data Engineer

1 tydzień temu

Warszawa, Mazovia, Polska 7N Pełny etat

We are seeking experienced professionals to join our team as a Cloud Data Engineer - Data Lake Development. As a key member of our global container liner shipping company, you will play a crucial role in building and managing our Data Lake infrastructure.

About the Role:

  • You will design and implement robust data processing pipelines using internal databases, IoT data, fleet data, and third-party sources.
  • Ensure seamless integration of data into the Data Lake while adhering to data quality and consistency standards.
  • Utilize expertise in Databricks and Apache Spark to develop and optimize data processing workflows within the Data Lake.
  • Leverage Spark's capabilities to process data at scale, perform complex transformations, and facilitate data aggregation for further analysis.
  • Take ownership of data storage and management within AWS, including separation of data into different buckets and zones.
  • Work closely with IT administrators to ensure proper access control and data security.
  • Implement data tokenization mechanisms to secure sensitive information, ensuring compliance with data privacy regulations.
  • Continuously monitor the Data Lake's performance and identify opportunities for improvement.
  • Optimize data processing pipelines and storage structures to enhance data retrieval speed and overall system efficiency.
  • Collaborate with the Product Group to understand their data needs, provide technical guidance, and ensure data quality and integrity throughout the data lifecycle.
  • Provide expert technical support to the Data Lake team and data users, addressing issues related to data ingestion, processing, and access.
  • Troubleshoot and resolve any data-related problems in a timely manner.

Requirements:

  • At least 5+ years of experience as a Data Engineer, with a focus on building and managing Data Lake infrastructures.
  • Strong expertise in AWS services, including data storage and processing using S3, Databricks, and Spark.
  • Hands-on experience with Databricks, Apache Spark, and Python for data processing and optimization.
  • Proficiency in working with big data formats like Parquet, Iceberg, Delta Format.
  • Solid understanding of data privacy regulations and best practices in handling PII data.
  • Experience with data visualization and reporting tools like Qlik Sense is a plus.
  • Strong problem-solving skills, attention to detail, and ability to work in a collaborative team environment.
  • Excellent communication skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.
  • Experience with containerization technologies and Infrastructure as Code (IaC) using Terraform.
  • Proficiency with orchestration tools like Airflow.
  • Proficiency in English at the C1 level.

What We Offer:

  • A competitive salary range of €26,880 - €33,600 per year, equivalent to 160 - 200 PLN/hour + VAT.
  • Clear wage model. Our consultants know exactly what 7N's fee is for its agent role on the project.
  • Professional development support, including subsidized trainings, technical certificates, conference participation, and foreign language classes.
  • Opportunity to participate in interpersonal skills training through the 7N Secret Code.
  • Cooperation with real experts - the average professional experience of a 7N consultant is 10 years.
  • Comprehensive and personal project support from one of our agents.
  • Numerous high-end events - both online and offline.
  • Healthcare, benefit multisport, and life insurance subsidies regardless of cooperation model.
  • Access to Mindgram, a psychological support and professional development platform.
  • Professional and quality-oriented recruitment process led by experienced recruiters.

  • Technical Network Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska NTT DATA Pełny etat

    Unlock a Challenging Career in Network Engineering We are seeking a seasoned Technical Network Engineer to join our team at NTT DATA. In this role, you will be responsible for delivering top-notch remote technical support services to clients by identifying and resolving complex technical issues. This is a unique opportunity to make a meaningful impact on...

  • Senior Windows Infrastructure Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska NTT DATA Pełny etat

    Job DescriptionWe are seeking a seasoned system expert to join our team as a Senior Windows Infrastructure Engineer. This role is critical in designing and implementing information systems that support our enterprise infrastructure.About the RoleThis position ensures that all systems are working at optimal levels and supports the development of new...

  • Data Engineer for Global Data Hub

    1 tydzień temu

    Warszawa, Mazovia, Polska VOLKSWAGEN FINANCIAL SERVICES POLSKA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ Pełny etat

    Company OverviewVolkswagen Financial Services Polska Spółka z ograniczoną odpowiedzialnością is a leading provider of financial services in the automotive industry. Our goal is to empower business units to use data effectively, efficiently, and compliantly in their decisions.We are establishing an international data hub to support our strategic...

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etat

    Balyasny Asset Management L.P. Hiring for a Data Engineer PositionAre you passionate about building robust data architectures? Do you thrive on working with complex data systems?We are seeking an experienced Data Engineer to join our team at Balyasny Asset Management L.P. in Warsaw.About the RoleAs a Data Engineer, you will be responsible for designing and...

  • Data Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska emagine Polska Pełny etat

    Fintech Data Engineer RoleWe are seeking a skilled Data Engineer to join our team at emagine Polska. As a Data Engineer, you will be responsible for building and maintaining large-scale data pipelines and transformations.Key Responsibilities:Design and implement data pipelines using SQL, Redshift, and PySparkDevelop and maintain data transformations using...

  • Data Pipeline Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska stuart Pełny etat

    Data Engineering at StuartWe are looking for a skilled Data Pipeline Engineer to join our team at Stuart. As a Data Pipeline Engineer, you will be responsible for building and maintaining data pipelines and models in our data warehouse to enable business users to interact with data at the level of detail they need.Design and implement data pipelines and...

  • Senior Data Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska Sunscrapers sp. z o.o. Pełny etat

    About the Role:As a Senior Data Engineer at Sunscrapers, you will be responsible for designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from various sources.Key Responsibilities:Design and implement data collection systems that integrate proprietary company data and third-party...

  • Sports Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Sportradar Pełny etat

    About the RoleAs a Sports Data Engineer at Sportradar, you will be responsible for implementing back-end applications in collaboration with the Frontend team. With an end product visible to thousands of customers every day and used 24/7, you'll have the opportunity to make a real impact in a high-availability environment, delivering top performance and...

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska VELUX Group Pełny etat

    Transform Spaces, Transform CareersIn the VELUX Group, we're shaping the future of sustainable indoor living. As a Data Engineer, you'll play a key role in developing and maintaining robust data platforms that align with our data strategy.About the RoleYou'll join our newly established Data Platform Team, working alongside skilled and engaged colleagues from...

  • Data Engineer

    2 miesięcy temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Data Engineer - Proactive SupportAt Square One Resources Sp. z o.o., we're looking for a skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in providing proactive support to our employees by analyzing and organizing raw data, building data systems and pipelines, and interpreting trends and patterns.Your...

  • Data Transfer Engineer III

    4 tygodni temu

    Warszawa, Mazovia, Polska ING Pełny etat

    Job Title: Data Transfer Engineer IIIAbout INGING is an international team of highly qualified professionals working together to provide cutting-edge solutions in data transfer and processing.Salary Range:We offer a competitive salary range of 65,000 - 90,000 per annum, depending on location and experience.Job DescriptionWe are seeking a talented Data...

  • Data Platform Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Ecovadis Pełny etat

    We are seeking an experienced Data Platform Engineer to join our growing data platform team in Warsaw. The successful candidate will play a crucial role in developing and automating our Data Platform and self-serve data infrastructure.Job DescriptionThis is an exciting opportunity for a skilled software engineer to drive the development of new data...

  • Data Engineer

    3 tygodni temu

    Warszawa, Mazovia, Polska Michael Page Pełny etat

    We are seeking an experienced Data Engineer to join our team at Michael Page in Warsaw. As a key member of our data engineering team, you will be responsible for designing and implementing robust data pipelines to ingest, clean, and process investment-related data from various sources.About the RoleIn this role, you will have the opportunity to work with...

  • Cloud Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska b2bnetwork Pełny etat

    About the RoleAs a Snowflake Data Engineer at b2bnetwork, you will be responsible for developing and maintaining data pipelines in our Snowflake-based data warehouse.You will work closely with the DW & Analytics team to design, implement, and optimize data pipelines to meet the needs of our business users.Key responsibilities include loading and extracting...

  • Data Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska RITS Pełny etat

    {"h1": "Praca Data Engineer", "p1": "Poszukujemy doświadczonego Data Engineer'a do współpracy z klientem z Wielkiej Brytanii, który będzie wymagał pomocy w obsłudze data ingestion oraz implementacji transformacji danych w PySpark i SQL.", "ul1": ["Wymagania techniczne:", "- Aktualna znajomość platformy Databricks", "- Wiedza o Python, PySpark, SQL",...

  • Senior Data Quality Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etat

    **About the Role**Balyasny Asset Management L.P. is seeking a skilled Senior Data Quality Engineer to join our team.As a Senior Data Quality Engineer, you will be responsible for designing and developing solutions that leverage cloud-based data and distributed computing technologies to create our next-gen data quality platform.You will contribute...

  • Data Engineer Specialist

    3 tygodni temu

    Warszawa, Mazovia, Polska Digital Hub Warsaw At Bayer Pełny etat

    Are you a skilled data professional looking for a challenging role in a dynamic environment? We are seeking an experienced Data Engineer to join our team at Digital Hub Warsaw At Bayer.About the RoleWe are looking for a talented individual to lead the design, implementation, and maintenance of our data infrastructure. As a Data Engineer, you will be...

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska 7N Sp. Z O.o. Pełny etat

    Company OverviewWe are a dynamic team of experts in the field of data engineering, dedicated to delivering innovative solutions that drive business growth. Our company, 7N Sp. Z O.o., is a leading provider of data-driven services, and we are seeking a talented Data Engineer / Python Developer to join our project.

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Michael Page Pełny etat

    Data Engineer OpportunityAt Michael Page, we are seeking a skilled Data Engineer to join our team in Warsaw. This exciting opportunity involves designing and implementing robust data pipelines to ingest, clean, and process investment-related data from various sources.We require an individual with a strong technical background, experience in data and...

  • Big Data Engineer

    1 miesiąc temu

    Warszawa, Mazovia, Polska Jit Team Pełny etat

    Job DescriptionAs a Junior Big Data Engineer at Jit Team, you will be part of a dynamic team working on various projects, including providing first-level support and technical expertise to the DROC team.Key Responsibilities:Executing ETL processes and refreshing UIs for data validationAssisting with Spark/Hive queries for dataset analysisClassifying and...