Data Engineer

1 miesiąc temu

Warszawa, Mazovia, Polska 7N Pełny etat

We are seeking experienced professionals to join our team as a Cloud Data Engineer - Data Lake Development. As a key member of our global container liner shipping company, you will play a crucial role in building and managing our Data Lake infrastructure.

About the Role:

  • You will design and implement robust data processing pipelines using internal databases, IoT data, fleet data, and third-party sources.
  • Ensure seamless integration of data into the Data Lake while adhering to data quality and consistency standards.
  • Utilize expertise in Databricks and Apache Spark to develop and optimize data processing workflows within the Data Lake.
  • Leverage Spark's capabilities to process data at scale, perform complex transformations, and facilitate data aggregation for further analysis.
  • Take ownership of data storage and management within AWS, including separation of data into different buckets and zones.
  • Work closely with IT administrators to ensure proper access control and data security.
  • Implement data tokenization mechanisms to secure sensitive information, ensuring compliance with data privacy regulations.
  • Continuously monitor the Data Lake's performance and identify opportunities for improvement.
  • Optimize data processing pipelines and storage structures to enhance data retrieval speed and overall system efficiency.
  • Collaborate with the Product Group to understand their data needs, provide technical guidance, and ensure data quality and integrity throughout the data lifecycle.
  • Provide expert technical support to the Data Lake team and data users, addressing issues related to data ingestion, processing, and access.
  • Troubleshoot and resolve any data-related problems in a timely manner.

Requirements:

  • At least 5+ years of experience as a Data Engineer, with a focus on building and managing Data Lake infrastructures.
  • Strong expertise in AWS services, including data storage and processing using S3, Databricks, and Spark.
  • Hands-on experience with Databricks, Apache Spark, and Python for data processing and optimization.
  • Proficiency in working with big data formats like Parquet, Iceberg, Delta Format.
  • Solid understanding of data privacy regulations and best practices in handling PII data.
  • Experience with data visualization and reporting tools like Qlik Sense is a plus.
  • Strong problem-solving skills, attention to detail, and ability to work in a collaborative team environment.
  • Excellent communication skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.
  • Experience with containerization technologies and Infrastructure as Code (IaC) using Terraform.
  • Proficiency with orchestration tools like Airflow.
  • Proficiency in English at the C1 level.

What We Offer:

  • A competitive salary range of €26,880 - €33,600 per year, equivalent to 160 - 200 PLN/hour + VAT.
  • Clear wage model. Our consultants know exactly what 7N's fee is for its agent role on the project.
  • Professional development support, including subsidized trainings, technical certificates, conference participation, and foreign language classes.
  • Opportunity to participate in interpersonal skills training through the 7N Secret Code.
  • Cooperation with real experts - the average professional experience of a 7N consultant is 10 years.
  • Comprehensive and personal project support from one of our agents.
  • Numerous high-end events - both online and offline.
  • Healthcare, benefit multisport, and life insurance subsidies regardless of cooperation model.
  • Access to Mindgram, a psychological support and professional development platform.
  • Professional and quality-oriented recruitment process led by experienced recruiters.

  • Data Engineer: Cloud-Native Data Expert

    2 tygodni temu

    Warszawa, Mazovia, Polska 7N Pełny etat

    About 7NAt 7N, we pride ourselves on our expertise in delivering high-end projects for leading US financial services companies. Our team of experienced professionals is dedicated to helping our clients achieve their goals through innovative solutions.Job DescriptionWe are seeking a highly skilled Senior Data Engineer / Datalake Expert to join our team. As a...

  • Senior Big Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska DCV Technologies Pełny etat

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at DCV Technologies in Warsaw, Poland. This is an exciting opportunity to work with a multinational client in the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.About the Job:The...

  • Data Engineer Expert for Cloud-Native Data Platform

    4 tygodni temu

    Warszawa, Mazovia, Polska 7N Pełny etat

    7N Consultants are seeking a seasoned Senior Data Engineer to join our team in Warsaw. As a key member of our data engineering squad, you will be responsible for designing, building, deploying, and maintaining a web-scale, cloud-native data platform.We are looking for an expert with at least 5+ years of recent hands-on professional experience working as a...

  • Data Engineer

    7 dni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a highly skilled Data Engineer to join our team at Square One Resources Sp. z o.o. in a key project focused on developing data products and reporting solutions that support decision-making for organizations servicing diagnostic instruments.About the RoleAs a Data Engineer, you will be responsible for designing and optimizing data pipelines...

  • Data Engineer for Banking Solutions

    5 dni temu

    Warszawa, Mazovia, Polska emagine Polska Pełny etat

    At emagine Polska, we are seeking an experienced Data Engineer to join our team in Warsaw, Gdynia or Gdańsk. The successful candidate will be responsible for driving release activities, designing and maintaining applications built on the Quantexa platform.We offer a competitive salary of 170 PLN per hour and a hybrid work model with one day per week spent...

  • Senior Cloud Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Be part of a world leading company in the FMCG industry as a Senior Cloud Data Engineer. Our team is responsible for designing, developing and implementing data and analytics cloud-based platforms (DAP) and pipelines which acquire, cleanse, transform and publish data.We are looking for someone who can assemble large, complex data sets that meet functional...

  • Data Engineer Leader

    2 tygodni temu

    Warszawa, Mazovia, Polska RITS Professional Services Pełny etat

    RITS Professional Services is seeking a highly skilled Data Engineer to join our team. The ideal candidate will have experience in Cloud Migration, Data Warehousing or Data Integration projects and possess excellent SQL skills.We are offering a competitive salary of $120,000 - $180,000 per year, depending on the candidate's experience.About the JobThis role...

  • ESG Data Engineer: Transforming Sustainability Insights

    7 dni temu

    Warszawa, Mazovia, Polska Experis Manpower Group Pełny etat

    Job OverviewWe are seeking a highly skilled ESG Data Engineer to join our team at Experis Manpower Group. This exciting opportunity allows you to utilize your technical expertise to drive sustainability insights and support business decision-making.Estimated Salary: $120,000 - $180,000 per yearJob DescriptionAs an ESG Data Engineer, you will be responsible...

  • Cloud Data Engineer for Large Scale Data Warehousing

    4 tygodni temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    Your role as a Cloud Data Engineer at Link Group will focus on delivering business-critical data that optimizes and supports trading processes. Key responsibilities include working within a cross-functional team to handle requirements analysis, testing, programming, deployments, and consulting with the business on proposed solutions.Key ResponsibilitiesData...

  • Data Engineer for GenAI Optimization

    2 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Job Title: Data Engineer for GenAI OptimizationAbout the Role:We are seeking a skilled Data Engineer to join our team at Square One Resources Sp. z o.o. in Warsaw, Poland. As a Data Engineer for GenAI optimization, you will play a crucial role in designing and implementing efficient data strategies using FastAPI.Your Responsibilities:Design and develop...

  • Data Engineer for Scalable Data Solutions

    2 tygodni temu

    Warszawa, Mazovia, Polska SoftwareOne Pełny etat

    About SoftwareOneSoftwareOne is a leading global software and cloud solutions provider that is revolutionizing how companies build, buy, and manage everything in the cloud. By empowering clients to migrate and modernize their workloads and applications, and simultaneously navigating and optimizing the resulting software and cloud changes, SoftwareOne unlocks...

  • Data Engineer for Digital Transformation

    4 tygodni temu

    Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Data Platform Engineer, Digital ExperiencesWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of innovative digital solutions.Key Responsibilities:Collaborate with cross-functional teams to design and implement cloud-native data platforms that drive business growth.Develop and maintain scalable data management...

  • Senior Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Procter And Gamble Polska Sp. z o.o. Pełny etat

    Job Title: Senior Data Engineer - Microsoft Azure ExpertAbout the Job:We are looking for a highly skilled Data Engineer to join our team at Procter and Gamble Polska Sp. z o.o. in Warsaw, Poland.Salary: Estimated salary range for this position is PLN 80,000 - 120,000 per month, depending on experience.Job Description: As a Data Engineer, you will be...

  • Data Engineer with Advanced Data Systems Expert

    7 dni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a skilled Data Engineer to join our team for a strategic data management project at Square One Resources Sp. z o.o.Estimated Salary: 80,000 - 100,000 PLN per year (part-time, 20 hours/week).About the RoleThis position involves utilizing expertise in database management systems and data engineering to contribute to data harmonization, enhancing...

  • Dane Cię do Sukcesu

    4 tygodni temu

    Warszawa, Mazovia, Polska Scalo Pełny etat

    Pracujemy na czele dzisiejszych innowacji i wyznaczamy standardy w obszarze rozwiązań danych. Dołączając do naszego zespołu jako Data Engineer, będziesz miał możliwość pracy nad projektem w nowo utworzonej linii bankowości/finansów.ZaletyDługoterminowa współpraca oraz pracę w różnorodnych projektach (działamy w ramach Software Services,...

  • Data Engineer with Database Systems Specialist

    7 dni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a skilled Data Engineer to join Square One Resources Sp. z o.o. for a strategic data management project. This product is designed to provide critical data and applications that facilitate strategic decision-making, aligning project portfolios with business strategies.Key ResponsibilitiesContribute to data harmonization, enhancing the usability...

  • Data Engineer for Logistics Data Solutions

    4 tygodni temu

    Warszawa, Mazovia, Polska Schenker Technology Center Warsaw Sp. Z O.o. Pełny etat

    The Schenker Technology Center Warsaw Sp. Z O.o. is seeking a talented Data Engineer to contribute to designing advanced analytics solutions for solving potential business use cases in logistics using Machine Learning, AI techniques, Data Visualization tools and Big Data technologies.Key ResponsibilitiesAnalyze data and design, code, test, debug, automate,...

  • Cloud Data Warehouse Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Holisticon Insight Pełny etat

    About the RoleWe are seeking an experienced Cloud Data Warehouse Engineer to join our client's team in Poland. As a key member of the analytics and insights division, you will be responsible for designing, building, and maintaining cloud-based data warehouses using Snowflake.ResponsibilitiesDesign and develop scalable cloud data warehouses using...

  • Data Engineer for High-Performance Data Pipelines

    4 tygodni temu

    Warszawa, Mazovia, Polska Grid Dynamics Poland Sp. z o.o. Pełny etat

    We are seeking an experienced Data Engineer to contribute to the development of high-performance data pipelines at Grid Dynamics Poland Sp. z o.o.The ideal candidate will have expertise in handling large-scale data using technologies such as Cassandra, Kafka, Spark, and Scala.This is a unique opportunity to work on a high-impact project within a...

  • Data Engineering Expert

    1 miesiąc temu

    Warszawa, Mazovia, Polska Allegro Pełny etat

    Allegro is a leading e-commerce platform in Poland, and we're looking for a skilled Data Engineer to join our team. As a Data Engineer at Allegro, you'll play a crucial role in shaping the future of our business by designing, developing, and maintaining robust data pipelines.