Data Engineer

2 tygodni temu

Warszawa, Mazovia, Polska Be | Shaping the Future Poland Pełny etat 80 000 zł - 120 000 zł rocznie

Be | Shaping the Future Poland
has a proven position of being a reliable partner for financial services organisations to analyse complex requirements, find solutions and implement them in their entirety, regardless of their complexity. One of our clients is looking for a
Data Engineer
to join a greenfield initiative focused on building an in-house data lake platform (AWS-based) for real-time and near real-time market data ingestion. The solution will support BI services, data science tools, and multiple business initiatives within a global trading environment.

Why This Role?

You'll be part of a high-impact initiative focused on building a scalable, high-performance data platform for global fixed-income trading. This role offers a unique opportunity to shape a new solution from the ground up within the AWS ecosystem.

Key responsibilities:

  • Ingest multiple data sources in batch and near real-time into a shared storage layer
  • Design and maintain decoupled storage and compute environments to improve scalability, performance, and cost efficiency
  • Maintain and enhance a centralized metadata catalogue ensuring a single view of the data model for all consumers
  • Integrate the platform with AWS services (Athena, EMR, QuickSight, etc.) and 3rd-party solutions (Spark, Presto, Tableau)
  • Build and maintain high-quality ETL pipelines and data ingestion processes
  • Collaborate closely with business stakeholders as part of a small, agile development team focused on high-quality solutions for electronic trading and pricing workflows
  • Take responsibility for software delivery by ensuring quality and scope expectations are met
  • Contribute to and take ownership of the technical design, ensuring all aspects of the system architecture are well documented
  • Work closely with partner technology teams and collaborate effectively

Technical skills (3–5 years of experience):

  • Experience with Python, PySpark, Pandas, JupyterLab (working with notebooks)
  • Experience using the AWS platform
  • Experience with continuous integration and continuous delivery tools such as Git, Jenkins, etc.
  • Knowledge of BI tools (Qlik, Tableau, Power BI, etc.)
  • Understanding of agile development and the software development lifecycle
  • Strong experience in big data ingestion and handling large datasets
  • Proven background in creating and maintaining high-quality ETL pipelines
  • Solid understanding of AWS data ecosystem and distributed data processing frameworks
  • Ability to work in a fast-moving environment and contribute to a new greenfield platform

Nice to have:

  • Experience with Kafka, SQL, Hive, Hadoop
  • Experience using EMR (Elastic MapReduce) in AWS to run Spark clusters
  • Knowledge of Terraform
  • Experience with Ansible and Bash scripting

Our offer:

  • Competitive remuneration on B2B contract
  • Option to activate Medicover and Multisport on preferential terms
  • Access to Mindgram – mental health & well-being platform
  • Free gym at Q22
  • Personal development – internal online / onsite DevTalks
  • Referral bonus program
  • International environment

  • SAP BW Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Integral Solutions - Data & AI Pełny etat 40 000 € - 80 000 € rocznie

    SAP BW Data Engineer Location: Poland Work mode: Remote Cooperation: B2B Rate* Euro netto B2B + VATAbout the company/project*Our Client a global leader in precision agriculture and smart water solutions, is lookingfor a talented and driven SAP BW Data Engineer to join our growing DataEngineering team.In this high-impact role, you will take ownership of one...

  • Senior Software Engineer

    6 dni temu

    Warszawa, Mazovia, Polska Soda Data Pełny etat

    Soda - creators of the Soda Core - are looking for a Senior Software Engineer (Data and Backend) to help improve our Open Source and Cloud products. We're moving in an exciting new direction, and we need your help. If you're a software engineer who thrives on tackling large-scale challenges and wants to build the future of Fully Automated Data Quality, we'd...

  • Senior Software Engineer

    4 dni temu

    Warszawa, Mazovia, Polska Soda Data Pełny etat

    Soda - creators of the Soda Core - are looking for a Senior Software Engineer (Data and Backend) to help improve our Open Source and Cloud products.We're moving in an exciting new direction, and we need your help. If you're a software engineer who thrives on tackling large-scale challenges and wants to build the future of Fully Automated Data Quality, we'd...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Axiom Software Solutions Limited Pełny etat 50 000 zł - 70 000 zł rocznie

    Here is a complete and polished Job Description (JD) for the Data Engineer role based on your requirements:Job Title: Data Engineer Job Location: Poland (Remote) Employment Type: B2B Contract About the RoleWe are looking for a skilled Data Engineer to join our team on a B2B contract basis for an exciting opportunity with our client, Coforge. This role is...

  • BigData Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Integral Solutions - Data & AI Pełny etat 45 000 zł - 65 000 zł rocznie

    We are looking for a skilledBigData Engineerto join an exciting project fora leading banking client, one of the top players in the Polish market. You will work on building and improving Big Data solutions that support key business processes, using modern technologies and best engineering practices.It's a Warsaw-based opportunity. The team visit the office...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat 30 000 zł - 60 000 zł rocznie

    We are looking for an experienced Data Engineer to join a long-term project starting October 1, 2025. The engagement is planned for 18 months, fully remote, with the possibility to work with cutting-edge data technologies in a dynamic and challenging environment. The project will involve collaboration with the client's technical teams, ensuring high-quality...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Onex Group Pełny etat 90 000 zł - 120 000 zł rocznie

    Twoje obowiązki:Projektowanie i budowanie rozwiązań w obszarze Nowoczesnych Platform Danych (np. Big Data, Modern Data Warehouse, Modernizacja hurtowni danych, Data Analytics) w oparciu o usługi Azure .Implementacja transformacji danych (ETL/ELT), analityka (OLAP) i raportowanie za pomocą technologii Azure (np. Data Factory, Fabric, Power BI).Wsparcie...

  • Data Engineer

    2 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat 40 000 zł - 80 000 zł rocznie

    Poszukujemy Data Engineera, który wesprze naszego klienta w tworzeniu skalowalnych i bezpiecznych rozwiązań do przetwarzania danych w środowisku Azure. Projekt koncentruje się na rozwoju pipelines ETL/ELT, integracji danych i przygotowywaniu ich pod potrzeby zespołów Data Science, ML oraz BI – z naciskiem na programowanie w Pythonie.Data...

  • Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska Medvidi Pełny etat

    MEDvidi, a dynamic telehealth company specializing in mental health, is on a fervent hunt for a proficient Data Engineer to come aboard our exhilarating scale up voyage. We are keenly interested in an innovative, strategically oriented professional who will contribute to enhancing MEDvidi by managing and optimizing our data architecture.Collaborating closely...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska In4Ge Pełny etat 60 000 zł - 90 000 zł rocznie

    We are looking for an experienced Data Engineer to join the Data & Analytics team. The ideal candidate will have deep expertise in data engineering with a focus on building Graph Databases using Neo4j, as well as hands-on experience in data ingestion, optimization techniques and Google Cloud Platform (GCP) services.