Data Engineer – Webscraping

5 dni temu

Warszawa, Mazovia, Polska Balyasny Asset Management L.P. Pełny etat

The Data Science & AI team is a key part of BAM's continued growth. Year over year, the knowledge needed to leverage data plays an increasingly important role in the firm's core business.The analysis, services, software, and operational expertise that Data Science & AI provides are part of BAM's competitive advantage.

Role Overview

The Webscraping team is a team of dynamic, creative problem solvers located around the globe. We combine high technical expertise with cutting-edge technology to obtain any data on the web which can help our investment teams generate returns. We work on a huge variety of data, from hurricane forecasts in Florida to iPhone prices in China. We find data which nobody else has, and we deliver it to investors with unmatched speed and reliability.

Just as every website is different, every solution we work on is unique and requires innovative, outside-the-box thinking. We are looking for a technically proficient, creative and detail-oriented Data Engineer to join the Warsaw branch of our global team. You will help us provide critical data, infrastructure and support to teams across the firm that directly impact their investment decisions every day.

Key Responsibilities

  • Design, implement and maintain robust and reliable pipelines for delivering alternative datasets gathered from a variety of web-based sources.
  • Collaborate with investment staff to understand, anticipate and meet their requirements.
  • Author QC checks to validate data availability and integrity.
  • Maintain alerting systems and investigating time-sensitive data incidents to ensure smooth day-to-day operations.
  • Design and implement products and tools to enhance the Webscraping platform.
  • Participate in on-call rotations to support our products and investors, embodying our "own what we build" philosophy.

Minimum Qualifications

  • Bachelor's or Master's degree in Computer Science or a related field.
  • 1-3 years of software development experience.
  • Strong proficiency in Python (including pandas) and SQL/Database skills.
  • Experience with web technologies (HTML/JS, APIs) and networking.
  • Proficiency in Linux (Windows experience is a plus).
  • Excellent verbal and written communication skills.

Preferred Qualifications

  • Aptitude for designing infrastructure, data products, and tools for Data Scientists.
  • Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, XPath).
  • Proficiency in containerizing workloads with Docker (Kubernetes experience is a plus).
  • Experience with build automation tools (Jenkins, GitLab CI/CD).
  • Familiarity with cloud technologies, particularly AWS.

Why Join Us?

  • Be part of a dynamic and innovative global team.
  • Contribute to high-impact projects that drive our investment strategies.
  • Leverage cutting-edge AI and ML technologies to enhance and scale operations.
  • Opportunities for professional growth and career advancement.
  • Work in a collaborative environment that values diversity and inclusivity.
#J-18808-Ljbffr

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Vwfs Pełny etat

    Join to apply for the Data Engineer (with SAP BW/4HANA) role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data...

  • Data Engineer

    2 dni temu

    Warszawa, Mazovia, Polska VW FS Pełny etat

    Join to apply for the Data Engineer role at Volkswagen Financial Services (Poland)Join our newly created European Data & Analytics HUB - we are growingThis strategic initiative is created to enable the change of Volkswagen Financial Services (VWFS) to a data-driven company. Our goal is to empower all VWFS business units to use data effectively, efficiently...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are seeking a skilled Data Engineer to join our Site Service Data & Insights (SSDI) DataOne project. The role involves ingesting data from source systems using technologies such as Python and Talend, modeling data following the Data Vault methodology.Data Engineer - BI Reporting with Tableau / ThoughtspotYour responsibilitiesData Engineering &...

  • Data Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Link Group Pełny etat

    We are looking for a Data Engineer with a strong background in ETL pipelines, database management, and data integrations. The ideal candidate will have hands-on experience with Python and SQL to develop and maintain data processing workflows, ensuring data integrity, performance, and security.This role involves building integrations with both external APIs...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska ALGOTEQUE Innovation Hub Pełny etat

    About company :ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive,...

  • Data Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Clouds On Mars sp. z o.o Pełny etat

    ResponsibilitiesDelivering Azure-based analytical solutionsCooperating with architects and stakeholders on a customer's sideDesigning Data processing platformDeveloping and designing ETL conceptsIncorporating DWH into Company IT architectureSupporting analysts in data model designingDesigning ETL, DWH refresh conceptsWe are looking forStrong Data Design and...

  • Data Engineer

    1 dzień temu

    Warszawa, Mazovia, Polska AIDA Recruitment Pełny etat

    We are currently looking for a Data Engineer in Poland for our client project, which involves remote full-time involvement.Responsibilities:Develop and manage efficient data pipelines for extracting and transforming data from Dynamics 365 FO.Design data storage and integration solutions that align with analytical and business needs.Optimize data processing...

  • Data Engineer

    3 dni temu

    Warszawa, Mazovia, Polska Digital Hub Warsaw at Bayer Pełny etat

    Company OverviewBayer's Digital Hub Warsaw is a state-of-the-art innovation center focused on data-driven solutions. As a Senior Data Engineer, you will be part of this dynamic team that combines cutting-edge technology with business expertise to drive growth and success.

  • Data Engineer

    4 tygodni temu

    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    We are Square One. For 30 years, we have specialized in IT recruitment and understand exactly what IT experts like you need. If you're looking for new challenges, aren't afraid of projects that enhance your skills, and want to stay at the forefront of technology – you're in the right placeWe are looking for a Data Engineer with experience in Big Data or...

  • Data Platform Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska Capgemini Polska Sp. z o.o. Pełny etat

    Data Platform Engineer About Insights & Data: Insights & Data is a team of over 400 specialists delivering high-quality, data-centric solutions. We focus on Cloud & Big Data engineering, designing and implementing scalable architectures across AWS, Azure, and GCP. Our expertise spans the entire Software Development Life Cycle (SDLC), employing advanced...

  • Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska Newxel Pełny etat

    Are you ready to revolutionize the Sports Tech industry? We're on the hunt for a Data Engineer to join our client's dynamic team in Warsaw. This is your chance to work at the intersection of cutting-edge technology, including AI, ML, and video editing, while shaping the future of sports entertainment. Be part of a team that's Fuelling the Fandom worldwide by...

  • Data Engineer Lead

    1 dzień temu

    Warszawa, Mazovia, Polska Addepto Pełny etat

    At Addepto, we are seeking a highly skilled Senior Data Engineer to join our team of technology experts. As a Senior Data Engineer, you will have the exciting opportunity to work on challenging projects across various industries, leveraging cutting-edge technologies such as BigQuery and Google Cloud Platform.">Main ResponsibilitiesDesign, implement, and...

  • Data Engineer

    7 dni temu

    Warszawa, Mazovia, Polska TECHBIZ GLOBAL OÜ Pełny etat

    About TechBiz GlobalWe are a leading recruitment and software development company with a diverse, globally distributed team. Our primary focus is on making our partners achieve their business goals successfully.Our tech stack includes Cloud & Infrastructure: AWS (S3, EKS, Quicksight, and monitoring tools), Data Engineering & Analytics: Apache Spark (Scala...

  • Senior Data Engineer @

    2 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data Engineer We seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Big Data Engineer

    6 dni temu

    Warszawa, Mazovia, Polska ACAISOFT POLAND Sp. z o.o. Pełny etat

    About ACAISOFT POLAND Sp. z o.o.: We are a cutting-edge software house dedicated to delivering innovative solutions that meet the evolving needs of our clients.We are currently looking for a seasoned Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring seamless data...

  • Data Engineer

    1 tydzień temu

    Warszawa, Mazovia, Polska Noda Introduces Pełny etat

    Join to apply for the Data Engineer role at Noda.Hi We're on the lookout for a vibrant Data Engineer to join Noda, a licensed UK Payment Institution and the brains behind an innovative Open Banking payments platform. If you're fueled by fintech excitement and seek a global career journey, keep readingWhat is Noda?Noda is reshaping online payments, allowing...

  • Data Engineer

    5 dni temu

    Warszawa, Mazovia, Polska TN Poland Pełny etat

    Social network you want to login/join with:You will be a contributor in a new dedicated core data engineering team tasked with developing and owning standard data engineering patterns that BAM's data engineers, analysts, scientists, and quantitative researchers depend on for ingesting and transforming data throughout our ecosystem. This central team is...

  • Senior Data Engineer @

    3 tygodni temu

    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data EngineerWe seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Data Engineer Position

    2 dni temu

    Warszawa, Mazovia, Polska SALESTUBE sp. z o.o. Pełny etat

    Job DescriptionSalestube is a leading digital marketing agency that offers a unique blend of technological, analytical, e-commerce, and media services. We are seeking an experienced Data Engineer to join our team.About the RoleWe are looking for a highly skilled Data Engineer who can design and implement scalable data architectures, develop efficient data...

  • Data Analytics Engineer

    2 dni temu

    Warszawa, Mazovia, Polska Grid Dynamics International, Inc. Pełny etat

    About the RoleWe are seeking a highly skilled Data Analytics Engineer to join our team at Grid Dynamics International, Inc.As a Data Analytics Engineer, you will play a crucial role in designing and developing high-performance data analytics platforms that handle petabytes of data.The ideal candidate will have strong hands-on expertise in Apache Druid,...