Senior Data Engineer

1 tydzień temu


Warszawa, Mazovia, Polska Rutkowski Pełny etat

Join to apply for the Senior Data Engineer role at Tomasz Rutkowski Solo Law Firm.

Join a Company That Invests in You. Seeking Alpha is the world's leading community of engaged investors. We're the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we're also dedicated to creating a workplace where our team thrives. We're passionate about fostering a flexible, balanced environment with remote work options and an array of perks that make a real difference. Here, your growth matters. We prioritize your development through ongoing learning and career advancement opportunities, helping you reach new milestones. Join Seeking Alpha to be part of a company that values your unique journey, supports your success, and champions both your personal well-being and professional goals.

What We're Looking For

We are looking for a Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the infrastructure required to analyze large data sets. As an expert in data management, ETL (extract, transform, load) processes, and data warehousing, you will work with various big data technologies such as Spark, Hadoop, and NoSQL databases. You will work closely with the data and analytics team to identify and prioritize data engineering projects, ensuring the data infrastructure aligns with overall business goals and objectives.

What You'll Do:
  1. Work closely with data scientists/analytics and other stakeholders to identify and prioritize data engineering projects and to ensure that the data infrastructure is aligned with business goals and objectives.
  2. Design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores.
  3. Continuously monitor and optimize the performance and reliability of the data infrastructure, and identify and implement solutions to improve scalability, efficiency, and security.
  4. Stay up-to-date with the latest trends and developments in the field of data engineering, and leverage this knowledge to identify opportunities for improvement and innovation within the organization.
  5. Solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality.
  6. Implement data privacy and security requirements to ensure solutions comply with security standards and frameworks.
  7. Enhance the team's dev-ops capabilities.
Minimum Requirements:
  1. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  2. 2 years of proven experience developing large-scale software using an object-oriented or a functional language.
  3. 3 years of professional experience in data engineering, focusing on building and maintaining data pipelines and data warehouses.
  4. Strong experience with Spark, Scala, and Python, including the ability to write high-performance, maintainable code.
  5. Experience with AWS services, including EC2, S3, Athena, Lambda, and EMR.
  6. Familiarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and SQL.
  7. Experience with data pipeline orchestration and scheduling using tools such as Airflow.
  8. Strong problem-solving skills and the ability to work independently as well as part of a team.
  9. High-level English - a must.
  10. A team player with excellent collaboration skills.
Nice to Have:
  1. Expertise with Vertica or Redshift, including experience with query optimization and performance tuning.
  2. Experience with machine learning and/or data science projects.
  3. Knowledge of data governance and security best practices, including data privacy regulations such as GDPR and CCPA.
  4. Knowledge of Spark internals (tuning, query optimization).
Seniority Level

Mid-Senior level

Employment Type

Full-time

Job Function

Information Technology

Industries

Legal Services

#J-18808-Ljbffr
  • Senior Data Engineer @

    17 minut temu


    Warszawa, Mazovia, Polska Data Science UA Pełny etat

    About us:Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 8 years, we have diligently fostered the largest Data Science Community in Eastern Europe.About the company:Our client is the...

  • Senior Data Engineer @

    3 tygodni temu


    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data Engineer We seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...

  • Senior Data Engineer @

    4 tygodni temu


    Warszawa, Mazovia, Polska TechHunt Pełny etat

    Senior Data EngineerWe seek a skilled and versatile Senior Data Engineer with strong backend development experience and a solid foundation in DevOps practices. In this role, you will contribute to developing and maintaining our backend services, perform DevOps tasks such as CI/CD, infrastructure management, and participate in data pipeline design and...


  • Warszawa, Mazovia, Polska TransferGo Pełny etat

    Senior Data EngineerWarszawaWarsaw, Masovian Voivodeship, PolskaJoin us on our journey as a Senior Data Engineer to play a pivotal role in shaping how money is sent worldwide. You will work in a team of bright-minded individuals looking after data delivery on time for a wide range of questions. If you want to significantly impact the fintech industry, drive...


  • Warszawa, Mazovia, Polska Jit Team Pełny etat

    We are seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for defining and maintaining data transformation processes using Scala and Spark. You will work closely with cross-functional teams, including DevOps, QA, and Product Management, to deliver high-quality results.Responsibilities:Designing...


  • Warszawa, Mazovia, Polska HAYS POLAND Sp. z o.o. Pełny etat

    Senior Data Engineer (finance)lokalizacja: Warszawa (mazowieckie)numer referencyjny: 1192369/jobs.plHays IT Contracting is a cooperation based on B2B rules. We connect IT specialists with the most interesting, technological projects on the market.Join the group of 500 satisfied Contractors working for Hays' clientsFor our Client we are currently looking for...


  • Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    Senior Data Engineer - Backend Developer with GCPThe project focuses on designing, developing, and optimizing data pipelines and architectures for clinical research and AI model training.Your responsibilitiesEnsuring data quality, accuracy, and integrity by continuously monitoring and optimizing ETL processesEstablishing a seamless data flow from endpoint...


  • Warszawa, Mazovia, Polska emagine dla Konsultantów IT Pełny etat

    Senior Data EngineerWarszawaWarsaw, Masovian Voivodeship, PolskaTechnologies we useExpectedPythonSQLAzure Data StackApache SparkTerraformKubernetesDockerAbout the projectAs a Senior Data Engineer, you will design and build scalable Data Hubs that support analytical, reporting, operational, and Generative AI use cases. This role involves defining standards,...


  • Warszawa, Mazovia, Polska Integral Solutions Pełny etat

    Job DescriptionWe are seeking a highly skilled Senior Data Collection Engineer to join our team at Integral Solutions. As a key member of our development team, you will be responsible for designing, developing, and maintaining our data collection infrastructure.Your primary focus will be on collaborating with the backend team to optimize data collection...


  • Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    Our mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and Consultant with a satisfying experience....


  • Warszawa, Mazovia, Polska Global Payments Pełny etat

    As a Senior Software Data Engineer, you will help in the design, implementation, and testing of our data pipelines, from extract to consumption; ensuring scalable, high-performance delivery into our GPN Data Lakehouse. Leveraging expertise in dimensional modeling and data engineering best practices, you will help in architecting data models,...


  • Warszawa, Mazovia, Polska 7N Sp z o.o. Pełny etat

    Senior Data Engineer (pharma)93_8110ObowiązkiApply data engineering practices and standards to develop robust and maintainable data pipelines Analyze and organize raw data ingestion pipelines Evaluate business needs and objectives Support senior  business stakeholders in defining new data product use cases and their value Take ownership of data product...

  • Senior Data Engineer

    3 tygodni temu


    Warszawa, Mazovia, Polska Square One Resources Sp. z o.o. Pełny etat

    The project focuses on designing, developing, and optimizing data pipelines and architectures for clinical research and AI model training.Senior Data Engineer - Backend Developer with GCPYour responsibilitiesEnsuring data quality, accuracy, and integrity by continuously monitoring and optimizing ETL processes Establishing a...


  • Warszawa, Mazovia, Polska Addepto Pełny etat

    Job SummaryWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will have at least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.The ideal candidate will have strong programming skills in Python, including writing clean code and OOP design. They will also have strong SQL...

  • Senior Data Engineer

    4 tygodni temu


    Warszawa, Mazovia, Polska TransferGo Pełny etat

    technologies-expected : SQL Microsoft Power BI Snowflake Data Cloud technologies-optional : AWS about-project : Join us on our journey as a Senior Data Engineer to play a pivotal role in shaping how money is sent worldwide. You will work in a team of bright-minded individuals looking after data delivery on time for a wide range of questions. If you want to...


  • Warszawa, Mazovia, Polska Point72 Asset Management, L.P Pełny etat

    About the RoleAs a Senior Data Engineer on our Risk Technology team, you will be responsible for designing, developing, and supporting ETL, data warehouse, process flow, PnL validation and adjustment tools, and PnL reporting framework to modernize the PnL reporting platform. Your expertise in programming languages such as Python, T-SQL, and Airflow will help...


  • Warszawa, Mazovia, Polska Alter Solutions Group Pełny etat

    3 weeks ago Be among the first 25 applicantsOur mission as a company providing IT services is to provide our clients all over the world with the best solutions. We manage to do this by analyzing the needs of our clients and matching them to the skills and aspirations of our employees. Therefore, one of our main motivations is to provide each Employee and...


  • Warszawa, Mazovia, Polska Bunge Iberica SA Pełny etat

    OverviewWe are looking for a skilled Senior Data Engineer to join our team. As part of a global team, you will work on challenging and meaningful projects that directly impact core business activities. With a strong background in data architecture, data engineering, and a basic understanding of data products and data mesh, you will be responsible for...

  • Data Engineer

    5 dni temu


    Warszawa, Mazovia, Polska Digital Hub Warsaw at Bayer Pełny etat

    Company OverviewBayer's Digital Hub Warsaw is a state-of-the-art innovation center focused on data-driven solutions. As a Senior Data Engineer, you will be part of this dynamic team that combines cutting-edge technology with business expertise to drive growth and success.


  • Warszawa, Mazovia, Polska Link Group Pełny etat

    Data Engineer (Azure & Databricks)Responsibilities:Manage data pipelines and optimize query performance.Develop and maintain Azure Pipelines and Databricks jobs.Collaborate with senior stakeholders to define and improve solutions.Build robust data pipelines using DBT and implement performance optimizations.Requirements:4+ years of experience in database...