Senior Data Engineer

4 tygodni temu

Warsaw, Polska Appcast Pełny etat
Job Description

The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract data from disparate sources; efficiently build and manage transformations into a cloud data warehouse; and build pipelines that load data into tools used by economists, data scientist, data analysts, and many other stakeholders. SQL and Python/R skills are a must. As is extensive experience managing data warehouses and ELT/ETL processes in an OLAP database.  

Job Responsibilities

Move data between systems:  

  • Extraction – Appcast has several disparate internal proprietary, external proprietary and external public sources that all serve our customers in several ways. A senior data engineer’s primary job is to build automated processes that extract data from these disparate sources for downstream use by data analysts. 
  • Transform – The senior data engineer will transform data from disparate sources into distinct tables using a relational data model, so that analysts can pull them together in one unified workflow. 
  • Load – The senior data engineer will need to load the new tables into a cloud data warehouse using efficient, low-latency methods. 

Manage cloud data warehouse:  

  • Monitor performance – As data needs grow, the senior data engineer will need to monitor essential performance queries used by downstream analysts to ensure data is being delivered in a timely manner that does not cause slowdowns.  
  • Data quality – Ensuring both internal and external data sources are accurate and up to date to provide the best quality for our clients and media partners.  

Serve data to downstream users (“democratize data”):  

  • Liaison with the Appcast core software development team on data extraction from its proprietary database. 
  • Data visualization/dashboards - Partner with data analysts to ensure BI tools (e.g., Tableau) are accurate and up to date. 
  • Data permissions/access - Manage the onboarding and offboarding of data permissions, who is given access to the cloud data warehouse and ensuring proper security protocols are being followed. 

Set data strategy for company:  

  • Control cost – Work with procurement specialists to keep negotiated contracts controlled with external data vendors; research/keep up to date with new data vendors that can provide Appcast with a competitive advantage in our competitive market  
  • Data awareness/education - Educate analysts on basic data “hygiene” on how to manage and clean data, and where to access data sources  
  • Data security and governance – Develop a deep understanding of Appcast data, work with internal stakeholders to decide on what data is proper to share with clients/media due to sample size and quality  
  • Pioneer the adoption of sophisticated ETL/ELT frameworks and platforms such as Apache Airflow and DBT to enhance data workflow automation. 
  • Serve as the primary senior data engineering expert, advising senior management and other internal stakeholders on technological advancements and strategic investments in data infrastructure. 

Qualifications

  • Expert proficiency in writing SQL queries 
  • Expert proficiency in a data engineering programming language (e.g. Python, R, Scala) 
  • Expert proficiency at managing data warehouses and ETL/ELT/OLAP processes   
  • Background in data modeling and distributed data systems 
  • Strong problem-solving skills and attention to detail   
  • Excellent communication and collaboration skills  
  • Experience with streaming data platforms like Amazon Kinesis or Apache Kafka 
  • Implement and manage complex data systems like Apache Spark for efficient data storage and computation.  
  • Familiarity with BI tools like Tableau, Shiny or PowerBI is a plus 

Education and Experience

  • Bachelor’s degree (or higher) in Computer Science, Information Technology, or a related field 
  • And, 8+ years of experience in data engineering   
  • Expert experience in writing SQL queries  
  • Strong experience in writing Python, R, and/or Scala code  
  • Strong experience in managing data warehouses and ETL/ELT/OLAP processes  
  • Experience with PostgreSQL, Tableau, or AWS tools is a plus    
  • Experience with big data technologies like Apache Spark is a plus 

Travel Requirements

  • Regular travel is not necessary for this position. 



Additional Information

Appcast recognized as one of Inc Magazine's "Best Workplaces" for 2021 & 2022 

  • We’re the best at what we do. We’re the global leader in programmatic recruitment advertising. With advanced technology, unmatched market data and a team of the industry’s best recruitment marketers. 
  • We have an amazing culture driven by great people. Headquartered in Lebanon, N.H. with offices in the U.S., Canada and Europe, Appcast is part of the Stepstone group. To better understand our company culture, read Our Story and check out Working at Appcast on our website.  
  • We take care of our employees. We're dedicated to creating an inviting environment where individuals from diverse backgrounds can thrive and develop. We believe in providing competitive compensation and comprehensive benefits, ensuring our team can support their loved ones and one another. We enjoy fostering a sense of community through dedicated employee networks, fun gatherings, delicious food, and even welcoming furry friends into our workspace. We live our values each day including volunteering and giving back to our communities. 

All your information will be kept confidential according to EEO guidelines. 

Appcast is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

  • Senior Data Engineer

    1 tydzień temu

    Warsaw, Polska Digital Turbine Pełny etat

    Senior Data Engineer Warsaw, PolandEMEA – AGP Tech /Regular /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences that...

  • Senior Data Engineer

    4 dni temu

    Warsaw, Polska Data Science UA Pełny etat

    About us: Data Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the organization of the first Data Science UA conference, setting the foundation for our growth. Over the past 7 years, we have diligently fostered the largest Data Science Community in Eastern Europe, boasting a network of over 30,000...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Appcast Inc Pełny etat

    Job Description The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Appcast Inc Pełny etat

    Job Description The Senior Data Engineer will serve as a liaison between the Appcast core development team and downstream analysts on the Data and Insights team. The senior data engineer sets up the data engineering infrastructure, using the tools of your choice. From the architecture you establish, you will then code automated processes that extract...

  • Senior Data Engineer

    1 tydzień temu

    Warsaw, Polska VGW Pełny etat

    Senior Data Engineer VGW is an interactive entertainment company, harnessing technology and creativity to deliver world-class, free-to-play games.   We have an exciting opportunity to join our Engineering team in Poland, and we are currently looking for a Senior Data Engineer to join the team. As a Senior Data Engineer in our Growth team, you will...

  • Senior Data Engineer

    1 miesiąc temu

    Warsaw, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Reckitt Pełny etat

    Senior Data Engineer City: Warszawa ​​​About Us We’re a diverse, global family of over 40,000 people united by one passionate purpose: a cleaner, healthier world for all. We are Reckitt. Home to the world's best loved and trusted hygiene, health and nutrition brands. Our IT&D Digital transformation is well under way, and we need innovators and...

  • Senior Data Engineer

    19 minut temu

    Warsaw, Polska AI Clearing Pełny etat

    At AI Clearing, we disrupt the construction industry with AI! We are a Warsaw-based SaaS startup that applies deep learning models to crunch drone-based data and project designs to deliver the new quality of construction site analytics. Our platform is universally acclaimed by the biggest players in the industry and we already monitor dozens of construction...

  • Senior Data Engineer

    4 dni temu

    Warsaw, Polska LITE E-COMMERCE sp. z o.o. Pełny etat

    technologies-expected : Python SQL technologies-optional : PubSub Kafka Terraform Docker Kubernetes about-project : We are currently looking for a Senior Data Engineer, who will become Lite’s hero or heroine in the mission of technological development of the world! responsibilities : designing and building a platform for ETL/ELT; designing of ELT/ETL...

  • Senior Data Engineer

    2 miesięcy temu

    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Senior Data Engineer

    2 miesięcy temu

    Warsaw, Polska Digital Turbine Pełny etat

    Senior Data Engineer Warsaw, PolandEMEA – Tech - Data /Full-time /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Digital Turbine Pełny etat

    Senior Data Engineer Warsaw, PolandEMEA – Tech - Data /Full-time /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences...

  • Senior Data Engineer

    1 miesiąc temu

    Warsaw, Polska Vratislavia Software Pełny etat

    Vratislavia Software is looking for: Senior Data Engineer Our client is a leader in software, automotive, software development, cybersecurity and ALM solutions. As part of the cooperation, you will have the opportunity to take part in an international project for the medical industry. Your responsibilities: The data engineers are responsible for the data...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Ecovadis Pełny etat

    Description We are looking for a Senior Data Engineer to join our growing data platform team. We need a skilled engineer who will help us develop and maintain data architectures and processing solutions that power our data scientists, BI analytics and many other internal data consumers. One major role of the team is to prepare and maintain self-serve...

  • Senior Data Engineer

    1 miesiąc temu

    Warsaw, Polska Ecovadis Pełny etat

    Description We are looking for a Senior Data Engineer to join our growing data platform team. We need a skilled engineer who will help us develop and maintain data architectures and processing solutions that power our data scientists, BI analytics and many other internal data consumers. One major role of the team is to prepare and maintain self-serve...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Ecovadis Pełny etat

    Description We are looking for a Senior Data Engineer to join our growing data platform team. We need a skilled engineer who will help us develop and maintain data architectures and processing solutions that power our data scientists, BI analytics and many other internal data consumers. One major role of the team is to prepare and maintain self-serve...

  • Senior Data Engineer

    2 tygodni temu

    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Data Engineer

    2 tygodni temu

    Warsaw, Polska Digital Turbine Pełny etat

    Data Engineer Warsaw, PolandEMEA – AGP Tech /Regular /HybridAt Digital Turbine , we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences that...

  • Senior Data Engineer

    4 dni temu

    Warsaw, Polska Displate Pełny etat

    Imagine a group of fascinating people… who spend time at work creating the product they absolutely love. Imagine empowered tech freaks for whom the team equals comrades. Imagine tremendous professionals and geeks who like, support, and respect each other. See yourself in that picture? Well, hello there! We’re Displate, the XXI-century metal posters...

  • Senior Data Engineer

    4 tygodni temu

    Warsaw, Polska Alter Solutions Pełny etat

    Job DescriptionThe position of a Senior Data Engineer offers an opportunity to work with a team of senior developers who focus on regulatory reporting. The team deals in the first place with development but also with maintenance and support of Data Warehousing/ ETL solutions.QualificationsMinimum 4 years (senior) of experience working with ETL, data...