Sr. Data Engineer

1 tydzień temu


Katowice, Silesia, Polska IVANS Insurance Solutions Pełny etat
Job Description

Job Title: Sr. Data Engineer

Position: 1

Experience: 5+ Years

Location: Bangalore, India

About Us: Our mission is to leverage data to drive transformative solutions and create impactful experiences for our customers. Join us and be a part of a dynamic team that is dedicated to pushing the boundaries of what's possible with data.

Role Overview: We are seeking an experienced Sr. Data Engineer with 5+ years of hands-on experience to join our talented team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, optimizing data processes, and ensuring the seamless integration of data from various sources. If you are passionate about data and excited to work on cutting-edge technologies, we want to hear from you

Key Responsibilities:

  1. Design, develop, and maintain robust and scalable data pipelines to support business needs.
  2. Code BigQuery procedures, functions, and other database objects by applying expert knowledge in BigQuery SQL.
  3. Optimize ETL processes and data workflows to ensure efficiency, performance, and high scalability.
  4. Implement and manage data integration solutions using tools like DBT, Apache Airflow, Fivetran, Python, Celigo.
  5. Design an ETL framework that leverages reusable components and automated data quality checks.
  6. Develop and implement features and enhancements in BigQuery, leveraging your expertise in SQL and cloud-based data warehousing technologies.
  7. Ensure data quality and consistency through rigorous testing and validation processes.
  8. Troubleshoot and resolve data-related issues promptly.
  9. Stay updated with industry trends and technologies to continuously improve our data engineering practices.

What We're Looking For:

  1. 5+ years of experience in Data / ETL Engineering, as well as Data / ETL Architecture and pipeline development.
  2. Proficiency in SQL, DBT, Python (Apache Airflow, Composer) and hands-on experience with ETL tools like Talend, Fivetran or similar.
  3. Proven experience in building and maintaining a scalable Data Warehouse in a cloud-based data platform, preferably in Google's BigQuery.
  4. Experience in Git for version control and DBT for data transformation.
  5. Proven experience in designing, building and maintaining ETL processes, automated data quality checks and reusable ETL components.
  6. Knowledge of Data Lake and Data Warehousing concepts and Data Modelling techniques.
  7. Strong problem-solving skills and the ability to work independently as well as collaboratively.
  8. Excellent communication skills and the ability to articulate technical concepts to non-technical stakeholders.
  9. Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience.

More context about the role and the team:

Here at Applied we have embarked on the journey of elevating our Corporate Data Services function. This function's mandate will encompass 3 key areas – Data Governance and Architecture, Data Engineering, Reporting and Analytics and later Machine Learning. This role will report into the Manager of Data Engineering and will play a key role in building Applied's Data Lakehouse from the ground up. This is an exciting opportunity for a motivated, high-performing individual who is eager to play a key role and influence the way we design and build a flexible, scalable data foundation.

We are looking for an individual who has solid, hands-on ETL and data integration experience. Someone who's able to leverage metadata to automate data integrations, who prioritizes automation and proactive job monitoring and alerting. We are looking for someone who's very familiar with data warehousing concepts and data quality reporting. Someone who can design and build reusable code components to enable efficiency and scalability.

#J-18808-Ljbffr

  • Katowice, Silesia, Polska Cadence Design Systems Pełny etat

    Sr Principal Design Engineer page is loadedSr Principal Design EngineerApply locations KATOWICE time type Full time posted on Posted 6 Days Ago job requisition id R49363At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.The Cadence Silicon Solutions Group (SSG) develop leading edge Silicon Solutions...


  • Katowice, Silesia, Polska HireRight Pełny etat

    About HireRightHireRight is the premier global background screening and workforce solutions provider. We bring clarity and confidence to vetting and hiring decisions through integrated, tailored solutions, driving a higher standard of accuracy in everything we do. Combining in-house talent, personalized services, and proprietary technology, we ensure the...

  • Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska TN Poland Pełny etat

    Social network you want to login/join with:Data Engineer - Automotive Sector, KatowiceClient:Groupe SIILocation:KatowiceJob Category:OtherEU Work Permit Required:YesJob Reference:5099fdb29f8aJob Views:19Posted:23.01.2025Expiry Date:09.03.2025Job Description:We are looking for a Data Engineer for one of our projects in the automotive industry. This person...

  • Data Engineer

    5 dni temu


    Katowice, Silesia, Polska Klient Just Join IT Pełny etat

    About the team & projectWe're looking for a Data Engineer to join a newly formed team focused on building and maintaining data solutions that support financial and operational reporting. The work is fully in-house – we're not delivering for an external client – and directly supports key business areas.The role requires high attention to detail and a...

  • Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Outokumpu Chrome Oy Pełny etat

    Select how often (in days) to receive an alert for your keyword search:Unlock the Power of Data – Join Outokumpu as a Data EngineerAre you passionate about leveraging data to drive innovation? At Outokumpu, we are looking for a skilled Data Engineer to play a crucial role in shaping our data solutions and supporting business growth. Join a company that...

  • Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Outokumpu Chrome Oy Pełny etat

    Unlock the Power of Data – Join Outokumpu as a Data EngineerAre you passionate about leveraging data to drive innovation? At Outokumpu, we are looking for a skilled Data Engineer to play a crucial role in shaping our data solutions and supporting business growth. Join a company that pioneers sustainability and technology while offering exciting career...

  • Data Engineer

    3 tygodni temu


    Katowice, Silesia, Polska Devire Pełny etat

    Devire IT Outsourcing is a form of cooperation dedicated to IT professionals, based on the principles of own business - B2B, implementing projects for clients running innovative and modern projects.   Our client is a global financial institution with an innovative and agile work environment. Operating in small, autonomous squads, they follow Agile...


  • Katowice, Silesia, Polska Devire Pełny etat

    **Overview:**At Devire, we are seeking an experienced Data Analytics Engineer to join our team. In this role, you will be responsible for designing and implementing data analytics solutions that drive business insights and inform decision-making.Key Responsibilities:Design and develop data models and architectures to support business intelligence...

  • Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska Vattenfall GmbH Pełny etat

    Job DescriptionWould you like to make a difference and work together with us on our big target? Do you want to play a significant role in supporting the Asset Driven Business Areas within Vattenfall in accelerating the digital transformation? You are convinced that the information assets generated by our physical assets, i.e. the big data coming from our...


  • Katowice, Silesia, Polska TN Poland Pełny etat

    Job DescriptionWe are seeking a highly skilled Data Integration Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building data integration solutions using tools like Mulesoft, Informatica, Snaplogic, Apigee, etc.You will work with API-driven enterprise architectures, supporting the...


  • Katowice, Silesia, Polska TN Poland Pełny etat

    About the RoleWe are seeking a highly skilled Data Analytics Engineer to join our team at SD Worx. As a Lead BI Developer, you will play a critical role in building and scaling our B2B analytics product.Key Responsibilities:Design and implement scalable, high-performance BI solutions using Power BI, Snowflake, and Azure data-related services.Collaborate...


  • Katowice, Silesia, Polska Klient Just Join IT Pełny etat

    About UsKlient Just Join IT is a dynamic and innovative organization dedicated to delivering cutting-edge data solutions.We are seeking a highly skilled Data Engineer Transformation Specialist to join our team and contribute to the development of our data infrastructure.Key ResponsibilitiesCollaborate with business stakeholders to understand data...

  • Senior Data Engineer

    1 tydzień temu


    Katowice, Silesia, Polska ING Pełny etat

    We are looking for you, if you:have hands-on experience building complex data pipelines,have experience with Apache Airflow, Spark, Python,have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),have experience with deployment and provisioning automation tools...

  • Cloud Data Engineer

    4 dni temu


    Katowice, Silesia, Polska DataRiseLab Pełny etat

    DataRiseLab is a cutting-edge IT Company providing comprehensive support in data management solutions, including data warehouses, integration, BI reporting, and Big Data. As a Microsoft Partner in the area of Data & AI Azure, we have deep expertise in cloud tools and technologies.We are seeking an experienced Senior Data Engineer to join our team. The...

  • Data Engineer

    7 dni temu


    Katowice, Silesia, Polska ING Pełny etat

    Tech stack/ knowledge:Mandatory:Proficient in relational databases and SQL.Proven big data experience, either from an implementation or a data science perspective.Strong coding experience in the likes of Java, Scala or Python.Experience with GCP tech stack (BigQuery, Dataflow, Cloud Composer, Google Cloud Storage) or other public cloud providers equivalents...

  • Data Engineer

    21 godzin temu


    Katowice, Silesia, Polska Capgemini Engineering Pełny etat

    Job OverviewCapgemini Engineering is seeking a highly skilled Data Engineer - PostgreSQL to join our team for a large bank payment solutions client. This role involves working closely with the Solution Architect, DBAs, and Lead Engineer to create highly performant and resilient database designs.Key Responsibilities:Maintain and optimize PostgreSQL databases...

  • Data Engineer

    2 tygodni temu


    Katowice, Silesia, Polska DCV Technologies Pełny etat

    We are looking for Data Engineer on behalf of our client to join to the leader from the sector a client from the largest banking group.Contract: B2BWork mode: Hybrid from KatowiceWe are looking for you, if you:You have hands on experience with Oracle SQL and RDBMS (12c or higher),Oracle Data Integrator 12c (tool)You know Oracle Goldengate,You are...


  • Katowice, Silesia, Polska TN Poland Pełny etat

    Company OverviewTN Poland is a leading provider of data-driven solutions to the pharmaceutical industry.Job DescriptionWe are seeking a highly skilled Data Science Engineer to join our team working on projects for one of the largest pharmaceutical companies in the world. As a Data Science Engineer, you will work closely with AI Scientists and Data Analysts...


  • Katowice, Silesia, Polska Inghubspoland Pełny etat

    Join to apply for the Data Infrastructure Engineer (SRE) role at ING Hubs PolandBe among the first applicantsFamiliarity with SRE concepts and system/application monitoringKnowledge of infrastructure architecture and practicesGood understanding of databases including RDBMS and NoSQLExperience with monitoring and observability (ELK stack)Strength in...


  • Katowice, Silesia, Polska Shiji Poland Pełny etat

    The role of Senior Software Engineer at Shiji Poland is an exciting opportunity for a passionate developer to join our innovative team and contribute to the development of cutting-edge Business Intelligence solutions.About the JobWe are looking for a skilled Senior Software Engineer with expertise in C# and .NET technologies to design, maintain, and extend...