Principal Data Engineer

4 tygodni temu

Gdansk, Polska HAYS Pełny etat
Principal Data Engineer
Gdansk
NR REF.: 1185178

The Principal Data Engineer / Technical Lead will help design and ensure adherence to the design of multiple global digital products being developed. This role will work on a range of hardware and software products critical to company’s continued business growth. As a Technical Value Stream Lead, you will be the technical and functional leader of one or more scrum teams responsible for solving complex business and technology issues, from strategy to execution.

Key Responsibilities:
  • Data Warehouse ownership, maintenance, support, and optimizations in a large multi-tenant architecture using AWS Redshift and other AWS Data Pipeline & Ingestion services
  • Data Modeling, ETL and/or ELT for complex large IoT, Operational Behavioral, and Meta Data
  • Own Data Warehouse security issue resolution, monitoring, workload management, query optimization, HA/DR for the RedShift clusters
  • Data Warehouse: Automation, Monitoring, Data Governance & Compliance, Scalability, and Cost Management
  • Supports all phases of product Analytics & Insights Value Stream projects from conception and architecture through execution and support for full development lifecycles in collaboration with multifunctional leaders, stakeholders, contributors, and customers
  • Drives development principles, best practices, quality standards, and activities within engineering production to minimize/mitigate risks, issues, and defects of platform service offerings, such that teams may appropriately characterize, manage, and remediate
  • Aligns with Product and other key stakeholders to help scope projects, define requirements, perform gap analysis, refine functional requirements, and manage engineering team’s technical execution and commitments using Agile/Scrum best practices
  • Conceptualizes solutions and generates secure design requirements, for related feature and function development, implement required modules and solutions, and fosters new product development and innovation
  • Provides technical & thought leadership, mentorship, and training
  • Provides timely and expert support to resolve difficult problems and issues
  • Works closely with technical writers to create documentation for developers, consumers and customers
  • Communicates with other TVSLs to design solutions aligned with the overall goal
Key Requirements:
  • 6-10+ years of hands-on, enterprise level, professional software development experience
  • 4+ years of hands-on cloud system design and architecture development and delivery experience
  • 5+ years of system design and architecture experience
  • 3+ years of engineering/development team leadership experience (Team Lead, Eng. Mgr, or similar)
  • 2+ years of distributed engineering team leadership experience
  • Travel for quarterly team alignment and planning
  • Conduct architecture reviews, cybersecurity reviews, code reviews, and provide technical feedback and guidance
  • A complete understanding of hardware/embedded/middleware/software development life cycle, from customer needs to product release, is essential. Hands-on experience with development tools & dev-ops is required.
  • Expertise and domain knowledge in developing, maintaining reusable software services, infrastructure for promoting reuse of services/ components/ libraries.
  • Deep understanding of standard practices of opensource software development tools and methodology is absolute.
     Demonstrated ability and hands-on experience in developing modern, cloud-native, IaC software technologies to deliver industrial, enterprise-grade platform products and services is necessary.
  • Expertise in developing and deploying solutions in a serverless AWS (Amazon Web Services) environment. Proficiency with other cloud development a plus.
  • Ability to analyze software services for reuse potential.


Preferred Qualifications:
  • Deep knowledge of cloud architecture, cloud native patterns, and cloud computing capabilities
  • especially as offered by AWS, specifically Timestream, Glue, Apache Spark, DataBricks, and
  • DynamoDB
  • Dashboard development and report development experience with big data, ideally with
  • Sisense (or a similar dashboard/reporting soluition)
  • Implementation experience with AWS Redshift, Graph data stores, Event-Driven Architecture,
  • IoT project experience on a revenue generating project
  • Experience with deployment orchestration, automation, and security configuration
  • management (CircleCI, Jenkins, Puppet, Chef, Ansible, etc.)
  • Strong skills and experience in Analytics Cloud migration and implementation, AWS services
  • related to analytics, AI/ML, CI/CD
  • Experience in EMR, Hadoop, HIVE, S3, etc.
  • Experience in managing and optimization Big Data / Hadoop clusters
  • Experience in designing and implementation of automated backup and restoration of
  • application/web servers/databases/data lakes
  • Experience with container technologies (AWS – ECS/EKS/Fargate, Kubernetes, etc) as well
  • as AWS serverless technologies and architecture patterns Experience in using AWS Key management systems (KMS)

Benefits:
  • Employee Scholar Program – we cover 100% costs for your study,
  • Inhouse English lessons,
  • Pension Plan with life insurance – 3% of your yearly salary,
  • Lunch Card – 296 PLN monthly,
  • Luxmed Private Medical Care,
  • Multisport Card,
  • Flexible working hours,
  • Working with highly modern products

Your next step?
If you are interested 

Hays Poland sp. z o.o. is an employment agency registered in the register kept by the Marshal of the Mazowieckie Voivodeship under number 361.

  • Principal Software Engineer

    1 miesiąc temu

    Gdansk, Polska NTIATIVE sp. z o.o. Pełny etat

    Principal Software Engineer Miejsce pracy: Gdańsk Technologies we use Expected .NET .NET Core C# About the project We work with company, who is the world’s most comprehensive sources for petroleum pricing and news information. They provide real-time and historical spot, wholesale/rack and retail fuel prices for the refined products, renewable fuels...

  • Principal Software Engineer

    5 dni temu

    Gdansk, Polska NTIATIVE sp. z o.o. Pełny etat

    Principal Software Engineer Miejsce pracy: Gdańsk Technologies we use Expected .NET .NET Core C# About the project We work with company, who is the world’s most comprehensive sources for petroleum pricing and news information. They provide real-time and historical spot, wholesale/rack and retail fuel prices for the refined products, renewable fuels...

  • Principal Software Engineer

    2 tygodni temu

    Gdansk, Polska NTIATIVE sp. z o.o. Pełny etat

    Principal Software Engineer Miejsce pracy: Gdańsk Technologies we use Expected .NET.NET CoreC#About the project We work with company, who is the world's most comprehensive sources for petroleum pricing and news information. They provide real-time and historical spot, wholesale/rack and retail fuel prices for the refined products, renewable fuels and natural...

  • Data Engineer

    2 tygodni temu

    Gdansk, Polska MindPal Pełny etat

    Data Engineer (Snowflake)Miejsce pracy: Gdańsk Technologies we use Expected SQLPythonAbout the project We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals,...

  • Data Engineer

    2 tygodni temu

    Gdansk, Polska MindPal Pełny etat

    technologies-expected :SQLPythonabout-project :We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Data Engineer

    2 dni temu

    Gdansk, Polska MindPal Pełny etat

    Data Engineer (Snowflake) Miejsce pracy: Gdańsk Technologies we use Expected SQL Python About the project We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals,...

  • Data Engineer

    3 dni temu

    Gdansk, Polska MindPal Pełny etat

    technologies-expected : Python SQL AWS about-project : We are looking for a Data Engineer to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Data Engineer

    1 miesiąc temu

    Gdansk, Polska MindPal Pełny etat

    technologies-expected : SQL Python about-project : We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Senior Data Engineer

    4 tygodni temu

    Gdansk, Polska Ework Group Pełny etat

    We are seeking a skilled and experienced Data Engineer to join our client (pharmaceutical area) team. The ideal candidate will have a strong background in data architecture, data modeling, data warehousing and ETL processes. The Data Engineer will be responsible for designing, building, and maintaining the data infrastructure that supports our organization's...

  • Data Engineer

    4 tygodni temu

    Gdansk, Polska Commerzbank AG Pełny etat

    technologies-expected : SQL Git Google Cloud Platform about-project : In your role as a Data Engineer you will be working in the Data as a Service (DaaS) cell which builds products and services designed to provide barrier free, easy to use information and test data for the whole bank. This includes data anonymization services, user interfaces and a...

  • Big Data Engineer

    4 tygodni temu

    Gdansk, Polska Inter Cars S.A. Pełny etat

    As a Senior Data Engineer at Inter Cars S.A., you will play a crucial role in shaping our data infrastructure, ensuring data quality, and enabling data-driven decision-making across the organization. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to deliver high-quality, reliable, and scalable...

  • Senior Data Engineer

    2 dni temu

    Gdansk, Polska Arla Global Shared Services Sp. z o.o. Pełny etat

    technologies-expected : SQL Python R Azure no-SQL Databricks Scala Azure DevOps about-project : Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? Join our...

  • Data Engineer (Data Competency Center)

    4 tygodni temu

    Gdansk, Polska Sigma Software Pełny etat

    Seeking a skilled Data Engineer to lead at Sigma Software's Data Competency Center, passionate about advancing expertise in data processing. Join us at Sigma Software to be at the forefront of the most interesting projects and play a pivotal role in the growth and success of our initiatives and Competence Center. CUSTOMER We are looking for a Data Engineer...

  • Data Platform Engineer/Consultant @ Elitmind

    1 miesiąc temu

    Gdansk, Polska Elitmind Pełny etat

    We’ve been honored as Microsoft Partner of the year 2023 in Poland and following that achievement we are focusing on growth and development, that’s why we are recruiting intensively. At the moment, we are looking for a  Data Platform Engineer to join our existing Team at Elitmind . In this role you will take part in innovative projects to...

  • Data Platform Engineer/Consultant @ Elitmind

    4 tygodni temu

    Gdansk, Polska Elitmind Pełny etat

    We’ve been honored as Microsoft Partner of the year 2023 in Poland and following that achievement we are focusing on growth and development, that’s why we are recruiting intensively. At the moment, we are looking for a  Data Platform Engineer to join our existing Team at Elitmind . In this role you will take part in innovative projects to...

  • Senior Data Engineer

    5 dni temu

    Gdansk, Polska Arla Pełny etat

    Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing? About the job Join our commercial IT organization, which is an area that benefits from an increased focus and...

  • Software Engineer, Java

    5 dni temu

    Gdansk, Polska Acoustic Pełny etat

    technologies-expected : Java about-project : Acoustic is the largest independent marketing cloud, and we're growing fast. We're seeking talented back-end developers to join our Gdansk team. We operate in eight independent squads, each dedicated to different facets of Acoustic products. Our squads include QA engineers, front-end and back-end engineers,...

  • Senior Big Data Engineer

    2 tygodni temu

    Gdansk, Polska Grid Dynamics Poland Pełny etat

    Expected, Scala, Java, Apache Hadoop, Apache Spark, Kubernetes, SQL, MySQL, PostgreSQL, MongoDB, CassandraOperating system, WindowsAbout the project, We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking,...

  • Data Engineer

    3 dni temu

    Gdansk, Polska Transition Technologies MS Pełny etat

    We offer: Participation in interesting and challenging projects Flexible working hours A great, non-corporate atmosphere Stable employment conditions (contract of employment or B2B contract) Opportunities for development and promotion Attractive package of benefits Remote work Your tasks: The responsibilities of this person will include development of...

  • Senior Data Engineer

    4 tygodni temu

    Gdansk, Polska Arla Foods Pełny etat

    Do you want to work in an amazing team that supports and develops our Data Foundation platform in Commercial space ? Are you motivated to join a role where you get to tie data and technologies together with our key platforms for sales and marketing?   About the job Join our commercial IT organization, which is an area that benefits from an...