Data Engineer

2 dni temu

Poznan, Polska YEPP sp. z o.o. Pełny etat

technologies-expected :
Microsoft Azure
Google Cloud Platform
Rockset
SQL
MongoDB
Python
Microsoft Excel
Git

technologies-optional :
Torch/PyTorch
TensorFlow
MySQL
PostgreSQL
Redis
Snowflake Data Cloud
AWS

about-project :
We aim to develop a comprehensive Business Artificial Intelligence (BAI) platform tailored specifically for production companies. The architecture of this platform will be designed to encompass the following key components:
Integrations:
APIs of Various Systems: The platform will integrate with the APIs of various systems that businesses currently use, ensuring seamless data flow and interaction.
Data Warehouse: A centralized data warehouse will be established to aggregate and store data from different sources, enabling efficient data management and retrieval.
AI Agents:
SQL Agents for Analytics: These agents will be responsible for querying the data warehouse, performing complex analytics, and generating insights.
API Agents: These agents will interact with external APIs, facilitating both read and write operations to ensure real-time data synchronization and interaction.
Generative UI:
The AI will have the capability to generate the platform’s user interface dynamically. This feature is particularly useful for companies using systems without existing APIs, allowing them to transfer and streamline their operations into our platform seamlessly.]
Extensions:
Prediction Models and More: The platform will support various extensions such as predictive modeling to forecast trends, anomalies, and other critical metrics, enhancing decision-making processes.
Ultimately, our vision is to develop AI that operates on employees' machines within the company. This AI will observe their activities, gradually assist in optimizing tasks, and provide feedback to the board on where operational bottlenecks exist. This continuous improvement loop aims to enhance overall productivity and operational efficiency.
Our initial focus will be on production companies, ensuring the platform addresses the unique challenges and requirements of this sector.

responsibilities :
Develop, implement, and maintain procedures for data cleansing to ensure data accuracy and consistency.
Managing data ingestion aspects, batch and near-real-time, with multiple source types
Design, build, and maintain data warehouse solutions that meet business needs.
Develop and optimize ETL processes to efficiently load data into data warehouses.
Integrate data from various sources, including databases, APIs, and flat files.
Troubleshooting and bug fixing
Work closely with business analysts, data scientists, and other stakeholders to understand data requirements.
Collaborate with IT teams to ensure proper data infrastructure and architecture.
Stay updated with the latest trends and technologies in data engineering and data warehousing.
Utilize advanced tools and technologies such as SQL, Python, ETL tools, and cloud-based data warehousing solutions (e.g., AWS Redshift, Google BigQuery).
Develop automation scripts and tools to improve data processing efficiency.
Develop and maintain data pipelines to support continuous data flow between systems.

requirements-expected :
2+ years of experience in data engineering, data warehousing, or a similar role
Strong experience with data warehouse technologies like Azure Synapse Analytics, Amazon Redshift, Google BigQuery, Snowflake, or similar.
Proficiency with ETL
Proficiency in SQL and Python
Experience with real-time data processing technologies
Strong understanding of relational databases (e.g., MySQL, PostgreSQL, Oracle) and NoSQL databases (e.g., MongoDB).
Experience with cloud platforms such as AWS, Google Cloud Platform, or Microsoft Azure, including data storage and processing services.
Knowledge of data integration tools and practices, including APIs, data streaming, and data replication.

offered :
Young and Energetic Team: Join a dynamic and enthusiastic team that thrives on creativity and innovation. Our collective energy and passion drive us to challenge the status quo and make a significant impact.
Fast-Paced Learning: Engage in continuous learning and professional development. Working with cutting-edge technology and solving complex problems will rapidly enhance your skills and knowledge.
Mentorship and Collaboration: Benefit from close collaboration with experienced professionals and peers, fostering a culture of mentorship and collective growth.
Making a Difference: Contribute to groundbreaking projects that have the potential to revolutionize business operations. Your work will directly impact our clients, helping them optimize tasks and improve efficiency.
Ownership and Responsibility: Take on meaningful responsibilities from day one. Your contributions will be valued, and you’ll have the autonomy to drive projects forward and see your ideas come to life.
Cutting-Edge Technology: Work with the latest technologies in artificial intelligence, machine learning, and data analytics. Be at the forefront of technological advancements and contribute to the development of pioneering solutions.
Startup Culture: Experience the excitement and agility of a startup environment. Our small, ambitious team allows for quick decision-making and the ability to make a tangible impact.

  • Data Engineer

    1 tydzień temu

    Poznan, Polska MindPal Pełny etat

    Data Engineer Miejsce pracy: Poznań Technologies we use Expected Python SQL AWS About the project We are looking for a Data Engineer to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an...

  • Data Engineer

    4 tygodni temu

    Poznan, Polska MindPal Pełny etat

    technologies-expected : SQL Python about-project : We are looking for a Data Engineer (Snowflake) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with experienced professionals, participation in an exciting project requiring innovative...

  • Data Engineer

    1 miesiąc temu

    Poznan, Polska Pragmile Pełny etat

    Pragmile is running an innovative research & development project for a large Polish institution which should result in a unique solution to monitor media market. We're looking for an experienced engineer who could support us in the successful execution and delivery. Requirements: Strong understanding of data structures and algorithms Strong understanding of...

  • Data Engineer

    1 tydzień temu

    Poznan, Polska Ework Group Pełny etat

    For our client - a company from pharmaceutical area, we are looking for Data Engineer. What you will be doing You will be close to the heart of our client’s clinical operations where you will play a key role in shaping the future of clinical trials and patient care, by building scalable solutions in the cloud. Your key responsibilities include the...

  • Hyperscaler Engineer @ NTT DATA Business Solutions

    4 tygodni temu

    Poznan, Polska NTT DATA Business Solutions Pełny etat

    That is what makes the NTT DATA Business Solutions spirit special: Team-oriented corporate culture, collaboration as equals and steady knowledge transfer Sustainable career development in a growth-oriented technology environment with a business focus on SAP full service (financing certificates and trainings) Remote work possibilities Benefits f.e. private...

  • Data Engineer

    1 tydzień temu

    Poznan, Polska ITDS Pełny etat

    Become a pioneer in smart crop science development with us! Warsaw-based opportunity with possibility to work partly remote (only 2 x month visits in office) As a  Data Engineer,  you will work for our Client - a global enterprise using science and imagination to advance health and nutrition. You will be working on cutting-edge solutions in the area of...

  • Senior Data Engineer

    4 tygodni temu

    Poznan, Polska Rite NRG Pełny etat

    Dołącz do naszej ekipy  Rite NRG  jako  Senior Data Engineer  i stwórz z nami w Polsce centrum dostaw dla lidera branży iGaming. Będziesz miał możliwość rozwijania się w obszarze analizy danych i zarządzania danymi. Jakimi umiejętnościami możesz się pochwalić? Jesteś ekspertem w korzystaniu z narzędzi  AWS, Bardzo dobrze znasz...

  • Senior Data Engineer

    4 tygodni temu

    Poznan, Polska Shaped Thoughts Pełny etat

    We are looking for a Senior Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector. Who are we ? We are a remote-first boutique software house company formed by a group of seasoned software experts (the average experience in the team is 12 years). What connected all of us,...

  • Senior Data Engineer

    4 tygodni temu

    Poznan, Polska Opensignal Pełny etat

    Job title:  Senior Data Engineer (MS SQL) Department:  Engineering Reporting to:  Engineering Manager Location:  Poland Purpose of Role We’re looking for a Senior Data Engineer to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our...

  • Senior Data Engineer

    4 tygodni temu

    Poznan, Polska Amer Sports Pełny etat

    ❄️ Mid/Senior Data Engineer (Snowflake) ❄️ Hybrid /Remote work, Cracow You will be part of the Enterprise Data & Analytics team, building strong ties with our international teams in North America and Asia to ensure seamless database operations. Your role is crucial in safeguarding data integrity, optimizing processes, and supporting the diverse...

  • Senior Big Data Engineer

    1 tydzień temu

    Poznan, Polska Capgemini Polska Sp. z o.o. Pełny etat

    YOUR ROLE As a Senior Engineer, you will build distributed data processing solution and highly loaded database solutions for various businesses cases including reporting, product analytics, marketing optimization and financial reporting. Contribute as part of self-organized team of experienced data engineers working in a challenging, innovative environment...

  • Senior Data Engineer

    2 tygodni temu

    Poznan, Polska Datumo Pełny etat

    Datumo specializes in providing Big Data and Cloud consulting services to clients from all over the world, primarily in Western Europe, Poland and the USA. Core industries we support include e-commerce, telecommunications and life science. Our team consists of exceptional people whose commitment allows us to conduct highly demanding projects .Our team...

  • Data Engineer

    2 tygodni temu

    Poznan, Polska TIDK sp. z o.o. Pełny etat

    Wymagane, Microsoft Azure, Databricks, Microsoft Power BI, PythonMile widziane, SQL, DAX, PySparkSystem operacyjny, WindowsO projekcie, Projekty z zakresu BI dla największych firm w Polsce (branże: retail, e-commerce, farmacja, energetyka, produkcja przemysłowa, logistyka).Twój zakres obowiązków, zbieranie wymagań biznesowych klientów,, budowanie...

  • Data Engineer

    2 tygodni temu

    Poznan, Polska Talex S.A. Pełny etat

    Wymagane, PL/SQL, T-SQL, Microsoft Power BITwój zakres obowiązków, Projektowanie, tworzenie i optymalizacja modeli danych,, Tworzenie procesów zasilania i przetwarzania zbiorów danych z wykorzystaniem języka SQL oraz języków proceduralnych,, Tworzenie dashboardów i raportów,, Analiza źródeł danych,, Analiza wymagań funkcjonalnych i...

  • DevOps Engineer

    6 dni temu

    Poznan, Polska MindPal Pełny etat

    DevOps Engineer (GCP) Miejsce pracy: Poznań Technologies we use Expected Kubernetes Docker Terraform Jenkins About the project We are looking for a DevOps Engineer (GCP) to join the team at MindPal, working for our key client in the technology sector. We offer the opportunity to work with modern technologies and tools, close collaboration with...

  • Senior Data Engineer

    6 dni temu

    Poznan, Polska BCF Software Sp. z o.o. Pełny etat

    Project overview Our client is embarking on a significant transformation project aimed at replatforming our financial system. Two initiatives will run in parallel: one for all financial and second for all non-financial data. We are in the early stages of an ambitious project to consolidate data from various sources into a single Delta Lake data...

  • Data Engineer

    2 miesięcy temu

    Poznan, Polska Talex S.A. Pełny etat

    Wymagane, PL/SQL, T-SQL, Microsoft Power BI Twój zakres obowiązków, Projektowanie, tworzenie i optymalizacja modeli danych,, Tworzenie procesów zasilania i przetwarzania zbiorów danych z wykorzystaniem języka SQL oraz języków proceduralnych,, Tworzenie dashboardów i raportów,, Analiza źródeł danych,, Analiza wymagań funkcjonalnych i...

  • Data Engineer

    4 tygodni temu

    Poznan, Polska Talex S.A. Pełny etat

    Wymagane, PL/SQL, T-SQL, Microsoft Power BI Twój zakres obowiązków, Projektowanie, tworzenie i optymalizacja modeli danych,, Tworzenie procesów zasilania i przetwarzania zbiorów danych z wykorzystaniem języka SQL oraz języków proceduralnych,, Tworzenie dashboardów i raportów,, Analiza źródeł danych,, Analiza wymagań funkcjonalnych i...

  • Staff DevOps Engineer with Azure

    1 tydzień temu

    Poznan, Polska Egnyte Poland Pełny etat

    Staff DevOps Engineer A BOUT EGNYTE Egnyte is the secure multi-cloud platform for content security and governance that enables organizations to better protect and collaborate on their most valuable content. Established in 2008, Egnyte has democratized cloud content security for more than 22,000 organizations, helping customers improve data security,...

  • Staff DevOps Engineer with Azure

    1 tydzień temu

    Poznan, Polska Egnyte Poland Pełny etat

    Staff DevOps Engineer A BOUT EGNYTE Egnyte is the secure multi-cloud platform for content security and governance that enables organizations to better protect and collaborate on their most valuable content. Established in 2008, Egnyte has democratized cloud content security for more than 22,000 organizations, helping customers improve data security,...