Middle Big Data Engineer

4 tygodni temu

Warsaw, Polska KITRUM Pełny etat

Middle Big Data Engineer Miejsce pracy: Warszawa Technologies we use Expected Spark
SQL
Python
Optional Kafka
Terraform
Airflow
Jira
JetBrains IDEs
Git
GitLab
Docker
Jenkins
About the project Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform.
The platform allows:
— anyone to share his/her ideas with the world;
— access to audio books;
— access to world’s composers who publish their music;
— incorporates articles from private publishers and world magazines;
— allows access to exclusive content.

Core Platform provides robust and foundational software, increasing operational excellence to scale apps and data. We are focused on building, testing, deploying apps and infrastructure which will help other teams rapidly scale, inter-operate, integrate with real-time data, and incorporate machine learning into their products. Working with our customers in the Data Science and Content Engineering, and our peers in Internal Tools and Infrastructure teams we bring systems-level visibility and focus to our projects.

Client’s goal is not total architectural or design perfection, but rather choosing the right trade-offs to strike a balance between speed, quality and cost.
Your responsibilities Manage data quality and integrity
Assist with building tools and technology to ensure that downstream customers can have faith in the data they’re consuming
Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines
Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets
Our requirements 3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets.
Proficiency in Spark
Expertise in Scala, and/or Python
Fluency with at least one dialect of SQL
Level of English: Upper-Intermediate
Optional Experience with Streaming platforms, typically based around Kafka
Experience in Terraform, Airflow
Strong grasp of AWS data platform services and their strengths/weaknesses
Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins
Experience using DataBricks
This is how we organize our work This is how we work at the client's site
you have influence on the choice of tools and technologies
you have influence on the technological solutions applied
you have influence on the product
agile
Development opportunities we offer development budget
external training
What we offer High compensation according to your technical skills
Long-term projects (12m+) with great Customers
5-day working week, 8-hour working day, flexible schedule
Democratic management style & friendly environment
WFH mode
Annual Paid vacation — 30 b/days + unpaid vacation
Paid sick leaves — 6 b/days per year
Corporate Perks (external training, English course, business speaking club, corporate events/team buildings)
Professional and personal growth
Recruitment stages Recruitment interview
Technical interview
Client interview
KITRUM KitRUM is a one-stop custom software development company headquartered in sunny Florida with tech hubs in Ukraine, Poland, Kazakhstan, and Mexico
With a pool of 300+ top-notch engineering resources, we help CxOs of VC-backed startups and fast-growing tech companies in the US, EU, and Australia to custom-build software engineering teams packed with top-tier talent.

  • Middle Big Data Engineer

    2 tygodni temu

    Warsaw, Polska KITRUM Pełny etat

    Middle Big Data Engineer Miejsce pracy: Warszawa Technologies we use Expected SparkSQLPythonOptional KafkaTerraformAirflowJiraJetBrains IDEsGitGitLabDockerJenkinsAbout the project Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform.The platform...

  • Senior Big Data Engineer

    2 miesięcy temu

    Warsaw, Polska Grid Dynamics Poland Pełny etat

    technologies-expected : Scala Java Apache Hadoop Apache Spark Kubernetes SQL MySQL PostgreSQL MongoDB Cassandra about-project : We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic thinking, collaboration, and...

  • Senior Big Data Engineer

    4 tygodni temu

    Warsaw, Polska Grid Dynamics Poland Pełny etat

    Expected, Scala, Java, Apache Hadoop, Apache Spark, Kubernetes, SQL, MySQL, PostgreSQL, MongoDB, Cassandra Operating system, Windows About the project, We are looking for experienced Big Data Engineer specializing in Scala, Hadoop, and Spark within a large enterprise digital product company. The role involves a mix of technical proficiency, strategic...

  • Senior Big Data Engineer

    3 miesięcy temu

    Warsaw, Polska Daxx Pełny etat

    Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...

  • Senior Big Data Engineer

    4 tygodni temu

    Warsaw, Polska Daxx Pełny etat

    Our client is the largest credit card processor in the world. It invented electronic payment-clearing credit card transactions It processes 65000 credit card transactions every second of every day. It is a digital product company with very large data and analytics functions with large product and engineering teams behind them. As the world’s leader in...

  • Specjalista Big Data

    2 miesięcy temu

    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Specjalista Big Data

    4 tygodni temu

    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Specjalista Big Data

    2 tygodni temu

    Warsaw, Polska Algoteque Pełny etat

    ALGOTEQUE is an IT consultancy firm that helps startups, mid-sized and large corporations to create and deliver innovative technologies.Our team has a successful track record in designing, developing, implementing, and integrating software solutions (AI, ML, BI, Web, Automation) for Telecom, Energy, Bank, Insurance, Pharma, Automotive, Industry, e-commerce....

  • Big Data Engineer

    3 dni temu

    Warsaw, Polska Integer Group Services Sp. z o.o Pełny etat

    Big Data Engineer Miejsce pracy: Warszawa Your responsibilities Building a platform for processing large amounts of data Building streaming solutions Construction and maintenance of data lake solutions, NoSQL databases Building CI/CD solutions, test automation CI/CD solutions, test automation Designing and maintaining ETL/ELT Applying good practices, code...

  • Big Data Engineer @ Orange Polska

    4 tygodni temu

    Warsaw, Polska Orange Polska Pełny etat

    As a Big Data Engineer at Orange you will use your expertise in the field of Data solutions and data pipeline development to enable the processing of a significant volume of data for various stakeholders (including Data Visualization, Data Scientists, and Data Analysts) in the GSP (Global Support for Performance which is the GBS Finance of the Orange Group)....

  • Senior Data Engineer to work with Big Data

    4 dni temu

    Warsaw, Polska Nordea Bank Pełny etat

    Job ID: 25161  #IT #Developer #Data #Engineering Would you like to work with Big Data? We are now looking for a Senior Data Engineer to develop, maintain, test and evaluate Big Data solutions within Nordea’s next generation Big Data Platform. In Nordea, we’re harnessing the power of technology to reinvent the future of banking. A tech...

  • Site Reliability Engineer

    4 tygodni temu

    Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etat

    technologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...

  • Site Reliability Engineer

    4 tygodni temu

    Warsaw, Polska WIPRO IT SERVICES POLAND Sp. z o.o. Pełny etat

    technologies-expected : Hadoop Kafka Python Kubernetes Linux Docker responsibilities : Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Kafka, Spark, and HBASE. Develop software systems and automated solutions for operational aspects in an organization. Code efficiently based on the requirements and verify, deploy software...

  • Middle Big Data Engineer

    4 tygodni temu

    Warsaw, Polska KITRUM Pełny etat

    technologies-expected : Spark SQL Python technologies-optional : Kafka Terraform Airflow Jira JetBrains IDEs Git GitLab Docker Jenkins about-project : Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform. The platform allows: — anyone to share...

  • Middle Big Data Engineer

    4 dni temu

    Warsaw, Polska KITRUM Pełny etat

    technologies-expected : Spark SQL Python technologies-optional : Kafka Terraform Airflow Jira JetBrains IDEs Git GitLab Docker Jenkins about-project : Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform. The platform allows: — anyone to share...

  • Middle Big Data Engineer

    2 tygodni temu

    Warsaw, Polska KITRUM Pełny etat

    technologies-expected :SparkSQLPythontechnologies-optional :KafkaTerraformAirflowJiraJetBrains IDEsGitGitLabDockerJenkinsabout-project :Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform.The platform allows:— anyone to share his/her ideas with...

  • Middle Big Data Engineer

    2 tygodni temu

    Warsaw, Polska KITRUM Pełny etat

    Expected, Spark, SQL, PythonOptional, Kafka, Terraform, Airflow, Jira, JetBrains IDEs, Git, GitLab, Docker, JenkinsAbout the project, Client is an American e-book and audiobook subscription service that includes one million titles. Platform hosts 60 million documents on its open publishing platform., The platform allows:, — anyone to share his/her ideas...

  • Mid Big Data Engineer @ Capco Poland

    3 dni temu

    Warsaw, Polska Capco Poland Pełny etat

    WHY JOIN CAPCO? Employment contract and/or Business to Business - whichever you prefer Possibility to work remotely Speaking English on daily basis, mainly in contact with foreign stakeholders and peers Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance) Access to 3.000+ Business Courses Platform (Udemy) Access to...

  • Data Engineer

    3 miesięcy temu

    Warsaw, Polska Webellian Sp. z o.o. Pełny etat

    technologies-expected : Python SQL AWS about-project : We are looking for Middle / Senior Data Engineer, to work on a project for one of our key customers in the insurance industry. You will work in hybrid mode with your teammates based in Poland and other stakeholders located worldwide and you will be in direct contact with business users of the...

  • Data Engineer

    4 tygodni temu

    Warsaw, Polska Webellian Sp. z o.o. Pełny etat

    technologies-expected : Python SQL AWS about-project : We are looking for Middle / Senior Data Engineer, to work on a project for one of our key customers in the insurance industry. You will work in hybrid mode with your teammates based in Poland and other stakeholders located worldwide and you will be in direct contact with business users of the...