Business Case: Big Data-Plattform for the e-Commerce-Business

The project was carried out for one of the top-selling German mail order companies, whose website is the most important distribution channel. In addition to clothing and accessories, the product range includes house and home textiles and small furniture. Its online shop offers 30,000 articles and reaches over 30 million customers, 9.5 million of whom are in Germany alone. The amount of data to be processed is correspondingly gigantic.

The trading company therefore decided to use the promising future technology Hadoop as a central platform for data processing and analysis. Hadoop is a free framework which, thanks to its interfaces and scalability, can be used flexibly, efficiently and cost-effectively, especially with polystructured mass data. Within the framework of an ambitious Big Data project, Hadoop specialist KYBEIDOS and the computer centre BOREUS cooperated for the first time. This first successful cooperation resulted in a strategic partnership with groundbreaking perspectives for secure cloud computing, Big Data management, IOT and Industrie 4.0.

BOREUS provided the company with the necessary hardware and software components and the appropriate network architecture. On this overall architecture KYBEIDOS installed and configured the targeted Enterprise Hadoop environment. By using automation tools (e.g. SaltStack) these installations and configurations were carried out fully automatically. The decisive factors were status monitoring, the detection of failures as well as error analysis and correction.

Data engineers and data scientists from KYBEIDOS then implemented various Big Data Use Cases for parallel data processing, machine learning and deep learning and supported their productive and operational deployment. Four months after the start of the project, KYBEIDOS and BOREUS had successfully fulfilled all requirements. The innovative Big Data solution is designed for flexible adaptations and, thanks to the open source technology used, can be technically adapted to changed conditions and requirements at any time.