Performance guarantee for Big Data applications

Performance guarantee for Big Data applications

This asset is fully developed and integrated in the framework of the EUBra-BIGSEA project and it is based on the combination of three key components:

  1. EC3 which automates the deployment and the initial configuration of a Big Data application and provides also mechanisms for runtime re-configuration (developed by Universitat Politecnica de Valencia),
  2. A rule-based module for pro-active run-time policies specification and execution (developed by Federal University of Campina Grande),
  3. A module implementing optimization based policies able to identify the deployment configuration of minimum costs that provides also performance guarantees (e.g., jobs are executed within a time limit or data streams are executed with no loss at a given rate, developed by Politecnico di Milano and Federal University of Minas Gerais).

The three components are developed separately at the four Institutions (UPV, UFCG, Polimi and UFMG). EC3 is more mature and partially in production (basic case). The three components will be integrated during the second year of the project. The modules are being developed considering an OpenStack cloud environment and the usage of OpenStack Monasca as a monitoring tool.

Contact Person:

Current Users: 
Currently, these three components are used within academic environments and are developed and tested within lab deployments.

User Categories: 
Infra managers
Network managers
Chief Technology Officer (CTO)
Chief Financial Officer (CFO)

Community / market sectors: 
Academia & Research

Specific needs / Value Proposition: 
The sets of components and services provided will be able to consider more information about the application in order to enable a smarter initial configuration for periodic jobs and a fast reaction time for the case of disturbances during the execution.

The open source license scheme is still under definition. Most of the components will rely on Apache 2.0, unless the dependencies to other libraries introduced in the implementation are not compatible with Apache 2.0.
Owner (incl. Joint ownership): 
UPV, UFCG, Polimi and UFMG

Owner type: Academia/Research

Delivery Model: 
Open source

EU EUBrasilCloudFORUM is funded by the European Commission under the Cooperation Programme, Horizon 2020 grant agreement No 689495. Este projeto é resultante da 3a Chamada Coordenada BR-UE em Tecnologias da Informação e Comunicação (TIC), anunciada pelo Ministério da Ciência, Tecnologia e Inovação (MCTI), no âmbito to acordo de subvenção Número 689495. Privacy Policy | Disclaimer Terms of use