In large scientific organizations, the laboratory experiments produce a huge amount of data and their processing and storage management are a challenging issue. Cloud architectures are exploited here and there for storage solutions and data sharing as well, in order to realize a collaborative world wide distributed platform. Large experimental facilities manage by themselves Information and Communications Technology (ICT) resources such as compute, networking and storage, while small experimental laboratories are demanding more and more departmental ICT resources for their own scientific instruments aided by data acquisition and control systems, specially in terms of storage and sharing/publishing data solutions. ENEA Staging Storage Sharing (E3S) system has been developed over the ENEA ICT infrastructure using Owncloud as architectural component for file syncing and sharing, trying to answer to these needs. E3S provides an homogeneous platform able to store and share heterogeneous data produced by many different laboratories geographically spread on several sites and working on collaborative projects. A first deployment of E3S works in a project for cultural heritage diagnostics involving several laboratories in different ENEA sites producing schema-free data. The paper presents the first deployment of E3S and a performance analysis of the architectural components. The performance analysis has been carried out with customized benchmark tools on a test bed consisting of a HPC cluster over Infiniband mounting a high performance storage.
A Staging Storage Sharing System for Data Handling in a Multisite Scientific Organization / Iannone, F.; Bellagamba, I.; Bracco, G.; Calosso, B.; Giovanetti, G.; Migliori, S.; Mongelli, M.; Perozziello, A.; Pierattini, S.; Quintiliani, A.; Ambrosino, F.; Di Mattia, D.; Funel, A.; Guarnieri, G.; Ponti, G.; Simoni, F.; Steffé, M.. - 2017:(2017), pp. 1-2. (Intervento presentato al convegno CS3 tenutosi a Amsterdam).
A Staging Storage Sharing System for Data Handling in a Multisite Scientific Organization
I. BellagambaMembro del Collaboration Group
;B. CalossoMembro del Collaboration Group
;
2017
Abstract
In large scientific organizations, the laboratory experiments produce a huge amount of data and their processing and storage management are a challenging issue. Cloud architectures are exploited here and there for storage solutions and data sharing as well, in order to realize a collaborative world wide distributed platform. Large experimental facilities manage by themselves Information and Communications Technology (ICT) resources such as compute, networking and storage, while small experimental laboratories are demanding more and more departmental ICT resources for their own scientific instruments aided by data acquisition and control systems, specially in terms of storage and sharing/publishing data solutions. ENEA Staging Storage Sharing (E3S) system has been developed over the ENEA ICT infrastructure using Owncloud as architectural component for file syncing and sharing, trying to answer to these needs. E3S provides an homogeneous platform able to store and share heterogeneous data produced by many different laboratories geographically spread on several sites and working on collaborative projects. A first deployment of E3S works in a project for cultural heritage diagnostics involving several laboratories in different ENEA sites producing schema-free data. The paper presents the first deployment of E3S and a performance analysis of the architectural components. The performance analysis has been carried out with customized benchmark tools on a test bed consisting of a HPC cluster over Infiniband mounting a high performance storage.File | Dimensione | Formato | |
---|---|---|---|
Iannone_A-Staging_2017.pdf
accesso aperto
Note: https://zenodo.org/record/439637#.XQoJcYgzaUk
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Creative commons
Dimensione
274.87 kB
Formato
Adobe PDF
|
274.87 kB | Adobe PDF |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.