In large scientific organizations, the laboratory experiments produce a huge amount of data and their processing and storage management are a challenging issue. Cloud architectures are exploited here and there for storage solutions and data sharing as well, in order to realize a collaborative world wide distributed platform. Large experimental facilities manage by themselves Information and Communications Technology (ICT) resources such as compute, networking and storage, while small experimental laboratories are demanding more and more departmental ICT resources for their own scientific instruments aided by data acquisition and control systems, specially in terms of storage and sharing/publishing data solutions. ENEA Staging Storage Sharing (E3S) system has been developed over the ENEA ICT infrastructure using Owncloud as architectural component for file syncing and sharing, trying to answer to these needs. E3S provides an homogeneous platform able to store and share heterogeneous data produced by many different laboratories geographically spread on several sites and working on collaborative projects. A first deployment of E3S works in a project for cultural heritage diagnostics involving several laboratories in different ENEA sites producing schema-free data. The paper presents the first deployment of E3S and a performance analysis of the architectural components. The performance analysis has been carried out with customized benchmark tools on a test bed consisting of a HPC cluster over Infiniband mounting a high performance storage.

A Staging Storage Sharing System for Data Handling in a Multisite Scientific Organization / Iannone, F.; Bellagamba, I.; Bracco, G.; Calosso, B.; Giovanetti, G.; Migliori, S.; Mongelli, M.; Perozziello, A.; Pierattini, S.; Quintiliani, A.; Ambrosino, F.; Di Mattia, D.; Funel, A.; Guarnieri, G.; Ponti, G.; Simoni, F.; Steffé, M.. - 2017:(2017), pp. 1-2. (Intervento presentato al convegno CS3 tenutosi a Amsterdam).

A Staging Storage Sharing System for Data Handling in a Multisite Scientific Organization

I. Bellagamba
Membro del Collaboration Group
;
B. Calosso
Membro del Collaboration Group
;
2017

Abstract

In large scientific organizations, the laboratory experiments produce a huge amount of data and their processing and storage management are a challenging issue. Cloud architectures are exploited here and there for storage solutions and data sharing as well, in order to realize a collaborative world wide distributed platform. Large experimental facilities manage by themselves Information and Communications Technology (ICT) resources such as compute, networking and storage, while small experimental laboratories are demanding more and more departmental ICT resources for their own scientific instruments aided by data acquisition and control systems, specially in terms of storage and sharing/publishing data solutions. ENEA Staging Storage Sharing (E3S) system has been developed over the ENEA ICT infrastructure using Owncloud as architectural component for file syncing and sharing, trying to answer to these needs. E3S provides an homogeneous platform able to store and share heterogeneous data produced by many different laboratories geographically spread on several sites and working on collaborative projects. A first deployment of E3S works in a project for cultural heritage diagnostics involving several laboratories in different ENEA sites producing schema-free data. The paper presents the first deployment of E3S and a performance analysis of the architectural components. The performance analysis has been carried out with customized benchmark tools on a test bed consisting of a HPC cluster over Infiniband mounting a high performance storage.
2017
CS3
cloud storage; Linux; AFS; GPFS
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
A Staging Storage Sharing System for Data Handling in a Multisite Scientific Organization / Iannone, F.; Bellagamba, I.; Bracco, G.; Calosso, B.; Giovanetti, G.; Migliori, S.; Mongelli, M.; Perozziello, A.; Pierattini, S.; Quintiliani, A.; Ambrosino, F.; Di Mattia, D.; Funel, A.; Guarnieri, G.; Ponti, G.; Simoni, F.; Steffé, M.. - 2017:(2017), pp. 1-2. (Intervento presentato al convegno CS3 tenutosi a Amsterdam).
File allegati a questo prodotto
File Dimensione Formato  
Iannone_A-Staging_2017.pdf

accesso aperto

Note: https://zenodo.org/record/439637#.XQoJcYgzaUk
Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Creative commons
Dimensione 274.87 kB
Formato Adobe PDF
274.87 kB Adobe PDF

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1288719
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact