Ad Hoc File Systems for High-Performance Computing

Publication type:
Journal article
Metadata:
Autoren
  • Andre Brinkmann
  • Kathryn Mohror
  • Weikuan Yu
  • Philip Carns
  • Toni Cortes
  • Scott A Klasky
  • Alberto Miranda
  • Franz-Josef Pfreundt
  • Robert B Ross
  • Marc-Andre Vef
Autoren-URL
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=fis-test-1&SrcAuth=WosAPI&KeyUT=WOS:000512098800002&DestLinkType=FullRecord&DestApp=WOS_CPL
DOI
10.1007/s11390-020-9801-1
eISSN
1860-4749
Externe Identifier
  • Clarivate Analytics Document Solution ID: KJ5KJ
ISSN
1000-9000
Ausgabe der Veröffentlichung
1
Zeitschrift
JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
Schlüsselwörter
  • parallel architectures
  • distributed file system
  • high-performance computing
  • burst buffer
  • POSIX (portable operating system interface)
Paginierung
4 - 26
Datum der Veröffentlichung
2020
Status
Published
Titel
Ad Hoc File Systems for High-Performance Computing
Sub types
  • Article
Ausgabe der Zeitschrift
35

Data source: Web of Science (Lite)

Other metadata sources:
Autoren
  • André Brinkmann
  • Kathryn Mohror
  • Weikuan Yu
  • Philip Carns
  • Toni Cortes
  • Scott A Klasky
  • Alberto Miranda
  • Franz-Josef Pfreundt
  • Robert B Ross
  • Marc-André Vef
DOI
10.1007/s11390-020-9801-1
eISSN
1860-4749
ISSN
1000-9000
Ausgabe der Veröffentlichung
1
Zeitschrift
Journal of Computer Science and Technology
Sprache
en
Online publication date
2020
Paginierung
4 - 26
Datum der Veröffentlichung
2020
Status
Published
Herausgeber
Springer Science and Business Media LLC
Herausgeber URL
http://dx.doi.org/10.1007/s11390-020-9801-1
Datum der Datenerfassung
2021
Titel
Ad Hoc File Systems for High-Performance Computing
Ausgabe der Zeitschrift
35

Data source: Crossref

Autoren
  • André Brinkmann
  • Kathryn M Mohror
  • Weikuan Yu
  • Philip H Carns
  • Toni Cortes
  • Scott Klasky
  • Alberto Miranda
  • Franz-Josef Pfreundt
  • Robert B Ross
  • Marc-Andre Vef
Zeitschrift
J. Comput. Sci. Technol.
Artikelnummer
1
Paginierung
4 - 26
Datum der Veröffentlichung
2020
Titel
Ad Hoc File Systems for High-Performance Computing.
Ausgabe der Zeitschrift
35

Data source: DBLP

Abstract
Storage backends of parallel compute clusters are still based mostly on magnetic disks, while newer and faster storage technologies such as flash-based SSDs or non-volatile random access memory (NVRAM) are deployed within compute nodes. Including these new storage technologies into scientific workflows is unfortunately today a mostly manual task, and most scientists therefore do not take advantage of the faster storage media. One approach to systematically include nodelocal SSDs or NVRAMs into scientific workflows is to deploy ad hoc file systems over a set of compute nodes, which serve as temporary storage systems for single applications or longer-running campaigns. This paper presents results from the Dagstuhl Seminar 17202 “Challenges and Opportunities of User-Level File Systems for HPC” and discusses application scenarios as well as design strategies for ad hoc file systems using node-local storage media. The discussion includes open research questions, such as how to couple ad hoc file systems with the batch scheduling environment and how to schedule stage-in and stage-out processes of data between the storage backend and the ad hoc file systems. Also presented are strategies to build ad hoc file systems by using reusable components for networking and how to improve storage device compatibility. Various interfaces and semantics are presented, for example those used by the three ad hoc file systems BeeOND, GekkoFS, and BurstFS. Their presentation covers a range from file systems running in production to cutting-edge research focusing on reaching the performance limits of the underlying devices.
Autoren
  • André Brinkmann
  • Kathryn Mohror and Weikuan Yu
  • Philip Carns
  • Toni Cortes
  • Scott A Klasky
  • Alberto Miranda
  • Franz-Josef Pfreundt
  • Robert B Ross
  • Marc-André Vef
Autoren-URL
https://seafile.rlp.net/f/9f6a7185ffd74e3e88e5/
DOI
10.1007/s11390-020-9801-1
Ausgabe der Veröffentlichung
1
Zeitschrift
Journal of Computer Science and Technology (JCST)
Paginierung
4 - 26
Datum der Veröffentlichung
2020
Datum der Datenerfassung
2019
Titel
Ad Hoc File Systems for High-Performance Computing
Ausgabe der Zeitschrift
35

Data source: Manual

Beziehungen:
Property of

Tools