header software2

This website uses cookies to manage authentication, navigation, and other functions. By using our website, you agree that we can place these types of cookies on your device.

View e-Privacy Directive Documents

BeeGFS, Fraunhofer's Parallel File System, forms the basis for the parallel I/O layer in DEEP-EST.

 

The DEEP-EST storage system uses the Parallel File System BeeGFS with its distributed metadata architecture as a basis for parallel I/O.

 

Developed with a strong focus on performance and designed for ease of use, simple installation, and management, the European BeeGFS parallel file system has been enhanced with new features to support storage pools and various storage hardware.

 

For a better exploitation of the cluster performances, BeeOND has been used to enable easy creation of one or multiple BeeGFS instances on the fly. For DEEP-EST project it has been re-implemented and integrated into the SLURM job manager, allowing system users to create a temporary BeeGFS file system on their allocated nodes with the options that suits their jobs best. Such BeeOND instances do not only provide a very fast and easy to use temporary buffer but can also keep a lot of I/O load for temporary or random-access files away from the global cluster storage. Increasing the proficiency of the client nodes by adding such functionality will speed up critical projects enormously.

 

Furthermore, the time series-based monitoring solution for BeeGFS has been implemented, released, and integrated with the resource manager to enable energy-saving scheduling mechanisms. In combination with the DEEP-EST monitoring infrastructure, users can now see the current and past status of the file system using Grafana panels. The full control over the system utilization provided by the system, opens opportunities for optimized operation policies.

 

For more information about BeeGFS: