3.3.5 EOS file storage

3.3.5.1 EOS file system introduction

The EOS file system is a distributed file system for EB-level data storage based on the xrootd framework. At present, it provides massive data storage services for multiple experiments such as LHAASO and HXMT.

The current EOS file system information is shown in the following table.

3.3.5.2 EOS file system usage instructions

1）eos usage

Eos currently provides two access modes: client FUSE mode and xrootd mode.

a）FUSE acess

This method is to access the EOS system as a mount point, similar to accessing the local file system. For different experimental storage instances, the mount points are shown in the table above. For example, the mount directory for the LHAASO experiment is /eos. On the login node, the data in the EOS file system can be accessed through the mount point.

b）xrootd access

This method uses the xrootd protocol to access the EOS system. The access method is:

access method： root://EOS_MGM_URL//filepath

The EOS_MGM_URL here is the server address of the instance. Users can use commands that come with xrootd, or you can use EOS commands to access them. Taking the lhaaso experiment as an example, if you want to list a file in the lhaaso experiment, the command is as follows:

Xrdfs root://eos01.ihep.ac.cn  ls /eos/user/file.txt

or

eos root://eos01.ihep.ac.cn  ls /eos/user/file.txt

Note: Using the xrootd method to access EOS files in user jobs requires the experimental software to support the xrootd protocol.

2）Viewing User's Resource Quota Use Command：

Command format：

$eos quota your_eos_path

Examples are as follows：

$eos quota /eos/user/z/zhangsan
By user ...
# _______________________________________________________________________________________________
# ==> Quota Node: /eos/user/z/zhangsan/
# _______________________________________________________________________________________________
user       used bytes logi bytes used files aval bytes aval logib aval files filled[%]  vol-status ino-status
lihaibo    800 GB  800 GB  10 k-   1.00 TB    200GB    25M -  9.08       ok         ok              
        （used space）          （number of used files ） （space quota）（number of files quota）     
By group ...
# _______________________________________________________________________________________________
# ==> Quota Node: /eos/user/z/zhangsan/
# _______________________________________________________________________________________________
# ...............................................................................................
group      used bytes logi bytes used files aval bytes aval logib aval files filled[%]  vol-status ino-status
u07        800 GB  800 GB  10 k-   0 B        0 B        0 -        100.00     ignored    ignored

3）View EOS Recycle Bin Usage Commands Command format：

$eos recycle help
Support ls，purge，restore three operations。
~

View the files in the user's personal recycle bin:

$eos recycle ls
# Deletion Time            UID      GID      SIZE         TYPE          RESTORE-KEY      RESTORE-PATH                                                    
# ==============================================================================================================================
Sat Dec 29 16:32:03 2018   zhangsan  u07      13           file          0000000008b0f7bf /eos/user/z/zhangsan/test.txt

Clean up the files in the user's personal recycle bin

$esos recycle purge

Restore the files in the user's personal recycle bin

$eos recycle restore [--force-original-name|-f] [--restore-versions|-r] <recycle-key>

Expamles：

$eos recycle restore 0000000008b0f7bf

Note: Documents in the / EOS Recycle Bin are currently kept for only three days.