|
Chapter 8: Enstore Commands
|
|||||||||||
Chapter 8: Enstore Commands
Enstore provides commands that allow you to communicate with various components of the system. The basic syntax of all Enstore commands is
% enstore <command> [--option [argument] ...]All options start with a double dash (--).
8.1 enstore info
As of encp v3_2, this command replaces enstore file and enstore vol. The developers may remove these latter two commands in future versions of encp.
This command communicates with the File Clerk (see section 7.1 File Clerk) and the Volume Clerk (see section 7.2 Volume Clerk). It returns information about a specified file or files on a specified volume.
% enstore info [--option [argument] ... ]
Prints the options (i.e., prints this message). Example:
$ enstore info --helpUsage: info [ -h --bfid= --help --list= --ls-active= --usage ] --bfid <BFID> get info of a file --gvol <VOLUME_NAME> get info of a volume in human readable time format -h, --help print this message --just <VOLUME_NAME> used with --pvols to list problem --list <VOLUME_NAME> list the files in a volume --ls-active <VOLUME_NAME> list active files in a volume --ls-sg-count list all sg counts --pvols list all problem volumes --show-bad list all bad files --usage print short help message --vol <VOLUME_NAME> get info of a volume --vols list all volumesReturns information (metadata) about the file corresponding to the specified bfid.
You can get the bfid of a file from the enstore pnfs --bfid <FILE_NAME> command (section 8.4 enstore pnfs); get the filename from searching PNFS namespace.
$ enstore info --bfid CDMS105770745000000{'bfid': 'CDMS105770745000000', 'complete_crc': 1191066979L, 'deleted': 'no', 'drive': 'stkenmvr7a:/dev/rmt/tps0d1n:4560000022', 'external_label': 'VO3222', 'location_cookie': '0000_000000000_0005661', 'pnfs_mapname': '', 'pnfs_name0': '/pnfs/fs/usr/test/xyz/srmtest/ar017983.0001phys_10', 'pnfsid': '000500000000000000190EA8', 'pnfsvid': '', 'sanity_cookie': (65536L, 3203712884L), 'size': 197354833L}This is just like enstore info --vol <VOLUME_NAME>, except that this one prints human-readable time fields (e.g., "declared", "first_access" and "last_access" fields). Example:
$ enstore info --gvol VO3332{'blocksize': 131072, 'capacity_bytes': 64424509440L, 'declared': 'Wed Jan 16 16:13:57 2002', 'eod_cookie': '0000_000000000_0000044', 'external_label': 'VO3332', 'first_access': 'Fri May 10 12:59:35 2002', 'last_access': 'Mon Oct 27 22:35:45 2003', 'library': '9940', 'media_type': '9940', 'non_del_files': 43, 'remaining_bytes': 1785262080L, 'sum_mounts': 234, 'sum_rd_access': 213, 'sum_rd_err': 0, 'sum_wr_access': 43, 'sum_wr_err': 0, 'system_inhibit': ['none', 'full'], 'user_inhibit': ['none', 'none'], 'volume_family': 'cms.objy_data_files.cpio_odc', 'wrapper': 'cpio_odc'}Used with --pvols to list problem. See enstore info --pvols.
Lists the files in the specified volume with their volume name, bfid, size, location (file number) on volume, delete flag, and the original filename in pnfs.
You can get the volume name from the enstore pnfs command, using either --xref or --layer (section 8.4 enstore pnfs), or from the "external_label" field of the enstore info --bfid <BFID> command (shown above).
The enstore info --list <VOLUME_NAME> is an alias for this command.
$ enstore info --list VO3222label bfid size location_cookie delflag original_name VO3222 CDMS106503213600000 983803 0000_000000000_0011536 deleted /pnfs/fs/usr/eagle/dcache-tests/274.dcache_page_p_27750(This shows one of many lines appearing in the real output, and is reformatted to two lines for readability.)
Lists active files in a volume.
You can get the volume name from the enstore pnfs command, using either --xref or --layer (section 8.4 enstore pnfs), or from the "external_label" field of the enstore info --bfid <BFID> command (shown above).
$ enstore info --ls-active VO3222/pnfs/fs/usr/eagle/dcache-tests/101.dcache_page_a_24401 /pnfs/fs/usr/eagle/dcache-tests/101.dcache_page_24401 /pnfs/fs/usr/test/stress-test/myfile1 /pnfs/fs/usr/test/stress-test/myfile3 /pnfs/fs/usr/test/stress-test/file128m-11 ...Lists allocated tape counts by library and by storage group. If "storage group" has value "none", the negative number under "allocated" gives the number of tapes that are available in the robot, but not yet assigned to a storage group.
$ enstore info --ls-sg-count VO3332library storage group allocated ======================================== ... 9940 ktev 189 9940 lqcd 150 9940 miniboone 132 9940 minos 109 9940 none -13 9940 patriot 20 9940 sdss 608 9940 test 28 9940 theory 70 CD-9940B cms 129 ...--pvols [--just <VOLUME_1> <VOLUME_2> ...]
Without --just, this lists all problem volumes. With --just followed by a space-separated list of volume names, it lists only the problem volumes among the given list.
The columns returned are: volume name, primary status, primary status time, secondary status, secondary status time. (The time fields are relatively new; not all volumes will display them.)
$ enstore info --pvols==== readonly LEGL10 none * readonly 0913-1540 LEGL98 none * readonly 0819-2329 ... ==== full ... VO4845 none * full * VO4846 none 1023-1032 full * VO4847 none * full * VO4848 none * full * VO4849 none * full * VO4850 none * full 1016-2315 VO4851 none * full 1017-0409 ... $ enstore volume --pvols --just VO3332 (no sample output available)Lists all files that are currently unavailable due to media problems. When a tape problem is discovered, the tape is sent to the vendor for file recovery. In the interim, a cloned tape is made available to users, with the bad files marked. This command option lets you list the bad files. The output lists the tape number, BFID, file size in bites, and pnfs path of file.
$ enstore info --show-bad... VO0053 CDMS105770745000000 95530315 /pnfs/fs/usr/xyz/my_data/2004-4/.bad.F000xyz43_0000.mdaq.root ...We show only one output line, and it is displayed on two lines for readability. Notice the ".bad." at the front of the filename; this is how the bad files are marked.
Prints short help message. Example:
$ enstore info --usageUsage: info [ -h --bfid= --help --list= --ls-active= --usage ]Returns detailed information about specified volume
$ enstore info --vol VO3332{'blocksize': 131072, 'capacity_bytes': 64424509440L, 'declared': 1011219237.849051, 'eod_cookie': '0000_000000000_0000044', 'external_label': 'VO3332', 'first_access': 1021053575.259737, 'last_access': 1067315745.238969, 'library': '9940', 'media_type': '9940', 'non_del_files': 43, 'remaining_bytes': 1785262080L, 'sum_mounts': 234, 'sum_rd_access': 213, 'sum_rd_err': 0, 'sum_wr_access': 43, 'sum_wr_err': 0, 'system_inhibit': ['none', 'full'], 'user_inhibit': ['none', 'none'], 'volume_family': 'cms.objy_data_files.cpio_odc', 'wrapper': 'cpio_odc'}Lists all volumes with their available space, the system inhibits, the library, the volume family (period-separated concatenation of storage group, file family and file family wrapper) and any comments.
$ enstore info --volslabel avail. system_inhibit library vol_family comment ... VO0053 1.19GB (none full ) eagle cms.objy_data_files.cpio_odc VO0054 0.51GB (none full ) eagle cms.objy_data_files.cpio_odc VO0055 0.17GB (none full ) eagle theory.theory-canopy-C.cpio_odc VO0056 0.65GB (none full ) eagle theory.theory-canopy-D.cpio_odc ...8.2 enstore library
This command communicates with the Library Manager (see section 7.3 Library Manager). You can use it to get information pertaining to a particular Library Manager. Use the online monitoring pages (see Chapter 9: Monitoring Enstore on the Web) to find the library manager of interest.
% enstore library [--option [argument] ... ] <library>The <library> argument is required except when using the --help option; the ".library_manager" portion of the library name is optional.
8.3 enstore monitor
This command communicates with the Monitor Server (see Chapter 9: Monitoring Enstore on the Web) to get network speed information.
On machines with an enstore.conf file (see Appendix A: Network Control), the enstore monitor command uses the routing already established there. If enstore monitor set up its own, it would interfere with the routes currently in use.
% enstore monitor [--option [argument] ...]8.4 enstore pnfs
Enstore has a pnfs command that allows you to perform a variety of pnfs manipulations, as listed in the option table below. Off-site users cannot mount /pnfs, and therefore cannot run this command.
% enstore pnfs [--option [argument] ... ]8.5 enstore file (deprecated)
This command has been deprecated for users (not for admins) as of encp v3_2, and (along with enstore volume) replaced with enstore info (see section 8.1 enstore info).
This command communicates with the File Clerk (see section 7.1 File Clerk). It returns information about a specified file or files on a specified volume.
% enstore file [--option [argument] ... ]
Prints the options (i.e., prints this message). Example:
$ enstore file --helpUsage: file [ -h --bfid= --help --list= --ls-active= --usage ] --bfid <BFID> get info of a file -h, --help print this message --list <VOLUME_NAME> list the files in a volume --ls-active <VOLUME_NAME> list active files in a volume --usage print short help messageReturns information (metadata) about the file corresponding to the specified bfid.
You can get the bfid of a file from the enstore pnfs --bfid <FILE_NAME> command (section 8.4 enstore pnfs); get the filename from searching PNFS namespace.
$ enstore file --bfid CDMS105770745000000{'bfid': 'CDMS105770745000000', 'complete_crc': 1191066979L, 'deleted': 'no', 'drive': 'stkenmvr7a:/dev/rmt/tps0d1n:4560000022', 'external_label': 'VO3222', 'location_cookie': '0000_000000000_0005661', 'pnfs_mapname': '', 'pnfs_name0': '/pnfs/fs/usr/test/xyz/srmtest/ar017983.0001phys_10', 'pnfsid': '000500000000000000190EA8', 'pnfsvid': '', 'sanity_cookie': (65536L, 3203712884L), 'size': 197354833L}Lists the files in the specified volume with their volume name, bfid, size, location (file number) on volume, delete flag, and the original filename in pnfs.
You can get the volume name from the enstore pnfs command, using either --xref or --layer (section 8.4 enstore pnfs), or from the "external_label" field of the enstore file --bfid <BFID> command (shown above).
The enstore volume --list <VOLUME_NAME> is an alias for this command.
$ enstore file --list VO3222label bfid size location_cookie delflag original_name VO3222 CDMS106503213600000 983803 0000_000000000_0011536 deleted /pnfs/fs/usr/eagle/dcache-tests/274.dcache_page_p_27750(This shows one of many lines appearing in the real output, and is reformatted to two lines for readability.)
Lists active files in a volume.
You can get the volume name from the enstore pnfs command, using either --xref or --layer (section 8.4 enstore pnfs), or from the "external_label" field of the enstore file --bfid <BFID> command (shown above).
$ enstore file --ls-active VO3222/pnfs/fs/usr/eagle/dcache-tests/101.dcache_page_a_24401 /pnfs/fs/usr/eagle/dcache-tests/101.dcache_page_24401 /pnfs/fs/usr/test/stress-test/myfile1 /pnfs/fs/usr/test/stress-test/myfile3 /pnfs/fs/usr/test/stress-test/file128m-11 ...Prints short help message. Example:
$ enstore file --usageUsage: file [ -h --bfid= --help --list= --ls-active= --usage ]8.6 enstore volume (deprecated)
This command has been deprecated for users (not admins) as of encp v3_2, and replaced (along with enstore file) with enstore info (see section 8.1 enstore info).
This command communicates with the Volume Clerk (see section 7.2 Volume Clerk) to return information on data volumes.
% enstore volume [--option [argument] ... ]
Prints this message (i.e., prints the options). Example:
$ enstore volume --helpUsage: volume [OPTIONS]... --gvol <VOLUME_NAME> get info of a volume in human readable time format -h, --help prints this messge --just <VOLUME_NAME> used with --pvols to list problem --list <VOLUME_NAME> list the files in a volume --ls-active <VOLUME_NAME> list active files in a volume --ls-sg-count list all sg counts --pvols list all problem volumes --usage prints short help message --vol <VOLUME_NAME> get info of a volume --vols list all volumesThis is just like enstore volume --vol <VOLUME_NAME>, except that this one prints human-readable time fields (e.g., "declared", "first_access" and "last_access" fields). Example:
$ enstore volume --gvol VO3332{'blocksize': 131072, 'capacity_bytes': 64424509440L, 'declared': 'Wed Jan 16 16:13:57 2002', 'eod_cookie': '0000_000000000_0000044', 'external_label': 'VO3332', 'first_access': 'Fri May 10 12:59:35 2002', 'last_access': 'Mon Oct 27 22:35:45 2003', 'library': '9940', 'media_type': '9940', 'non_del_files': 43, 'remaining_bytes': 1785262080L, 'sum_mounts': 234, 'sum_rd_access': 213, 'sum_rd_err': 0, 'sum_wr_access': 43, 'sum_wr_err': 0, 'system_inhibit': ['none', 'full'], 'user_inhibit': ['none', 'none'], 'volume_family': 'cms.objy_data_files.cpio_odc', 'wrapper': 'cpio_odc'}Used with --pvols to list problem. See enstore volume --pvols.
This is an alias for the enstore file --list <VOLUME_NAME> command. See section 8.5 enstore file (deprecated).
Lists original file names of active files in a volume. Example:
$ enstore volume --ls-active VO3332/pnfs/cms/UserFederation/data/jetmet_production/data/Collections/jm_Hit601_g12 5_UCSD/jm02_qqh120_ll/EVD0.jet0102.DB /pnfs/cms/UserFederation/data/jetmet_production/data/TAssoc/jm_2x1033PUjm602_T kMu_g125_UCSD/jm02_hlt15-20/EVD11.jet0102.DB /pnfs/cms/UserFederation/data/jetmet_production/data/Digis/jm_2x1033PUjm602_Tk Mu_g125_UCSD/jm02-hlt0-15/EVD12.jet0102.DB /pnfs/cms/UserFederation/data/jetmet_production/data/Hits/jm_Hit601_g125_UCSD/ jm02_hlt230-300/EVD12.jet0102.DB ...Lists allocated tape counts by library and by storage group. If "storage group" has value "none", the negative number under "allocated" gives the number of tapes that are available in the robot, but not yet assigned to a storage group.
$ enstore volume --ls-sg-count VO3332library storage group allocated ======================================== ... 9940 ktev 189 9940 lqcd 150 9940 miniboone 132 9940 minos 109 9940 none -13 9940 patriot 20 9940 sdss 608 9940 test 28 9940 theory 70 CD-9940B cms 129 ...--pvols [--just <VOLUME_1> <VOLUME_2> ...]
Without --just, this lists all problem volumes. With --just followed by a space-separated list of volume names, it lists only the problem volumes among the given list.
The columns returned are: volume name, primary status, primary status time, secondary status, secondary status time. (The time fields are relatively new; not all volumes will display them.)
$ enstore volume --pvols==== readonly LEGL10 none * readonly 0913-1540 LEGL98 none * readonly 0819-2329 ... ==== full ... VO4845 none * full * VO4846 none 1023-1032 full * VO4847 none * full * VO4848 none * full * VO4849 none * full * VO4850 none * full 1016-2315 VO4851 none * full 1017-0409 ... $ enstore volume --pvols --just VO3332 (no sample output available)Returns detailed information about specified volume
$ enstore volume --vol VO3332{'blocksize': 131072, 'capacity_bytes': 64424509440L, 'declared': 1011219237.849051, 'eod_cookie': '0000_000000000_0000044', 'external_label': 'VO3332', 'first_access': 1021053575.259737, 'last_access': 1067315745.238969, 'library': '9940', 'media_type': '9940', 'non_del_files': 43, 'remaining_bytes': 1785262080L, 'sum_mounts': 234, 'sum_rd_access': 213, 'sum_rd_err': 0, 'sum_wr_access': 43, 'sum_wr_err': 0, 'system_inhibit': ['none', 'full'], 'user_inhibit': ['none', 'none'], 'volume_family': 'cms.objy_data_files.cpio_odc', 'wrapper': 'cpio_odc'}Lists all volumes with their available space, the system inhibits, the library, the volume family (period-separated concatenation of storage group, file family and file family wrapper) and any comments.
$ enstore volume --volslabel avail. system_inhibit library vol_family comment ... VO0053 1.19GB (none full ) eagle cms.objy_data_files.cpio_odc VO0054 0.51GB (none full ) eagle cms.objy_data_files.cpio_odc VO0055 0.17GB (none full ) eagle theory.theory-canopy-C.cpio_odc VO0056 0.65GB (none full ) eagle theory.theory-canopy-D.cpio_odc ...
|
|
|||||||||||
| View/print PDF file | Back to Enstore Doc Home Page | Fermilab Mass Storage System | Computing Division | Fermilab at Work | Fermilab Home | |||||||||||