Index

A

accounting server 16-1

accounting server (AS) 8-6

ACL

limitations with FTP C-1

reflexive C-2

active file 16-1

adapter tunnel C-2

admin priority 11-1

alarm server (AS) 8-4, 16-1

overview 8-4

relationship to other servers 8-4

AS (alarm server) 8-4

B

bfid 16-1

bottlenecks in encp 6-7

C

CDFEN installation 1-2

cern wrapper 2-2, 16-1

configuration server (CS) 8-3, 16-1

overview 8-3

relationship to other servers 8-3

copy directory to enstore 7-1

copying data files

recursively 7-1

to/from on-site 6-1

using dCap and dCache 5-1

using encp 6-1

using ensync 7-1

using ftp and dCache 5-1

using GSI FTP and dCache 5-5

using kerberized ftp and dCache 5-9

using kftpcp and dCache 5-10

weak-auth FTP and dCache 5-12

cpio 2-5

cpio_odc wrapper 2-2, 16-1

crc 16-1

calculate via ecrc 6-3

cross-reference data for file 9-16

CS (configuration server) 8-3

cwd (current working directory) 16-1

D

D0EN installation 1-2

DAQ/Admin priority 11-1

data file

access from storage media 2-4

active 16-1

caching 1-3

calculate crc 6-3

cross-reference information 9-16

format on storage volume 2-2

get BFID 9-12

get filesize 9-13

get layer-related info 9-12, 9-14

inquire enstore about 9-17

list active ones per volume 9-5, 9-18

list cross-ref info 9-13, 9-16

list per volume 9-4, 9-18, 9-20

organization on storage media 2-1

organization on volume 2-4

partial files and ftp C-1

prevent overwriting 6-6

quantity limit 3-1

size limits 2-2, 2-3

storage volume details 10-16, 10-29

dc_check 5-3

dc_ckeck 16-2

dc_stage 5-3, 16-2

dCache 1-1, 16-1

access via GSI FTP 5-5

access via Kerberized ftp 5-9

access via kftpcp 5-10

access via native dCap 5-1

access via standard ftp (read-only) 5-12

description of use 5-1

doors 1-3, 5-1

file copy utilities 5-1

get data file info 9-14

introduction 1-3

kftp service 5-9

protocols 1-2

server nodes and ports 5-1

SRM interface 5-6

storage disks 1-3

dCache doors 16-2

dCap 5-1, 16-2

dccp command 5-3

nodes and ports 5-2

protocol specification 5-2, 5-4

with Kerberos V5 5-2

dccp 5-3, 16-2

examples 5-4

prestage a request 5-3

syntax 5-4

dd 2-5

ddencp 6-4, 16-2

DESY 16-2

direct I/O 16-2

directory capacity 3-1

directory structure

upload via ensync 7-1

disk rate 6-7

drive

ownership 11-2

priority 11-1

reserving 11-2

drive rate 6-6

drivestat server 8-6, 16-2

dumping tapes 2-5

E

ecrc 6-3, 16-2

en_check 6-5, 16-2

encp 1-1, 16-2

aborting a job 6-6

bottlenecks, isolating 6-7

command option list and descriptions 6-10

command syntax and usage 6-2

common errors 6-8

description 6-1

error handling 6-8

finding files 6-8

installing 3-3

killing a job 6-6

network interfaces 3-1

order of processing 6-9

preventing overwriting 6-6

rate transfers, isolating 6-7

read requests 6-9

recent transfers, details 10-20

routing A-1

searching all enstore systems 6-8

uploading files to enstore 6-2

use of filename expansion 6-2

use with pnfs 1-2

write requests 6-9

enmv 6-5

enstore 16-3

CDFEN 1-2

commands 9-1

copying data files via dCache 5-1

copying data files with encp 6-1

D0EN 1-2

file search across systems 6-8

installed systems 1-2

introduction 1-1

multi-directory copies 7-1

multi-file copies 7-1

network interfaces 3-1

preparation for use 3-1

remote access 1-3

slot quota 2-5

STKEN 1-2

throughput 3-2

volume quota 2-5

web monitoring 10-1

enstore announcements by email 3-1

enstore file command 8-1, 9-17

enstore info command 9-1

enstore libraries 8-1

enstore library command 9-8

enstore monitor command 9-10

enstore pnfs command 9-11

Enstore Server Status web page

relationship to Event Relay server 8-5

enstore servers 1-1, 8-1

enstore systems

active file list 10-10

active jobs, details 10-14

alarms, unresolved 10-23

configuration 10-21

current and pending jobs 10-11

encp, recent transfers 10-20

file family use with WRITE jobs 10-13

files currently being copied 10-10

investigating problems 10-4

jobs in progress, file family width 10-13

library manager queues 10-11

library managers, full info 10-14

log files 10-24

monitoring via web 10-1

mover status 10-18

node-server mapping 10-6

READ jobs in queue 10-12

server status 10-5, 10-6

status summary page 10-4

system activity plots 10-28

system performance monitoring 10-28

tape inventory (dynamic html) 10-29

tape inventory (text) 10-16

web monitoring 1-2

web page format 10-3

web pages 10-1

WRITE jobs in queue 10-13

enstore volume command 8-2, 9-19

ENSTORE_CONF variable A-1, 16-3

ENSTORE_CONFIG_HOST variable 16-3

ENSTORE_CONFIG_PORT variable 16-3

enstore.conf file 3-1, A-1, 16-3

format and contents A-1

ensync 16-3

command syntax 7-1

description 7-1

hard vs symbolic links 7-1

ER (event relay server) 8-5

error handling in encp 6-8

event relay 16-3

event relay server (ER) 8-5

overview 8-5

relationship to inquisitor 8-5

relationship to other servers 8-5

Status-At-A-Glance web page 8-5

export of storage volumes 2-5

F

fair share 11-2, 16-3

FC (file clerk) 8-1

Fermilab installed enstore systems

web pages 10-1

file clerk 16-3

file clerk server (FC) 9-17

overview 8-1

file family 16-3

definition 2-1

file organization on storage media 2-4

WRITE jobs in queue 10-13

file family width 16-3

definition 2-2

job assignment and initiation 10-13

file family wrapper 16-4, 16-7

CERN standard 2-2, 16-1

cpio 2-2

cpio_odc 16-1

definition 2-2

difference in bytes read vs written 10-19

null 2-2

tape dumping 2-5

file size 2-3

wrapper limits 2-2

file streaming 16-6

file striping 16-6

file, finding 6-8

filemark 16-4

firewalls C-2

fndca.fnal.gov (dCache node) 5-1

FTP

problems with grid environment C-1

ftp 16-4

third party passive transfers C-2

ftp (standard security)

nodes and ports 5-12

use for copying files via dCache 5-12

ftp client, Kerberized 16-4

G

grid

problems with ftp C-1

grid certificate 5-5

Grid FTP 5-5, 16-4

grid proxy 5-5

GSI FTP 5-5, 16-4

examples of use with dCache 5-5

globus-url-copy 5-6

grid certificate 5-5

kftpcp protocol specification 5-8

nodes and ports 5-5

protocol specification 5-6

srm interface 5-5

I

I/O, direct 16-2

I/O, memory mapped 16-5

import of storage volumes 2-5

information server 8-6

INQ (See inquisitor)

inquisitor (INQ) 8-4, 16-4

overview 8-4

relationship to other servers 8-4

J

job

See request

job priority

See priority

K

Kerberized ftp

kftpcp command for using dCache 5-10

nodes and ports 5-9

Kerberized ftp client 16-4

kftp product 5-10

kftpcp

protocol specification 5-11

kftpcp command 5-10, 5-11

kftpcp examples 5-11

kits 5-7

KX.509 certificate 5-5

L

layer 16-5

libraries, Enstore 8-1

library 16-4

library manager (LM) 8-2, 9-8, 16-4

encp requests 8-2

find for given pnfs dir 9-16

Library Manager Queues page 10-11

overview 8-2

queue management 11-1

READ/WRITE queues 10-11

relationship to mover 8-2

relationship to VL 8-2

reset for given pnfs dir B-2

status definitions 10-7

listserv email for announcements 3-1

LM (library manager)

See library manager (LM)

log files for enstore system activity 10-24

log server (LS) 8-4, 16-4

overview 8-4

relationship to other servers 8-4

LS (log server)

See log server (LS)

M

MC (media changer)

See media changer (MC)

media changer 16-5

media changer (MC) 8-3

overview 8-3

relationship to drives 8-3

relationship to mover 8-3

relationship to VL 8-3

memory mapped I/O 16-5

metadata

get for given data file 9-2, 9-13, 9-16, 9-17

mmapped I/O 16-5

monitor server 9-10, 16-5

monitor server (MS) 8-5

mover (MV) 8-2, 16-5

bytes read/written for current jobs 10-19

current status on web 10-18

flexible LM assignment 8-3

Movers web page 10-18

overview 8-2

relationship to LM 8-2

relationship to MC 8-2

relationship to media drive 8-2

status definitions 10-8

MV (mover)

See mover (MV)

N

network inquiries 9-10

network interfaces

connection to routers A-1

specifying A-2

network transfer rate 6-6

networks 3-1

ACL limitations C-1

rate information 9-10

normal priority 11-1

null wrapper 2-2

O

off-site access to enstore 1-3

overall rate 6-7

P

PNFS

file limit 4-2

pnfs 1-1

authorization to mount area 3-2

change tags 9-11

enstore pnfs command 9-11

file family 2-1

file size representation 2-3

introduction 1-2

layer 16-5

list tags of directory 9-15

mounting area 3-2

namespace 16-5

return info about a file 9-11

tag file (See tag)

tag files 16-5, 16-6

usable UNIX commands 4-1

pnfs directory

change file family of B-2

change file family width of B-2

change file family wrapper of B-2

changing tags B-1

get file family of 9-12

get file family width of 9-13

get file family wrapper of 9-13

get library tag for 9-16

permissions and ownership B-1

reset library tag for B-2

reset tags B-2

return info about tags 9-11

PNFS directory limitations 4-2

POSIX I/O 16-5

preparation for using enstore 3-1

all users 3-1

on-site users only 3-2

prestage read with dc_stage 5-3

priority 11-1

DAQ/Admin 11-1

encp option 11-2

fair share 11-2

normal 11-1

numeric 11-2

tape drive ownership 11-2

Q

queue

management 11-1

print queue per encp client host 9-9

R

rate

disk 6-7

drive 6-6

network transfer 6-6

overall 6-7

transfer 6-6

ratekeeper 8-6

recursive copy via ensync 7-1

remote access to enstore 1-3

requests 16-5

distributing resources 11-2

numerical priority values 11-2

print list of active by library 9-10

print list of pending by library 9-10

priority 11-1

routing A-1

resubmit 16-5

retry 16-6

robot 8-2

MC as interface 8-3

routing 3-1

encp requests A-1

S

server overviews

alarm server (AS) 8-4

configuration server (CS) 8-3

event relay server (ER) 8-5

file clerk (FC) 8-1

inquisitor (INQ) 8-4

library manager (LM) 8-2

log server (LS) 8-4

media changer (MC) 8-3

mover (MV) 8-2

virtual library (VL) 8-2

volume clerk (VC) 8-2

servers, Enstore 8-1

size of data file 2-2

slots in robot

quantity vs no. of volumes 2-5

SRM 16-6

interface to dCache 5-6

protocol specification 5-7

srmcp examples 5-7

srmtools 5-7

standard ftp with dCache 5-12

status definitions (servers) 10-9

library manager 10-7

mover 10-8

Status-At-A-Glance web page

event relay server 8-5

STKEN installation 1-2

stken system announcements 3-1

storage area 1-2

storage group 3-1, 16-6

definition 2-1

storage volume 16-6

assert 16-6

data file organization 2-1, 2-4

data storage information 2-4

export from enstore 2-5

import to enstore 2-5

inhibits 10-16, 10-29

inventory on web 10-16, 10-29

limit on number of volumes 2-5

list active files 9-21

list allocated tape counts 9-5, 9-21

list available space 9-6, 9-7, 9-19, 9-23

list file family info 9-6, 9-7, 9-19, 9-23

list files on 9-4, 9-18, 9-20

list inhibits 9-6, 9-7, 9-19, 9-23

list problem volumes 9-6, 9-22

look-ahead feature 2-4

print asserts per library 9-8

quota 3-1

remove from robot 2-5

statistics 9-4, 9-7, 9-20, 9-22

suspect 16-6

tape features 2-4

unused space 2-4

volume family 16-7

streaming 16-6

striping 16-6

suspect volumes 16-6

print list per library 9-9

T

tag 16-6

definition 4-2

file-family 4-3

file-family-width 4-3

file-family-wrapper 4-3

library 4-3

list of tags 4-3

storage-group 4-3

viewing 4-4

tag file (See tag)

tape

See storage volume

TCP window size 3-1

transfer rate 6-6

U

UNIX commands

use in pnfs namespace 4-1

UPS/UPD installation 3-3

V

VC (volume clerk)

see volume clerk (VC)

viewing pnfs tags 4-4

virtual library (VL) 8-2, 16-6

overview 8-2

VL (virtual library)

See virtual library (VL)

volume

See storage volume

volume clerk (VC) 9-19, 16-7

overview 8-2

volume family 2-1

W

web pages for monitoring enstore 1-2, 10-1

Active File List page 10-10

active jobs, details 10-14

alarms, unresolved 10-23

configuration 10-21

current and pending jobs 10-11

encp, recent transfers 10-20

Enstore Server Status page 10-6

features and format of pages 10-3

file family use with WRITE jobs 10-13

Full Library Manager Info page 10-14

home page 10-1

job initiation, file family width 10-13

jobs in progress, bytes read/written 10-19

Library Manager Queues page 10-11

library manager status definitions 10-7

log files 10-24

mover status definitions 10-8

Movers page 10-18

online help 10-3

READ jobs in queue 10-12

server status definitions 10-9

system activity plots 10-28

system performance monitoring 10-28

System-At-A-Glance page 10-4

tape inventory page (dynamic html) 10-29

tape inventory text page 10-16

top page 10-1

WRITE jobs in queue 10-13

width

See file family width

wrapper

See file family wrapper

X

X.509 certificate 5-5