Table of Contents

Chapter 1: Introduction to the Enstore Mass Storage System

1.1 About Enstore

1.2 PNFS Namespace

1.3 Storage Groups

1.4 File Organization on Storage Media

1.4.1 File Family

1.4.2 File Family Width

1.4.3 File Family Wrapper

1.5 File Size Limitations

1.6 Data Storage Volumes in Enstore

1.6.1 Tape Features

1.6.2 File Organization, Storage and Access

1.6.3 Quantity of Volumes

1.6.4 Import/Export of Volumes

1.7 dCache: The Enstore Front-End

1.7.1 Overview

1.7.2 Advantages

1.7.3 Protocols for Communicating with dCache

Chapter 2: Getting Ready to Use Enstore and DCache

2.1 Setting up Access to Enstore

2.1.1 Initial Steps for All Users

2.1.2 Further Steps for non-dCache Users Only

2.2 Important Environment Variables

Chapter 3: PNFS Namespace

3.1 UNIX Commands You can Use in PNFS Space

3.2 About PNFS Tags

3.2.1 Tag Listing

3.2.2 How to View Tags

Chapter 4: Using the dCache to Copy Files to/from Enstore

4.1 DCache-Native dCap

4.1.1 About dCap

4.1.2 The dccp Command

4.2 Grid (GSI) FTP

4.2.1 Obtain Grid Proxies

4.2.2 GSI FTP with globus-url-copy

4.2.3 GSI FTP with Kftpcp

4.2.4 Storage Resource Management (SRM)

4.3 Simple Kerberized FTP

4.3.1 Prepare to use Kerberized FTP

4.3.2 Sample Kerberized FTP session

4.4 Kerberized FTP via the kftpcp Command

4.4.1 Syntax and Options

4.4.2 Download a File

4.4.3 Upload a File

4.4.4 Examples

4.5 Weakly-Authenticated FTP Service (Read-only)

Chapter 5: Copying Files with Encp

5.1 Setup encp

5.2 Encp Command Syntax and Usage

5.3 Copy Files to and from Enstore Media

5.3.1 Run encp

5.3.2 Examples

5.4 More about Encp

5.4.1 Preventing Unwanted Overwriting

5.4.2 Killing an encp Job

5.4.3 Isolating Source of Bottlenecks

5.4.4 Encp Error Handling

5.4.5 Finding files in different Enstore systems

5.4.6 Order of Processing Queued Requests

5.4.7 Calculating the CRC of a Local File

5.5 Encp Command Options

Chapter 6: Copying Directory Structures with Ensync

6.1 About Ensync

6.2 Ensync Command Syntax

Chapter 7: Overview of the Enstore Servers

7.1 File Clerk

7.2 Volume Clerk

7.3 Library Manager

7.4 Mover

7.5 Media Changer

7.6 Configuration Server

7.7 Inquisitor

7.8 Alarm Server

7.9 Log Server

7.10 Event Relay

7.11 Monitor Server

7.12 Accounting Server

7.13 Drivestat Server

7.14 Info Server

Chapter 8: Enstore Commands

8.1 enstore info

8.2 enstore library

8.3 enstore monitor

8.4 enstore pnfs

8.5 enstore file (deprecated)

8.6 enstore volume (deprecated)

Chapter 9: Monitoring Enstore on the Web

9.1 Top Page

9.1.1 Enstore System Status Links

9.1.2 Information

9.2 Header Format for Status Pages

9.3 Mass Storage Status-At-A-Glance Page

9.4 Enstore Server Status

9.5 Active File List

9.6 Library Manager Queues

9.6.1 Suspect Volumes

9.6.2 File Reads

9.6.3 File Writes

9.6.4 Additional Movers

9.7 Full Library Manager Info

9.8 Tape Inventory Page (Text)

9.9 Movers Page

9.10 Encp History

9.11 Configuration

9.12 Enstore Active Alarms

9.13 Enstore Log Files

9.14 Quota and Usage

9.15 Enstore Plots

9.16 NGOP Monitoring

9.17 Tape Inventory Page (Dynamic HTML)

Chapter 10: Job Priority and Queue Management

10.1 Job Priority Categories

10.2 Numerical Priority Values

10.3 Fair Share Resource Allotment

10.4 Resource Ownership

Appendix A. Network Control

A.1 Default Routing for Encp

A.2 Routing via the enstore.conf File

Appendix B. Changing PNFS Tags

B.1 Caveat

B.2 Permissions and Ownership

B.3 How to Set a Tag

Appendix C. FTP: Problems in Grid Environment

C.1 Problems with Partial Files

C.2 ACL Timeouts

C.3 Third Party Passive Transfers Impossible

Enstore Glossary

Index

View or print PDF file of chapter | Back to Enstore Doc Home Page | Fermilab Mass Storage System | Computing Division | Fermilab at Work | Fermilab Home