Table of Contents

Table of Contents 1

Chapter 1: Introduction to the Mass Storage System 1-1

1.1 About Enstore 1-1

1.2 PNFS Namespace 1-2

1.3 dCache 1-3

1.3.1 Overview 1-3

1.3.2 Advantages 1-4

1.3.3 Protocols for Communicating with dCache 1-4

Chapter 2: Data Storage in Enstore 2-1

2.1 Storage Groups 2-1

2.2 File Organization on Storage Media 2-1

2.2.1 File Family 2-1

2.2.2 File Family Width 2-2

2.2.3 File Family Wrapper 2-2

2.3 File Size Limitations 2-3

2.4 Data Storage Volumes in Enstore 2-4

2.4.1 Tape Features 2-4

2.4.2 File Organization, Storage and Access 2-4

2.4.3 Quantity of Volumes 2-5

2.4.4 Import/Export of Volumes 2-5

Chapter 3: Getting Ready to Use Enstore and dCache 3-1

3.1 Initial Steps for All Users 3-1

3.2 Further Steps for Direct Access Enstore Users Only 3-2

3.3 Installing Encp 3-3

Chapter 4: PNFS Namespace 4-1

4.1 UNIX Commands You can Use in PNFS Space 4-1

4.2 PNFS Limitations 4-2

4.2.1 PNFS Directory Limitations 4-2

4.3 About PNFS Tags 4-2

4.3.1 Tag Listing 4-3

4.3.2 How to View Tags 4-4

Chapter 5: Using the dCache to Copy Files to/from Enstore 5-1

5.1 dCache-Native dCap 5-1

5.1.1 Authentication Mechanisms 5-2

5.1.2 Nodes and Ports 5-2

5.1.3 The dccp Command 5-3

5.1.4 The dc_stage Command 5-3

5.1.5 The dc_check Command 5-4

5.1.6 Syntax and Examples (PNFS Not Mounted Locally) 5-4

5.1.7 Syntax and Examples (PNFS Mounted Locally) 5-4

5.2 Grid (GSI) FTP 5-5

5.2.1 Obtain Grid Proxies 5-5

5.2.2 GSI FTP with globus-url-copy 5-6

5.2.3 Storage Resource Management (SRM) 5-6

5.2.4 X.509 dCap 5-8

5.2.5 GSI FTP with Kftpcp (Deprecated) 5-8

5.3 Simple Kerberized FTP 5-9

5.3.1 Prepare to use Kerberized FTP 5-9

5.3.2 Sample Kerberized FTP session 5-10

5.4 Kerberized FTP via the kftpcp Command 5-10

5.4.1 Syntax and Options 5-11

5.4.2 Download a File 5-11

5.4.3 Upload a File 5-11

5.4.4 Examples 5-11

5.5 Weakly-Authenticated FTP Service (Read-only) 5-12

Chapter 6: Copying Files with Encp 6-1

6.1 Setup encp 6-1

6.2 Encp Command Syntax and Usage 6-2

6.3 Copy Files to and from Enstore Media 6-2

6.3.1 Run encp 6-2

6.3.2 Examples 6-2

6.4 Additional Diagnostic Executables 6-3

6.4.1 ecrc 6-3

6.4.2 ddencp 6-4

6.4.3 en_check 6-5

6.4.4 enmv 6-5

6.5 More about Encp 6-6

6.5.1 Preventing Unwanted Overwriting 6-6

6.5.2 Killing an encp Job 6-6

6.5.3 Encp Transfer Rates Defined 6-6

6.5.4 Isolating Source of Bottlenecks 6-7

6.5.5 Encp Error Handling 6-8

6.5.6 Finding files in different Enstore systems 6-8

6.5.7 Order of Processing Queued Requests 6-9

6.5.8 NULL File Directories 6-9

6.5.9 Important Environment Variables 6-9

6.5.10 Encp Limitations 6-10

6.6 Encp Command Options 6-10

Chapter 7: Copying Directory Structures with Ensync 7-1

7.1 About Ensync 7-1

7.2 Ensync Command Syntax 7-1

Chapter 8: Overview of the Enstore Servers 8-1

8.1 File Clerk 8-1

8.2 Volume Clerk 8-2

8.3 Library Manager 8-2

8.4 Mover 8-2

8.5 Media Changer 8-3

8.6 Configuration Server 8-3

8.7 Inquisitor 8-4

8.8 Alarm Server 8-4

8.9 Log Server 8-4

8.10 Event Relay 8-5

8.11 Monitor Server 8-5

8.12 Accounting Server 8-6

8.13 Drivestat Server 8-6

8.14 Info Server 8-6

8.15 Ratekeeper 8-6

Chapter 9: Enstore Commands 9-1

9.1 enstore info 9-1

9.2 enstore library 9-8

9.3 enstore monitor 9-10

9.4 enstore pnfs 9-11

9.5 enstore file (deprecated) 9-17

9.6 enstore volume (deprecated) 9-19

Chapter 10: Monitoring Enstore on the Web 10-1

10.1 Top Page 10-1

10.1.1 Enstore System Status Links 10-2

10.1.2 Information 10-2

10.2 Header Format for Status Pages 10-3

10.3 Mass Storage Status-At-A-Glance Page 10-4

10.4 Enstore Server Status 10-6

10.5 Active File List 10-10

10.6 Library Manager Queues 10-11

10.6.1 Suspect Volumes 10-12

10.6.2 File Reads 10-12

10.6.3 File Writes 10-13

10.6.4 Additional Movers 10-14

10.7 Full Library Manager Info 10-14

10.8 Tape Inventory Page (Text) 10-16

10.9 Movers Page 10-18

10.10 Encp History 10-20

10.11 Configuration 10-21

10.12 Enstore Active Alarms 10-23

10.13 Enstore Log Files 10-24

10.14 Quota and Usage 10-27

10.15 Enstore Plots 10-28

10.16 Tape Inventory Page (Dynamic HTML) 10-29

Chapter 11: Job Priority and Queue Management 11-1

11.1 Job Priority Categories 11-1

11.2 Numerical Priority Values 11-2

11.3 Fair Share Resource Allotment 11-2

11.4 Resource Ownership 11-2

Appendix A. Network Control A-1

A.1 Default Routing for Encp A-1

A.2 Routing via the enstore.conf File A-1

Appendix B. Changing PNFS Tags B-1

B.1 Caveat B-1

B.2 Permissions and Ownership B-1

B.3 How to Set a Tag B-2

Appendix C. FTP: Problems in Grid Environment C-1

C.1 Problems with Partial Files C-1

C.2 ACL Timeouts C-1

C.3 Third Party Passive Transfers Impossible C-2

Enstore Glossary 1

Index 1