AMASS Overview AMASS Version 5.
Trademark Notice ADIC, AMASS, CentraVision, DAS, DataMgr, FileServ, and VolServ are either trademarks or registered trademarks of Advanced Digital Information Corporation. All other product names and identifications are trademarks or registered trademarks of their respective owners. Copyright Notice © 1996-2002 ADIC® All rights reserved. This document is the property of ADIC.
READER COMMENT FORM ADIC includes this Form in an effort to provide the best possible documentation to our customers. Please take a few moments to mail or FAX your response to: ADIC Technical Publications 8560 Upland Drive Englewood, CO 80112 FAX: 303-792-2465 Email: techdocs@adic.com Question Circle One Information was complete. Agree Disagree Information was easy to find. Agree Disagree Information was easy to follow.
NOTES
Contents Preface Purpose of This Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Who Should Read This Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . How This Book is Organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Accessing Storage Devices Design Maintains Data Integrity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-13 File Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-14 Database Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-14 Library Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-14 Volume Verification . . . . . . . . . . . .
Accessing Storage Devices Accessing the Storage Network 2 Local and Network Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-3 Local Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-3 Network Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-3 Network File System (NFS) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Accessing Storage Devices Index viii Contents 6-00025-01 Rev A
P Preface
AMASS Overview NOTES P-2 Preface 6-00026-01 Rev A
AMASS Overview Purpose of This Book This book provides an introduction or high-level summary of AMASS, ADIC’s Archival Management and Storage System software application. Who Should Read This Book This book is written for prospective customers as well as for the system administrator who will be using and maintaining AMASS.
AMASS Overview Conventions The conventions used throughout the AMASS technical books are listed below: Convention Example The word “library” usually includes “jukebox” and “standalone drive” and is a generic way to reference a storage device. If using HP SunSpot jukeboxes, install patch 1234. Screen text, file names, program names, and commands are in Courier font. Request to add a new volume: Volume group will be “20” Volume position will be “A123” The root prompt is shown as a number symbol.
1 Online Archiving with AMASS
AMASS Overview NOTES 1-2 Online Archiving with AMASS 6-00026-01 Rev A
AMASS Overview Using AMASS to Archive Your Data The Archival Management and Storage System (AMASS) is a management tool for your storage solution. Files are archived to media stored in robotic libraries, jukeboxes, and standalone drives.
AMASS Overview Archive versus Backup and Restore Backup and restore applications are usually an automatically scheduled operation aimed at protecting original data against any kind of loss or damage. The goal of archiving is usually to conserve online storage space. It is more cost effective to store infrequently accessed data on lower cost media. Files Viewed as Online When applications need to read from or write to archived files, the files appear as a single, mounted file system on the UNIX server.
AMASS Overview Documentation Set Overview The figure below provides an overview of an AMASS-managed storage solution and a reference to other books in the AMASS documentation set. For library-specific information, refer to Accessing Storage Devices. Library Offline Media For system requirements and installation steps, refer to Installing AMASS. SCSI-a To use offline media, refer to Managing the AMASS File System.
AMASS Overview Benefits of Using AMASS The management tool for your storage system should provide: • Performance • Data integrity • Ease-of-use • Flexibility The benefits of using AMASS are described in the following table: Topic Database Improves Performance 1-6 Page Database Improves Performance 1-6 Design Prevents Thrashing 1-9 Cache Optimizes Requests 1-9 Virtually Unlimited File System Size 1-10 Design Maintains Data Integrity 1-13 Increased Throughput 1-15 Tools 1-18 Flexib
AMASS Overview The following figure illustrates the concept of how the File System Database maps the file system data to the volumes in the library. Volumes contain “real” data. The File System Database contains metadata, which includes the directory structure, file attributes, media information, and storage information. AMASS File System Database Inodes Inodes Inodes map the metadata to “real” data found on the media.
AMASS Overview Automated Backups via Cron Job Because the File System Database is extremely important, this information must be protected. Consequently, the amassbackup command, run from a cron job, regularly backs up both the Database and the Journal. The Journal is a transaction log of daily activity. This cron job is created when AMASS is installed. The cron job backs up the Database and Journal to a Backup Volume at 3 a.m.
AMASS Overview Design Prevents Thrashing In a storage environment, there are many volumes but only a few drives. If several requests come in for many different volumes, the potential exists for AMASS to spend most of its time moving media in and out of drives and little of its time actually processing requests.
AMASS Overview • Prioritizing reads-from-volumes over writes-to-volumes UNIX Server where AMASS is installed. WRITES are written to cache. UNIX Server READS are cached the same way. Configurable Cache Cache is on the hard disk. From cache, WRITES are written to volumes in the storage device. The cache size can be configured to take advantage of both the application being used and the system environment where AMASS is installed.
AMASS Overview When a volume is full, AMASS automatically selects the next available volume to continue its operations. The volumes that make up AMASS can be subdivided, if desired, into multiple groups called volume groups. Volume Groups Archiving files by projects can be achieved with volume groups by assigning volumes to numerical volume groups to serve a particular subdirectory tree.
AMASS Overview The following figure illustrates these volume groups: Numeric Volume Group Space Pool Cleaning Group Media Verification Volumes can be assigned to a numeric volume group. The group can be a number from 1 through 2047. Volumes can be assigned to the space pool (SP). These are formatted volumes with specific attributes.
AMASS Overview • Allow AMASS to automatically assign a volume from the space pool to the out-of-space volume group. Do this by using the AMASS vgpool command to enable space pool for the specified volume group. For more information on volume groups, refer to Managing the AMASS File System.
AMASS Overview File Recovery Because write operations go to the cache first (including sync, fsync, and synchronous IO), in the event of a system crash, AMASS recovers all write operations that were in the cache and processes the writes to media after the system is rebooted. This paradigm provides a level of data integrity consistent with standard UNIX file systems.
AMASS Overview As an aid in volume verification, the system administrator enters either a bar code or a user-defined label when introducing a volume to the File System Database. At the same time, AMASS assigns the volume a unique numerical ID. From then on, AMASS tracks the volume by this unique identifier and verifies the volume by using either bar codes or headers.
AMASS Overview Scattered writes allows AMASS to use more than one drive to write to volumes in a volume group. For configuration parameters, refer to Installing AMASS. Library Drive1 writes file_A to media. Drive1 Volume Group 6 Drive2 Drive2 writes file_B to media. Enabling scattered writes allows AMASS to use more than one drive to write data to the same volume group. Consequently, performance is improved.
AMASS Overview Tape Streaming Improves Write Performance Streaming tape IO provides a constant flow of data output to a drive, which lessens start and stop operations. This feature typically improves write performance but depends on file size, number of files, and drive type.
AMASS Overview Tools The following tools assist with file system tasks and troubleshooting: Commands The AMASS commands are a set of UNIX-style, command-line interfaces. These commands, as well as standard UNIX commands, help you manage archiving a file system onto media in storage devices. For a description of the AMASS commands and how to use then, refer to Managing the AMASS File System.
AMASS Overview ADIC Scalar 1000 AMASS does not support automatic drive cleaning on the ADIC Scalar 1000 with firmware earlier than level 2.10. Consequently, the Cleaning Mode must be disabled as follows: Step 1. Enter the Main menu by pressing the Escape button on the operator panel. Step 2. Scroll the Main menu using the navigation buttons or Enter . Select the Setup menu by pressing . Step 3. Scroll the Setup menu using the navigation buttons, and select the Cleaning menu by pressing Enter.
AMASS Overview Step 8. Press Escape until you reach the Status Display menu (the initial screen). Flexible AMASS is both drive and library independent thus allowing you to choose the hardware that meets the specific needs of your company. For detailed information, refer to Accessing Storage Devices. Third-party Backup Applications AMASS supports third-party backup and restore applications that access files using standard file system semantics.
AMASS Overview • A network-attached Storage Technology storage device using Automatic Cartridge System Library Software (ACSLS). UNIX Server ACSLS AMASS Mixed media in StorageTek ACSLS library interface Clients During the AMASS installation, configure the unique media types with separate authorization strings. For example, if the AML contains both DLT and 3590 media, define AMASS with an authorization string for DLT JUKEBOX 1 and an authorization string for 3590 JUKEBOX 2.
AMASS Overview Optional Features To enable the following optional features, obtain a unique authorization string from your AMASS sales representative. Enter this alphanumeric string during the installation process.
AMASS Overview The metadata contains the directory structure and media attributes (such as media type, ownership, and timestamp) for a specified volume group. The metadata is located in /usr/amass/filesysdb and is exported as standard ASCII text. Send this file to the target AMASS site using FTP (File Transfer Protocol) or a similar tool. The following figure illustrates these steps: 1. Export metadata that describes specified volume group. AMASS Metadata File Colorado 2.
AMASS Overview The following figure illustrates these steps: Metadata File AMASS 1. Import metadata that describes specified volumes. Texas 2. Load specified volumes. For more information, refer to the Command Reference chapter in Managing the AMASS File System.
AMASS Overview Volume Copy The volcopy command copies data from a source volume to a destination volume. If the original volume is lost, destroyed, or damaged, you can use the duplicate volume exactly like you would the original. AMASS supports volcopy on the following media: • WORM • Rewritable optical • Tape This command copies the Backup Volume as well as all other volumes “known” to the File System Database.
AMASS Overview CD Import Import data from CDs formatted by the standards prescribed by the following: • High Sierra • ISO 9660 • Rockridge (an ISO 9660 format with extensions) Note AMASS does not support writable CDs. For more information, refer to the Command Reference chapter in Managing the AMASS File System. DataMgr 1-26 DataMgr is an ADIC Hierarchical Storage Management (HSM) software package.
AMASS Overview Infinite File Life The Infinite File Life (IFL) optional feature automatically manages volatile media over an extended period. IFL performs the following functions: • Tracks magnetic media, which degenerates over time • Determines the amount of deterioration on each volume • Replaces the media before it becomes unreadable Refer to the AMASS Release Notes for a list of drives that support Infinite File Life (IFL.
AMASS Overview NOTES 1-28 Online Archiving with AMASS 6-00026-01 Rev A
2 Accessing the Storage Network
AMASS Overview NOTES 2-2 Accessing the Storage Network 6-00026-01 Rev A
AMASS Overview Local and Network Access Because AMASS is implemented at the virtual file system (VFS) layer of the server’s operating system, it is transparent to other software programs on the server. Consequently, AMASS as well as the file system mounted under AMASS can be accessed both locally and through a network. Both paths are discussed below. Local Access AMASS appears as a local, single, logical device with a single file system encompassing the entire capacity of the library or volume set.
AMASS Overview AMASS supports NFS by making its file system appear as a mounted local file system to the NFS server. This allows the AMASS file system to be exported in the same manner as the standard local file system is exported. Thus, the AMASS file system or its subdirectories can be mounted, across the network to the client file system, making the AMASS resident files, directories, and storage capacity available as though the AMASS software and its storage devices were running on the client.
AMASS Overview Remote File Copy (RCP) RCP allows the user to do file transfers to and from the AMASS without manually logging onto the remote system. The login function is performed automatically by the RCP utility. In addition, RCP can do recursive copies, which can copy an entire directory structure to or from the target. For the login function to work, the user’s user name must exist on the target system; therefore, coordination of user names must be enforced across the network servers.
AMASS Overview Supported Libraries and Drives AMASS supports a maximum of: • 8 libraries • 256 drives per library • 65,000 volumes AMASS supports the following types of storage devices: • Multiple libraries of the same model in a daisy-chained configuration • Heterogeneous libraries, for example, optical and tape, in a daisy-chained configuration • A library with different drive types so you can mix media; for example, 3590 and DTF media in the same library • Standalone drives For a list of
AMASS Overview The following figure illustrates these connections: Library Jukebox UNIX Application Server RS-232 Jukebox AMASS Standalone Drive Network SCSI Client The following figure illustrates library and drive addresses: The library has its own SCSI or IP address. Each drive has its own SCSI address.
AMASS Overview Fibre Channel Support This release of AMASS has been successfully tested on the following Fibre Channel configurations Fibre Channel SCSI HP Fibre Channel Multiplexer A3511A HP9000 V Series S-class running HP-UX 11.
AMASS Overview AMASS Installed on Platform Multiplexer/Router HP 9000 V series S-class running HP-UX 11.0 with a Fibre Channel PCI SCSI card using an SCTL driver HP Fibre Channel Multiplexer A3511A (SCSI bridge) ADIC Fibre Channel Router (FCR) Model 200 and Model 250.
AMASS Overview NOTES 2-10 Accessing the Storage Network 6-00026-01 Rev A
3 Technical Support
AMASS Overview NOTES 3-2 Technical Support 6-00026-01 Rev A
AMASS Overview Phone Support Depending on how you purchased technical support, telephone support is provided either through your reseller or directly through ADIC. The ADIC Technical Assistance Center (ATAC) in Denver, Colorado provides world-wide service and support. Methods of contacting ATAC are listed below: Training • In the USA and Canada, call 1-800-827-3822. • Outside the USA and Canada, call toll-free 00800-9999-3822. • Send e-mail to: support@adic.
AMASS Overview Books The CD contains the AMASS books as PDF files. The books described below are part of the technical documentation set: AMASS Overview An introduction to AMASS (Archival Management and Storage System). Contains a glossary. Managing the AMASS File System Perform system administrative tasks with AMASS commands and troubleshoot problems with AMASS utilities and scripts.
AMASS Overview Related Publications The publications described in the following table are created and distributed on an as-needed basis: Related Publications Release Notes Description For each version of AMASS, the Release Notes contain: • Summary of enhancements • Describes: - Fixed problems - Known problems 6-00026-01 Rev A Product Alerts Informs customers of technical problems and solutions Product Bulletins Conveys technical information — not problems — to customers Technical Support 3-5
AMASS Overview Secured Web Site To receive access to the secured site on ADIC’s home page containing technical product information (Release Notes, Product Alerts, Product Bulletins, FAQs), visit http://partners.adic.com/ and follow the password request procedure. In return, ADIC will send instructions and a password. Year 2000 Compliant When AMASS is running on Year 2000-compliant operating systems, including systems with Y2k-compliant patches, AMASS is Year 2000 Option 1-compliant.
Glossary Note The terms in this Glossary are used throughout the ADIC UNIX software documentation. Product-specific terms are noted. manipulate AMASS file system metadata (such as, namespace) and media. Using the API is a way for a program to ask AMASS to perform a service unique to your site. appended files A Files that span media. The files are on more than one piece of media, possibly, on more than one library.
AMASS Overview bar code An array of spaces and vertical bars in varying widths in a machine-readable pattern. Media is identified by barcode rather than a physical home storage slot. C cache Bitfile Server component of DataMgr. The BFS maintains storage policies, assigns bitfile IDs, and manages the licensing of clients. All data flows into a central cache located on the UNIX server before being read from or written to media.
AMASS Overview D DAS™ Distributed AML Server. An ADIC software product with both client and server components. The server component is installed on an OS/2 PC and the client component is installed on the same UNIX workstation where AMASS is installed. With DAS, AMASS supports different media types in the same library. DataClass group Migration directories with the same associated data class parameters are in the same DataClass grouping. A FileServ-specific term.
AMASS Overview E file import Ethernet A networking system designed to connect computers that are releatively close together (physically in the same department). The specification has been defined by IEEE Standard 802.3. Other software, such as TCP/IP, runs on top of Ethernet to provide high-level networking services to applications. A DataMgr feature that imports data from a “foreign” archival file system into DataMgr to be archived by AMASS.
AMASS Overview File System Database The File System Database contains tables of attributes—or metadata—representing the directory structure and media mounted under the AMASS file system. The metadata includes: media ID, media type, media location, ownership, and timestamp. The File System Database tells AMASS where data is located on the media archived in your library. The default location in UNIX is in /usr/filesysdb. See also inode and metadata. G GUI Graphical User Interface.
AMASS Overview L IPI Intelligent Peripheral Interface. A high-performance, general-purpose parallel peripheral interface. The intent of the IPI is to isolate the host, both hardware and software, from changes in peripherals by providing a “function generic” command set to allow the connection of multiple types of peripherals (disks, printers, and tapes.) label A tag affixed to media used for identification.
AMASS Overview • Optical • CD metadata Represents the directory structure and attributes about media. Attributes include: • Media ID • Media type • Media location • Ownership • Timestamp The metadata for the AMASS file system resides in the AMASS database. See also File System Database and inode. migration The planned movement of data from one library — and possibly from one type of media — to another.
AMASS Overview nonresident file • A nonresident file is a file whose contents have been migrated to a storage device. The file is nonresident on the client’s machine but DataMgr leaves behind a stub file. Offline Media Manager O optical Types of optical platters are described below: • MO (Magneto Optical) is rewritable optical. It uses both magnets and lasers to write and read data on a plastic disc having a magnetic layer.
AMASS Overview S SMP scattered writes Symmetric Multiprocessing. Making efficient use of multiple processors within a computer. If multiple writes occur to a single volume group, AMASS uses more than one drive to simultaneously write to the volume group. This increases throughput. SCSI Fast/Wide Small Computer System Interface. An intelligent bus-level device interface.
AMASS Overview storage policy DataMgr migrates files using storage policies, including Single Copy, Multi-tier Migration, and File Replication. striping The UNIX operating system allows AMASS to cache data across multiple magnetic disks on the server or across partitions on a single magnetic disk on the server. This feature improves AMASS throughput. AMASS divides the data into segments (stripes) and writes each segment either to multiple disks or to partitions on a disk.
AMASS Overview V • VBS The Virtual Block Server is an AMASS component that emulates a hard disk drive that maps an infinitely large block of space on to physical libraries, drives, and media. Use the GUI to monitor the Virtual Block Server. volume Equivalent to media. See also media. • offline = Media that does not reside in a library. Although AMASS assigned this media a unique volume number and there is an entry for it in the AMASS database, the media may be stored in a vault or on a shelf.
AMASS Overview X XDI eXtensible Device Interface. An AMASS software module that provides a communication interface between AMASS and network-attached storage devices.
Index A C Access local . . . . . . . . . . . . . . . . . . . . . . . 2-3 network . . . . . . . . . . . . . . . . . . . . 2-3 Addresses . . . . . . . . . . . . . . . . . . . . . . 2-7 AMASS . . . . . . . . . . . . . . . . . . . . . . GL-1 benefits. . . . . . . . . . . . . . . . . . . . . 1-6 using. . . . . . . . . . . . . . . . . . . . . . . 1-3 amassbackup Command . . . . . . . . . . 1-8 AML mixed media. . . . . . . . . . . . . . . . 1-20 API . . . . . . . . . . . . . . . . . . . . . . . . . .
AMASS Overview definition . . . . . . . . . . . . . . . . . . GL-3 DataMgr . . . . . . . . . . . . . . . . . 1-26, GL-3 Dead Space . . . . . . . . . . . . . . . . . . . GL-3 DLT . . . . . . . . . . . . . . . . . . . . . . . . . GL-3 DMFS. . . . . . . . . . . . . . . . . . . . . . . . GL-3 Documentation Set. . . . . . . . . . . . . . . 3-4 Drive . . . . . . . . . . . . . . . . 1-3, 2-6, GL-3 cleaning . . . . . . . . . . . . . . . . . . . 1-18 maximum number supported . . . . 2-6 Drive Pool definition . . .
AMASS Overview M P Mailbox . . . . . . . . . . . . . . . . . . . . . . GL-6 Mailslot . . . . . . . . . . . . . . . . . . . . . . GL-9 Media . . . . . . . . . . . . . . 1-3, GL-6, GL-11 less contention . . . . . . . . . . . . . . . 1-7 mixed . . . . . . . . . . . . . . . . . . . . . 1-20 optical. . . . . . . . . . . . . . . . . . . . . GL-8 tape. . . . . . . . . . . . . . . . . . . . . . . 1-25 Metadata. . . . . . . . . . . . . . . . . . 1-7, GL-7 Migration . . . . . . . . . . . . . . . . . . . . .
AMASS Overview SSD . . . . . . . . . . . . . . . . . . . . . . . . . GL-9 Standalone Drives . . . . . . . . . . . . . . GL-9 Storage Area Network . . . . . . . . . . . GL-9 Storage Devices supported . . . . . . . . . . . . . . . . . . . 2-6 Storage Policy . . . . . . . . . . . . . . . . GL-10 file replication . . . . . . . . . . . . . . GL-4 multi-tier . . . . . . . . . . . . . . . . . . GL-7 Streaming Tape . . . . . . . . . . . . . . . . 1-17 Striping. . . . . . . . . . . . . . . . . . . . . .
