IBM Spectrum Archive: Difference between revisions

From Leo's Notes
This page was last edited on 3 February 2020, at 19:36.
← Older editNewer edit →
VisualWikitext
Created page with " == Usage == The {{code|ltfs*}} binaries are typically installed at {{code|/opt/ibm/ltfsee/bin/}} and are provided by the {{code|ltfs-*.rpm}} RPM packages. You will most lik..."
Line 15: Line 15:


=== Tapes ===  
=== Tapes ===  
All tape related usage.
To show all tape drives:
 
To show all drives:
{{highlight|lang=terminal|code=
{{highlight|lang=terminal|code=
[root@ltfs ~]# ltfsee info drives
[root@ltfs ~]# ltfsee info drives
Line 27: Line 25:




{{code|ltfsee info tapes}} shows all tapes all libraries.


To show all tapes in the library, use {{code|ltfsee info tapes}}. Tape status description available at https://www.ibm.com/support/knowledgecenter/ST9MBR_1.2.6/ltfs_ee_ltfsee_info_tapes.html.
{{highlight|lang=terminal|code=
{{highlight|lang=terminal|code=
[root@ltfs ~]# ltfsee info tapes
[root@ltfs ~]# ltfsee info tapes
Line 54: Line 52:
{{code|ltfsee pool remove -p TIERED1 -t $tape -r}}  
{{code|ltfsee pool remove -p TIERED1 -t $tape -r}}  


'''TODO''': When removing, how does that affect replicas?
If a tape is in a drive, you can move it back to its homeslot using {{code|ltfsee tape move homeslot -t tape -p pool}}:
{{highlight|lang=terminal|code=
# ltfsee tape move homeslot -t T00037L8 -p TIERED1
GLESL373I(00890): Moving tape T00037L8.
Tape T00037L8 is unmounted because it is inserted into the drive.
Tape T00037L8 is moved successfully.
}}


TODO: When removing, how does that affect replicas?
Alternatively, use {{code|ieslot}} to move it to the IO port of the tape library for extraction.


=== LTFS Information ===
=== LTFS Information ===

Revision as of 19:36, 3 February 2020


Usage

The ltfs* binaries are typically installed at /opt/ibm/ltfsee/bin/ and are provided by the ltfs-*.rpm RPM packages.

You will most likely interface with LTFS using the ltfsee command.


LTFS Library Status

[root@ltfs ~]# ltfsee status
Ctrl Node     MD      MMM     Library
172.26.3.249  Active  Active  T_ARCH

Tapes

To show all tape drives: 

[root@ltfs ~]# ltfsee info drives
Drive S/N   Status   Type  Role  Library  Address  Node ID  Tape      Node Group
0007807A4B  In use   LTO8   mrg  T_ARCH   260      4        T00031L8  G0        
0007807A0B  Mounted  LTO8   mrg  T_ARCH   261      4        -         G0        
000780765B  In use   LTO8   mrg  T_ARCH   262      4        T00054L8  G0


To show all tapes in the library, use ltfsee info tapes. Tape status description available at https://www.ibm.com/support/knowledgecenter/ST9MBR_1.2.6/ltfs_ee_ltfsee_info_tapes.html. 

[root@ltfs ~]# ltfsee info tapes
Tape ID   Status       Type  Capacity(GiB)  Used(GiB)  Free(GiB)  Reclaimable(GiB)  Pool     Library  Address  Drive       Appendable
T00000L8  Valid        L8            10907          0      10907                 0  TIERED1  T_ARCH   1161     -           yes       
T00001L8  Valid        L8            10907          0      10907                 0  TIERED1  T_ARCH   1160     -           yes       
T00003L8  Valid        L8            10907          0      10907                 0  TIERED1  T_ARCH   1158     -           yes       
T00004L8  Valid        L8            10907          0      10907                 0  TIERED1  T_ARCH   1157     -           yes
Tape Types
Tapes that end with L8 are LTO-8.


If drives are in use, you can list all jobs to see what is actually being done. 

[root@ltfs ~]# ltfsee info jobs
Job Type         Status       Idle(sec)  Scan ID     Tape      Pool     Library  Node  File Name or inode
Reclaim(Source)  In-progress     573811  2944737025  T00031L8  TIERED1  T_ARCH      4  -                 
Reclaim(Target)  In-progress     573683  2944737281  T00054L8  TIERED1  T_ARCH      4  -                 
Validate         Unscheduled       4469  1602429441  T00054L8  TIERED1  T_ARCH      -  -

To add tapes to a particular pool, use ltfsee pool add -p pool -t tape ...: ltfsee pool add -p TIERED1 -t $tape -t $tape2 ...

To remove tapes from a particular pool, use ltfsee pool remove -p pool -t tape ...: ltfsee pool remove -p TIERED1 -t $tape -r

TODO: When removing, how does that affect replicas?

If a tape is in a drive, you can move it back to its homeslot using ltfsee tape move homeslot -t tape -p pool: 

# ltfsee tape move homeslot -t T00037L8 -p TIERED1
GLESL373I(00890): Moving tape T00037L8.
Tape T00037L8 is unmounted because it is inserted into the drive.
Tape T00037L8 is moved successfully.

Alternatively, use ieslot to move it to the IO port of the tape library for extraction.

LTFS Information

ltfsee info pools shows all pools. 

Pool Name  Total(TiB)  Used(TiB)  Free(TiB)  Reclaimable(TiB)  Tapes  Type  Library  Node Group
TIERED1         644.3       84.6      559.7               0.0     61  LTO   T_ARCH   G0        
TIERED2         638.9       80.8      558.1               0.0     61  LTO   T_ARCH   G0


ltfsee info libraries shows all libraries with LTFS. 

[root@ltfs ~]# ltfsee info libraries 
Library Name  Status  Model     Serial Number     Ctrl Node   
T_ARCH        Active  03584L32  0000078BA6130402  172.26.3.249


Show Tiered Files

When files are tiered to tape, the full path of the file is stored in a database as 'migrated'. You can find a file's tiered tape cartridge using ltfsee info files -f filepath. Eg:

Files that are 'migrated' or tiered off to tape. Files not migrated are 'resident' and resides on spinning disk.

Example output below shows tape ID @ library for files migrated 

# ltfsee info files -f /tiered/ewang_scratch/xuexu/dbgap_UK_OTTO/SRR302*
Name: /tiered/ewang_scratch/xuexu/dbgap_UK_OTTO/SRR3021220_2.fastq
Tape id:-          Status: resident
Name: /tiered/ewang_scratch/xuexu/dbgap_UK_OTTO/SRR3021242_1.fastq
Tape id:T00042L8@T_ARCH:T00102L8@T_ARCH Status: migrated
Name: /tiered/ewang_scratch/xuexu/dbgap_UK_OTTO/SRR3021288_1.fastq
Tape id:T00055L8@T_ARCH:T00107L8@T_ARCH Status: migrated
Side Notes on Migrated Files
Migrated files will have a stub file with zero size. To count sizes with du, you need to use --apparent-size Eg. 
[root@node001 xuexu]# du -sh dbgap_UK_OTTO
23T	dbgap_UK_OTTO

[root@node001 xuexu]# du -sh --apparent-size dbgap_UK_OTTO
35T	dbgap_UK_OTTO 

[root@node001 dbgap_UK_OTTO]# du SRR3021288_2.fastq
0	SRR3021288_2.fastq

[root@node001 dbgap_UK_OTTO]# du -sh --apparent-size SRR3021288_2.fastq
15G	SRR3021288_2.fastq



Troubleshooting

Logging

LTFS logs are located at /var/log/ltfsee.log.

Additional logs worth investigating:

  • /opt/tivoli/tsm/client/hsm/bin/dsmerror.log

Tasks

Cronjobs

The following cronjob is installed. 

# Cron Job Used to Move Data Via policy to LTFS Tape at 1:00 AM
00 1 * * * /mmpolicies/movetogpfs1.sh 
# Cron Job Used to Move Data Via policy to LTFS Tape at 3:00 AM
00 3 * * * /mmpolicies/movetogpfs0.sh 
# Cron Job Used to Reconcile disk data with LTFS Tape data Pool TIERED1
00 20 * * * /opt/ibm/ltfsee/bin/ltfsee reconcile -p TIERED1 -l T_ARCH -g /tiered
# Cron Job Used to Reconcile disk data with LTFS Tape data Pool TIERED2
00 22 * * * /opt/ibm/ltfsee/bin/ltfsee reconcile -p TIERED2 -l T_ARCH -g /tiered
# Cron Job Used to Reclaim LTFS Tape data in Pool TIERED1
00 5 * * sun /opt/ibm/ltfsee/bin/ltfsee reclaim -p TIERED1 -l T_ARCH
# Cron Job Used to Reclaim LTFS Tape Data in Pool TIERED2
00 7 * * sun /opt/ibm/ltfsee/bin/ltfsee reclaim -p TIERED2 -l T_ARCH


See Also