URL: https://it.desy.de/services/backup___restore/central_backup/faq/index_eng.html
Breadcrumb Navigation
Frequently Asked Quiestions
For additional information, please contact the tsm.service@desy.de
- How to register a new node?
- TSM Klient-Packages: Where are those?
- Linux: How to install and update the TSM client?
- SUSE: How to start the client scheduler (dsmcad) on boot of the system?
- Windows: How to install and update the TSM client?
- Mac: How to install and update the TSM client?
- Mac: Example of DSM.SYS, DSM.OPT
- Mac: Use of Tivoli Storage Manager classic scheduler dsmc sched
- Solaris-Sparc: How to install and update the TSM client?
- Solaris x86: How to install and update the TSM client?
- Which filesystems exist (are configured for backup) on the server?
- How to specify the filesystems/volumes for backup?
- How to backup a directory which is not a mountpoint?
- What is the difference between archiving and backup of files?
- How to change the password for the client node?
- How long will the data be saved?
- How to store files with special characters in the name(e.g. Umlaute)?
- When does the next planned backup start?
- Which files are stored?
- How to exclude some files or directories from the backup?
- Datensicherung startet nicht. Woran liegt es?
- How to restore stored AFS files from the TSM-backup?
- How to restore backuped data?
TSM packages for several OS are listed under software.
Installing TSM on Ubuntu
The TSM packages for Ubuntu 14.04 and upwards are located in the DESY ASG repository for Ubuntu.
A new component "tsm" has been created, which contains the IBM TSM packages and a metapackage.
1. Create a new sources.list with the following content:
$ vi /etc/apt/sources.list.d/tsm.list
deb http://nims.desy.de/extra/desy/ trusty tsm
deb-src http://nims.desy.de/extra/desy/ trusty tsm
2. Add DESY GPG Apt key (Fingerprint: 0C81 0EC0 C0C7 E422 2B93 5FD2 0E60 CA79 4E76 CE0E)
$ wget http://nims.desy.de/extra/desy/DESY-Debian-key.asc
$ apt-key add DESY-Debian-key.asc
3. Update the repository sources
$ aptitude update
4. Install the TSM metapackage, which installs all required packages
$ aptitude install tsm
5. Configure TSM on your machine by editing the configuration in /etc/tsm
6. Enable dsmcad to start on boot
$ update-rc.d dsmcad defaults
Updating TSM on Ubuntu
1. apt upgrade tsm
Installing TSM on SL5/6 or el7 64 bit:
1. yum groupinstall tsm --enablerepo=desy-tsm
2. Eidt /etc/tsm die dsm.opt(domain) und dsm.sys(nodename)
3. dsmc q fi
"Please enter your user id node_name: enter
"Please enter password for user id "node_name": enter the initial TSM password(ask your TSM-Admin)
4. /etc/init.d/tsm-sched start(nur fuer 32 bit) sl 5/6
service dsmcad start(fuer 64 bit) sl5/6
5. for EL 7 after install :
service dsmcad stop
chkconfig --del dsmcad
rm /etc/init.d/dsmcad
If the dsmcad.service file doesn't exist in /etc/systemd/system/ please copy the file from
/opt/tivoli/tsm/client/ba/bin/dsmcad.service to /etc/systemd/system .
service dsmcad start
systemctl restart dsmcad.service
Update TSM on SL5/6 or el7 64 bit:
1. yum groupupdate tsm
Contact E-Mail: tsm.service@desy.de.
After the node registration:
dsmc set password
Copy the /afs/desy.de/products/source/tsm6/linux/SUSE/tsm-sched script
into the /etc/init.d directory on the SUSE-system.
chmod 744 /etc/init.d/tsm-sched
chkconfig --add tsm-sched
chkconfig --list tsm-sched (just to be sure)
For further information please refer to: the IBM pages.
Start Backup-Archive GUI
Choose Task: Create a new option file; Next
TSM Client Node NAme: "TSM-NodeName"; Next
TSM Client/Server Communications: TCP/IP; Next
TSM Server Address: itsm-w03 (Contact the TSM Admin)
TSM Server Port Number: 1503(Contact the TSM Admin); Next
Recommended Include/Exclude List: Select All; Next
Please select from the list the file types you wish to be excluded; Next
Backup Type: Incremental
Specify which file systems to include in your client domain: C:(\\zitpcx20809\c$); Next
Confirm and Apply
Enter TSM Password
Automatical Start TSM GUI
Utilities->Setup Wizard
Help me configure the TSM Client Scheduler; Next
Install a new or additional scheduler; Next
Type a naem for the client scheduler: TSM Scheduler Name
Use the Client Acceptor deamon: check in; Next
Enter TSM acceptor name; Next
Specify the options file that TSM should use: C:\Program Files\Tivoli\TSM\baclient\dsm.opt; Next
Type the TCP/IP port address to use to communicate with the Web client acceptor: 1581; Next
Type the initial password for your node: (contact the TSM Admin)
Select: Contact the TSM Server to validate password; Next
Service login options -> The System account
Service login options -> Automatically when Windows boots; Next;
Specify the file names and locations of your client schedule log and error log files; Next
Start Option -> Would you like to start the service upon completion of this wizard?: Yes; Next
Apply; Finish
Allow IBM Tivoli Storage Manager Agent Client, IBM Tivoli Storage CAD Client(dsmcad.exe) to communicate through Windows Firewall.
The configuration file: C:\Program Files\Tivoli\TSM\baclient\dsm.opt has to contain a line:
PASSWORDACCESS GENERATE
Please install the current TSM package from the AFS directory:
7.1.8.0-TIV-TSMBAC-Mac.dmg
In:
/afs/desy.de/products/source/tsm/Mac/
are located excample dsm.opt and dsm.sys filesi, both shall be copied to:
/Library/Preferences/Tivoli\ Storage\ Manager/
after intallation of the software.
Please change the servername, tcpserveraddress and tcpport according to the received information.
Please configure also the domains (directories which are to be backuped): See 'How to specify the filesystems/volumes for backup?' in the FAQ.
Start dsmcad.
The path:
/Library/Preferences/Tivoli\ Storage\ Manager/dsm.sys
SERVERNAME name
MEMORYEFFICIENTBACKUP diskcachem
MANAGEDSERVICES NONE
SCHEDLOGRETENTION 30 S
WEBPORTS 1548,1549
ERRORLOGRETENTION 30 S
PASSWORDACCESS GENERATE
QUERYSCHEDPERIOD 6
NODENAME substitute_node_name
TCPSERVERADDRESS substitute_tcpserveraddress.desy.de
TCPPORT tcpport_number
EXCLUDE "/.../dsmsched.log"
EXCLUDE "/.../dsmprune.log"
EXCLUDE "/.../dsmerror.log"
EXCLUDE "/.../dsmj.log"
EXCLUDE "/.../.hotfiles.bTree"
EXCLUDE.DIR "/private/tmp"
EXCLUDE.DIR "/private/var/vm"
EXCLUDE.DIR "/private/var/tmp"
EXCLUDE.DIR "/.../.fseventsd"
EXCLUDE.DIR "/.../.Trashes"
EXCLUDE.DIR "/.../.Spotlight-V100"
EXCLUDE.DIR "/.../Library/Caches"
EXCLUDE.DIR "/Users/.../Library/Caches"
EXCLUDE.DIR "/private/var/db/netinfo/local.nidb"
EXCLUDE.DIR "/.../Backups.backupdb"
Path:
/Library/Preferences/Tivoli\ Storage\ Manager/dsm.opt
SERVERNAME substitute_server_name
DATEFORMAT 3
NUMBERFORMAT 4
DOMAIN "/PATH1/NAME1"
DOMAIN "/PATH2/NAME2"
TESTFLAG MACSKIPFSPERMISSION
In case of problems with dsmcad (Client Acceptor Daemon, the recommended Tivoli Storage Manager client scheduler for the Macintosh platform), one can use the classic scheduler.
The classisc scheduler can be started on the command line of every Mac-system.
Mac:~ Administrator$ sudo su -
Password:
Mac:~ root#
Important are two options:
MANAGEDSERVICES NONE and PASSWORDACCESS GENERATE
In the GUI to be configured like:
TSM tools for Administrators -> Tivoli Storage Manager
(enter administrator password)
Edit -> Client Preferences
Web Client tab
Important: the schedule box is _NOT_ checked.
PASSWORDACCESS GENERATE
Oder in der GUI
Edit -> Client Preferences
Authorization tab
"Password Generate" checked.
Add or change in /Library/Preferences/Tivoli\ Storage\ Manager/dsm.sys file:
MANAGEDSERVICES NONE
PASSWORDACCESS GENERATE
Mac:/Library/Application Support/tivoli/tsm/client/ba/bin root# ./dsmc
IBM Tivoli Storage Manager
Command Line Backup/Archive Client Interface
Client Version 5, Release 5, Level 0.0
Client date/time: 11/24/2009 07:04:12
(c) Copyright by IBM Corporation and other(s) 1990, 2009. All Rights Reserved.
Node Name: MACNODE
Please enter your user id
Please enter password for user id "MACNODE":
Session established with server TSM_SERVER: AIX
Server Version 6, Release 1, Level 2.1
Server date/time: 11/24/2009 08:04:09 Last access: 11/24/2009 08:04:09
tsm> quit
Afterwards one can start the classisc scheduler in the background:
# cd /Library/Application\ Support/tivoli/tsm/client/ba/bin/
# nohup ./dsmc sched > /dev/null 2>&1 &
The scheduler-output is /Library/Logs/tivoli/tsm/dsmsched.log
To start the scheduler during the boot process:
OSX 10.4, 10.5, 10.6:
As root user:
# crontab -e
Enter the lines:
@reboot cd /Library/Application\ Support/tivoli/tsm/client/ba/bin/ ; ./dsmc sched > /dev/null 2>&1
OSX 10.4, 10.5:
Create an entry in /etc/rc.local with the content:
/Library/Application\ Support/tivoli/tsm/client/ba/bin/dsmc sched > /dev/null 2>&1
(Important: from OSX 10.6 on, the rc.local method is not supported anymore)
Installation (new)
mkdir /tmp/tsm
cd /tmp/tsm/
scp -p username@pal:/afs/desy.de/products/source/tsm6/solaris/tar/tsm.solaris.desy.tar /tmp/tsm/
tar -xvf tsm.solaris.desy.tar
./desy.dsminst-solaris u solaris_node noint
If the node is an AFS-Host:
/afs/desy.de/products/source/tsm6/solaris/desy.dsminst-solaris u solaris_node noint
Questions during installation process:
Please enter your user id node_name: enter
Please enter password for user id "node_name": the initial TSM-Password (like received from the TSM-Admin)
After the sucessfull initialisation:
dsmc set password
Update:
scp -p username@pal:/afs/desy.de/products/source/tsm6/solaris/tar/tsm.solaris.desy.upd.tar /tmp/tsm/
tar -xvf tsm.solaris.desy.upd.tar
./desy.dsm-solaris-upd
Installation (new):
mkdir /tmp/tsm
cd /tmp/tsm/
scp -p username@pal:/afs/desy.de/products/source/tsm6/solaris_x86/tar/tsm.solaris_x86.desy.tar /tmp/tsm/
tar -xvf tsm.solaris_x86.desy.tar
./desy.dsminst-solaris_x86 u solaris86_node_name noint
If the node is an AFS-Host:
/afs/desy.de/products/source/tsm6/solaris_x86/desy.dsminst-solaris_x86 u node_name noint
Questions during installation process:
Please enter your user id node_name: enter
Please enter password for user id "node_name": the initial TSM-Password (like received from the TSM-Admin)
After the sucessfull initialisation:
dsmc set password
Update:
scp -p username@pal:/afs/desy.de/products/source/tsm6/solaris_x86/tar/tsm.solaris_x86.desy.upd.tar /tmp/tsm/
tar -xvf tsm.solaris_x86.desy.upd.tar
./desy.dsm-solaris_x86-upd
A backup for certain files or volumes can be specified with:
dsmc incr -domain="/ /usr"
The filesystems can also be configured in "dsm.opt".
domain / /usr
If the domain are not configured in "dsm.opt" and the
dsmc incr
is issued, all local filesystems will be backuped.
In case a directory is not a mountpoint, additionally to the entry in "dsm.opt" an entry in "dsm.sys" as "virtualmountpolnt" should be configured.
In dsm.opt:
Domain /home/user_name/dir
In dsm.sys:
virtualmountpoint /home/user_name/dir
Der TSM allows also to archive files.
Unlike the backup, an archive is always a unique file that is equipped with information.
In contrast to the backup, there is no versioning and a defined deletion time of the file, which depends on the selected management class.
The file is removed from the system on the defined release date.
Example output of :
dsmc q mgmt
Command | Functionality |
---|---|
dsmc archive {pfad/datei/en} [-archmc=<archclass>][-description="Archiv Test 2012" ] |
Archive files ( archmc = mgmtclassname ; desription default = date of day) |
dsmc retrieve {pfad/datei/en} [-description="Archiv Test 2012" ] | Retrieve files |
dsmc q ar {pfad/datei/en} [-fromdate=2010/08/01] | Show files |
dsmc delete archive {datei/en} | Delete files |
dsmc q ar subdir=yes {datei} | Search files |
dsmc q mgmt | Show valid <archclass> definitions |
Linux:
open a terminal
/usr/bin/dsmc set password
Windows:
press the start-button and r
type in / copy into the Run-window:
C:\Program Files\Tivoli\TSM\baclient\dsmc set password
dsmc q mgmt -det
The first part of the output contains the name of the used "Default Mgmt Class Name". The block with this "MgmtClass Name"name"" contains along other information:
Versions Data Exists - how many versions of the files are to be stored, as long as a current file exists.
Versions Data Deleted - up to how many versions of a file shall be stored, if no current file exists any more.
Retain Extra Versions - how long shall inactive versions of a file be stored.
Retain Only Version - how long shall the last version of an inactive file be stored, after the last active version ceased to exist.
The filenames shall be created with character set ISO-8859-15.
The environment variables shall be set to::
export LANG=de_DE
export LC_CTYPE=de_DE
- only the active versions:
dsmc q ba "/home*"
- all stored files:
dsmc q ba "/home*" -ina
- all active versions in a directory:
dsmc q ba "/home*" -subdir=no
- with details:
dsmc q ba file_name -ina -det
- all archived files in current version:
dsmc q archive "*"
- for mor eoptions:
dsmc help q
To view inactive files in the graphical interface, the view has to be changed:
choose in 'View': 'Display active/inactive files'
Use braces in a file path specification within a query or restore/retrieve to isolate and explicitly identify the file space name (or virtual mount point name) to TSM in cases where there can be ambiguity. For example: If you have two filespaces "/a" and "/a/b" and want to query "/a/b/somefile" from the /a file system, specify "{/a/}somefile".
dsmc q ba {/a/}somefile
To exclude some files or directories from beeing stored, configure this in the file "inclexcl".
The path for the "inclexl"-file is stored in dsm.sys.
exclude /.../*.tmp
exclude.dir /tmp
On Windows this is configured in the file: "dsm.opt".
The:
dsmc q inclexcl
shows a list of include / exclude-clauses in the storage sequence.
The date format depends on the settings in your operation system. To ensure the same format, you can use as first option "-date=4" for the format DD.MM.YYYY:
tsm> rest -date=4 -ina -pitdate=21.07.2004 /afs/desy.de/user/a/anyuser/x.cpp
or insert the option:
dateformat 4
into: /etc/tsm/dsm.opt
following examples works only on afs systems with dsmc_afs :
- simple file restore to another destination:
tsm> restore /afs/desy.de/user/a/anyuser/target.html /afs/desy.de/user/a/anyuser/destination.html
- simple file restore, with replace option:
tsm> restore -rep=yes /afs/desy.de/user/a/anyuser/show.html
- selection menue of old file versions:
tsm> restore -inactiv -pick /afs/desy.de/user/a/anyuser/exp.cmz
- restore old file version with date limit:
tsm> rest -ina -pitdate=2004.07.01 /afs/desy.de/user/a/anyuser/x.cpp
- restore old file version with specific date, from which you want to search for backup copies. Files that were backed up before this date and time are not included
tsm> rest -ina -pick -fromdate=2004.07.01 /afs/desy.de/user/a/anyuser/x.cpp
- restore old file version with specific date range:
tsm> rest -ina -fromdate=2010.04.21 -tod=2010.05.05 "/afs/desy.de/user/a/anydir/*"
- restore old directory version, with date limit and replace data:
tsm> restore -ina -rep=yes -subdir=yes -pitdate=2004.07.01 /afs/desy.de/user/a/anyuser/tesla/
- use braces in a file path specification within a query or restore/retrieve to isolate and explicitly identify the file space name (or virtual mount point name) to TSM in cases where there can be ambiguity. For example: If you have two filespaces "/a" and "/a/b" and want to query "/a/b/somefile" from the /a file system, specify "{/a/}somefile".
tsm> restore {/a/}somefile
How to restore from any local TSM/ADSM node to start the TSM GUI:
dsm in older TSM Versions, in newer use dsmj
press the Restore button and select your file.
Alternatively you can restore a specific file under the current pwd via TSM CLI (command-line interface).
A simple restore example:
dsmc restore scan.tex
How to restore an AFS file (user or group) quick from the ~/.OldFiles/ directory or from the DESY AFS TSM GUI via:
dsm_afs (or /products/adsm/bin/dsm_afs)
Press the Restore button and select your file, or with the DESY AFS TSM CLI (command-line interface).
Examples:
dsmc_afs restore /afs/desy.de/user/a/anyusername/.netscape/bookmarks.html
(for all inactive files in the directory)
dsmc_afs restore -ina "/afs/desy.de/user/a/anyuser/directory/*"
ATTENTION: only such AFS files which are readable by system:administrators will be stored in the TSM backup node AFSFILE. AFS setacl example:
fs setacl -dir private -acl system:administrators rlidwka<
A detailed description with screenshots and informationen on the TSM/ADSM-V5- backup can be found at:
Backup TSM/ADSM
Backup for data in the WINDOWS 7/XP home directory/ Outlook User
Restore Windows XP/Windows 7 files on the WIN domain: please use "Previous Versions" on your directory.
Shadow copy help: ShadowCopy.doc
Restore older Windows files from the WIN domain, please send a request via email to windows
Restore a Zimbra INBOX file or folder files please send a request via email to mailmaster
Exceptions from Backup
There are some exceptions where a backup is normally not useful. E.g. temporary files, cach directories of applications and logfiles that are changing, and directories which have been exempted in compliance with the group administrators.
For any kinds of questions: please contact the UCO