01. Archieve 하는법
1
| dsmc archive -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz -sub=yes
|
- ⭐️ 완전중요 ⭐️
- 디렉토리/파일 이름까지 절대 경로로 써줘야함.
- 폴더 전체를 보관하고 싶다면, 꼭 끝이
/ 로 끝나야함. -sub=yes 그래야 directory로 인식 & 내부 파일들까지 archived.
- directory로 업로드 하려면 안에 각 파일 평균 크기가 1GB여야한다. 안그러면 에러나고 안올라감 주의. 압축해서 한 파일로 만들고 올리자.
Average file size of selected files (.0X GB) is below the file size required on the Minerva archive system (1.00 GB).
-description="text" : 뒤에 붙이면 설명도 함께 저장가능-deletefiles : 저장후 원본 삭제. TSM object지우면 영구 손실 가능성 있음. 항상 주의.
👇output
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
| IBM Storage Protect
Command Line Backup-Archive Client Interface
Client Version 8, Release 1, Level 21.0
Client date/time: 03/23/2026 11:34:14
(c) Copyright by IBM Corporation and other(s) 1990, 2023. All Rights Reserved.
Node Name: CHOS14
Session established with server HPCTSM01: Linux/x86_64
Server Version 8, Release 1, Level 21.000
Server date/time: 03/23/2026 11:34:24 Last access: 03/23/2026 11:31:38
Archive function invoked.
ANS1898I ***** Processed 500 files *****
...
ANS1898I ***** Processed 185,500 files *****
03/23/2026 11:44:23 Normal File--> 133,458,605,068 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz [Sent]
Archive processing of '/sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz' finished without failure.
03/23/2026 11:44:23 Total number of objects inspected: 185,983
03/23/2026 11:44:23 Total number of objects archived: 4
03/23/2026 11:44:23 Total number of objects updated: 0
03/23/2026 11:44:23 Total number of objects rebound: 0
03/23/2026 11:44:23 Total number of objects deleted: 0
03/23/2026 11:44:23 Total number of objects expired: 0
03/23/2026 11:44:23 Total number of objects failed: 0
03/23/2026 11:44:23 Total number of objects encrypted: 0
03/23/2026 11:44:23 Total number of objects grew: 0
03/23/2026 11:44:23 Total number of retries: 0
03/23/2026 11:44:23 Total number of bytes inspected: 125.00 GB
03/23/2026 11:44:23 Total number of bytes transferred: 124.30 GB
03/23/2026 11:44:23 Data transfer time: 428.75 sec
03/23/2026 11:44:23 Network data transfer rate: 303,988.99 KB/sec
03/23/2026 11:44:23 Aggregate data transfer rate: 217,935.31 KB/sec
03/23/2026 11:44:23 Objects compressed by: 0%
03/23/2026 11:44:23 Total data reduction ratio: 0.57%
03/23/2026 11:44:23 Elapsed processing time: 00:09:58
|
02. Archive 잘됐는지 확인
1
| dsmc q archive -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz -sub=yes
|
- archive앞에
q (query) 붙여서 확인. 나머지 옵션은 동일하게 작성.
- description 붙여뒀다면 검색도 가능
-description="text*" "*" 뭔 이름으로 저장했는지 헷깔릴때 사용가능
03. 다시 꺼내기 retrieve
1
| dsmc retrieve -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
|
- 이렇게 하면 원래 위치로 꺼내짐
- 이미 같은 이름의 파일이 있으면 overwrite 할지 물어봄
- 다른 위치로 retrieve하고 싶다면
dsmc retrieve -se=chos14 [첫경로 원래경로] [두번째경로 받고 싶은 새경로] 할수 있음
- 폴더면
-sub=yes 넣어야함
04. 지우기
1
| dsmc delete archive -se=chos14 "/sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz"
|
저 이름으로 된 모든 archived file전부 삭제됨.
특정 사본만 지우려면 -pick. 입력하면 사용자한테 어떤버전 지울건지 직접 고르도록한다.
잘못해서 같은 파일 두번이나 archive한 상황.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
| [chos14@li04e04 NYU]$ dsmc q archive -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
IBM Storage Protect
Command Line Backup-Archive Client Interface
Client Version 8, Release 1, Level 21.0
Client date/time: 03/24/2026 13:16:45
(c) Copyright by IBM Corporation and other(s) 1990, 2023. All Rights Reserved.
Node Name: CHOS14
Session established with server HPCTSM01: Linux/x86_64
Server Version 8, Release 1, Level 21.000
Server date/time: 03/24/2026 13:17:07 Last access: 03/24/2026 13:11:08
Size Archive Date - Time File - Expires on - Description
---- ------------------- -------------------------------
130,330,669 KB 03/23/2026 11:36:35 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz 03/23/2032 Archive Date: 03/23/2026
130,330,669 KB 03/24/2026 13:11:08 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz 03/24/2032 Archive Date: 03/24/2026
|
-pick으로 제일 최근 잘못 올린 버전은 지워보자.
1
2
| dsmc delete archive -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz -pick
# -description="Archive Date: 03/24/2026" 추가해서 지울수도 있다
|
그럼 검색후에 새 창에서 어떤 버전 지울건지 물어본다. 숫자로 해당 파일 선택후 enter
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
| Scrollable PICK Window - Archive Delete
# Archive Date/Time File Size File
---------------------------------------------------------------------------------------------------------------------------
1. | 03/24/26 13:11:08 124.29 GB /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
2. | 03/23/26 11:36:35 124.29 GB /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
|
|
|
|
0---------10--------20--------30--------40--------50--------60--------70--------80--------90--------100-------110-------120
<U>=Up <D>=Down <T>=Top <B>=Bottom <R#>=Right <L#>=Left
<G#>=Goto Line # <#>=Toggle Entry <+>=Select All <->=Deselect All
<#:#+>=Select A Range <#:#->=Deselect A Range <O>=Ok <C>=Cancel
pick> 1
|
선택되면 해당줄에 X표시된다. 선택 완료됐으면 O 입력후 enter. 대소문자 상관없음.
1
2
3
4
5
6
| Scrollable PICK Window - Archive Delete
# Archive Date/Time File Size File
---------------------------------------------------------------------------------------------------------------------------
x 1. | 03/24/26 13:11:08 124.29 GB /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
2. | 03/23/26 11:36:35 124.29 GB /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
|
최종 컨펌 문구 뜨고 Y + enter 하면 지워진다.
1
| Archived files will be deleted. Do you wish to proceed? (Yes (Y)/No (N))
|
확인해보면 선택한 버전 지워짐.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
| [chos14@li04e03 NYU]$ dsmc q archive -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz
IBM Storage Protect
Command Line Backup-Archive Client Interface
Client Version 8, Release 1, Level 21.0
Client date/time: 03/24/26 13:27:08
(c) Copyright by IBM Corporation and other(s) 1990, 2023. All Rights Reserved.
Node Name: CHOS14
Session established with server HPCTSM01: Linux/x86_64
Server Version 8, Release 1, Level 21.000
Server date/time: 03/24/26 13:27:19 Last access: 03/24/26 13:24:39
Size Archive Date - Time File - Expires on - Description
---- ------------------- -------------------------------
130,330,669 KB 03/23/26 11:36:35 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz 03/23/32 Archive Date: 03/23/2026
|
당연한 얘기지만 delete하면 되돌릴수 없다
05. 데이터가 크다면, 연결 끊길까봐 걱정된다면
screen 안에서 돌리자
1
2
3
4
5
6
| screen #열고
dsmc archive -se=chos14 /sc/arion/scratch/chos14/NYU/2024Mar_mkfastq.tar.gz -sub=yes -description="text" #돌려놓고
# ctrl + a 후 d 눌러서 detach
# 확인은
screen -r
|
또는 nohup사용
1
2
3
4
5
6
7
| nohup dsmc archive -se=chos14 /sc/arion/scratch/chos14/sysFluR01/UGA4Bulk/fastq/ -sub=yes > ~/dsmc_archive.log 2>&1 &
#실시간으로 로그 확인
tail -f ~/dsmc_archive.log
# 프로세스 살아있는지 확인
ps aux | grep dsmc | grep -v grep
|
06. 진행중인 업로드/다운로드 확인
파일크기가 크다면 background로 자동으로 돌아간다. 확인하고 싶다면
1
2
| dsmc q session -se=chos14
|