SQream Database Upgrade (v2022.1.2 to v2022.1.2.1)

@ 테스트 환경
CPU : Intel® Core™ i7-11600H 2.9GHz
RAM : 32GB
HDD : 512GB SSD(M.2, NVMe)
GPU : NVIDIA RTX 3050 Ti GDDR6 4GB
OS : CentOS Linux release 7.9.2009 (Core)

DB : v2022.1.2.1

 

1. 임의 디렉터리에 업로드한 SQream Database 설치파일의 압축을 해제합니다.

[sqream@nt761xda /home/sqream/product/03_sqream]$ cd

[sqream@nt761xda /home/sqream]$ cd /home/sqream/product/03_sqream

[sqream@nt761xda /home/sqream/product/03_sqream]$ ls -rlt
합계 1494348
-rw-r--r-- 1 sqream sqream       496 11월  2 12:33 license.enc
-rw-r--r-- 1 sqream sqream 765101315 11월  2 13:17 sqream-db-v2022.1.2.1.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar.gz
-rw-r--r-- 1 sqream sqream 765103999 11월  2 13:18 sqream-db-v2022.1.2.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar.gz

[sqream@nt761xda /home/sqream/product/03_sqream]$ gzip -d sqream-db-v2022.1.2.1.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar.gz

[sqream@nt761xda /home/sqream/product/03_sqream]$ ls -rlt
합계 2891008
-rw-r--r-- 1 sqream sqream        496 11월  2 12:33 license.enc
-rw-r--r-- 1 sqream sqream 2195281920 11월  2 13:17 sqream-db-v2022.1.2.1.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar
-rw-r--r-- 1 sqream sqream  765103999 11월  2 13:18 sqream-db-v2022.1.2.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar.gz

[sqream@nt761xda /home/sqream/product/03_sqream]$ tar xvf sqream-db-v2022.1.2.1.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar
......

[sqream@nt761xda /home/sqream/product/03_sqream]$ ls -rlt
합계 2891008
-rw-r--r--  1 sqream sqream        496 11월  2 12:33 license.enc
-rw-r--r--  1 sqream sqream 2195281920 11월  2 13:17 sqream-db-v2022.1.2.1.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar
-rw-r--r--  1 sqream sqream  765103999 11월  2 13:18 sqream-db-v2022.1.2.cpu-generic.pascal.cuda-10.1.el7.centos.x86_64.tar.gz
drwxrwxr-x 10 sqream sqream        145 11월  2 13:20 sqream

2. 압축을 해제한 SQream Database의 디렉터리의 위치 및 이름을 변경합니다.

[sqream@nt761xda /home/sqream/product/03_sqream]$ mv sqream /home/sqream/SQREAM/sqream-db-v2022.1.2.1

[sqream@nt761xda /home/sqream/product/03_sqream]$ ls -rlt /home/sqream/SQREAM
합계 0
drwxrwxr-x 10 sqream sqream 145 10월 27 18:31 sqream-db-v2022.1.2
drwxrwxr-x  2 sqream sqream  25 10월 27 18:37 sqream_license
lrwxrwxrwx  1 sqream sqream  19 10월 27 18:44 sqream -> sqream-db-v2022.1.2
drwxrwxr-x  3 sqream sqream  22 10월 27 18:54 sqream_cluster
drwxrwxr-x  3 sqream sqream  17 10월 27 19:53 sqream_config
drwxrwxr-x  3 sqream sqream  23 10월 29 22:36 logs
drwxrwxr-x  5 sqream sqream 102 10월 30 23:54 sqream-admin-5.4.4
drwxrwxr-x  5 sqream sqream  80 11월  1 21:32 prometheus
drwxrwxr-x  7 sqream sqream 242 11월  1 22:16 sqream-dashboard
drwxrwxr-x  5 sqream sqream 102 11월  2 09:11 sqream-admin
drwxrwxr-x  3 sqream sqream 152 11월  2 12:31 sqream_script
drwxrwxr-x 10 sqream sqream 145 11월  2 13:20 sqream-db-v2022.1.2.1

 

3. SQream Database에 접속하여 현재 버전과 Delete Predicates를 확인합니다.

[sqream@nt761xda /home/sqream/product/03_sqream]$ sqream sql --database=master --username=sqream --password=sqream --host=127.0.0.1 --port=3108 --clustered --trim-varchars
Interactive client mode
To quit, use ^D or \q.

master=> select show_version();
v2022.1.2
1 row
time: 0.184754s

master=> SELECT * FROM sqream_catalog.delete_predicates;
0 rows
time: 0.169508s

 

4. Upgrade 전, 현재 SQream Database의 metadata_server를 백업합니다.

master=> SELECT backup_metadata('/home/sqream/SQREAM/sqream_cluster/sqreamdb/leveldb_2022.1.2_20221103');
executed
time: 0.167740s

master=> \q
[sqream@nt761xda /home/sqream/product/03_sqream]$

 

5. SQream Database를 중지합니다.

[sqream@nt761xda /home/sqream/product/03_sqream]$ killall metadata_server

 

6. SQream Studio가 기동 되어 있다면 SQream Studio 관련 프로세스도 모두 종료시킵니다.

[sqream@nt761xda /home/sqream/product/03_sqream]$ ps -ef | grep sqream
sqream    1282     1  0 06:23 ?        00:02:47 /usr/local/bin/prometheus --config.file=/home/sqream/SQREAM/prometheus/prometheus.yml --storage.tsdb.path=/home/sqream/SQREAM/prometheus/lib/prometheus --web.console.templates=/home/sqream/SQREAM/prometheus/consoles --web.console.libraries=/home/sqream/SQREAM/prometheus/console_libraries
sqream    1284     1  0 06:23 ?        00:02:14 /usr/bin/node_exporter
sqream    1287     1  0 06:23 ?        00:00:27 /usr/bin/nvidia_exporter
sqream   13687     1  0 10:44 ?        00:00:00 npm
sqream   13710 13687  0 10:44 ?        00:00:00 npm
sqream   13724     1  0 10:44 ?        00:00:00 npm
sqream   13738 13710  0 10:44 ?        00:00:03 sqream-studio
sqream   13749 13724  0 10:44 ?        00:00:06 node index.js
root     15042 15000  0 12:30 pts/3    00:00:00 su - sqream
sqream   15043 15042  0 12:30 pts/3    00:00:00 -bash
root     15401 15110  0 12:32 pts/4    00:00:00 su - sqream
sqream   15402 15401  0 12:32 pts/4    00:00:00 -bash
sqream   16784 15043  0 13:21 pts/3    00:00:00 ps -ef
sqream   16785 15043  0 13:21 pts/3    00:00:00 grep --color=auto sqream

[sqream@nt761xda /home/sqream/product/03_sqream]$ kill -9 13687 13710 13724 13738 13749

[sqream@nt761xda /home/sqream/product/03_sqream]$ ps -ef | grep sqream
sqream    1282     1  0 06:23 ?        00:02:47 /usr/local/bin/prometheus --config.file=/home/sqream/SQREAM/prometheus/prometheus.yml --storage.tsdb.path=/home/sqream/SQREAM/prometheus/lib/prometheus --web.console.templates=/home/sqream/SQREAM/prometheus/consoles --web.console.libraries=/home/sqream/SQREAM/prometheus/console_libraries
sqream    1284     1  0 06:23 ?        00:02:14 /usr/bin/node_exporter
sqream    1287     1  0 06:23 ?        00:00:28 /usr/bin/nvidia_exporter
root     15042 15000  0 12:30 pts/3    00:00:00 su - sqream
sqream   15043 15042  0 12:30 pts/3    00:00:00 -bash
root     15401 15110  0 12:32 pts/4    00:00:00 su - sqream
sqream   15402 15401  0 12:32 pts/4    00:00:00 -bash
sqream   16803 15043  0 13:22 pts/3    00:00:00 ps -ef
sqream   16804 15043  0 13:22 pts/3    00:00:00 grep --color=auto sqream

 

7. SQream Database를 Upgrade(Product Link) 합니다.

[sqream@nt761xda /home/sqream/product/03_sqream]$ cd /home/sqream/SQREAM

[sqream@nt761xda /home/sqream/SQREAM]$ ls -rlt
합계 0
drwxrwxr-x 10 sqream sqream 145 10월 27 18:31 sqream-db-v2022.1.2
drwxrwxr-x  2 sqream sqream  25 10월 27 18:37 sqream_license
lrwxrwxrwx  1 sqream sqream  19 10월 27 18:44 sqream -> sqream-db-v2022.1.2
drwxrwxr-x  3 sqream sqream  22 10월 27 18:54 sqream_cluster
drwxrwxr-x  3 sqream sqream  17 10월 27 19:53 sqream_config
drwxrwxr-x  3 sqream sqream  23 10월 29 22:36 logs
drwxrwxr-x  5 sqream sqream 102 10월 30 23:54 sqream-admin-5.4.4
drwxrwxr-x  5 sqream sqream  80 11월  1 21:32 prometheus
drwxrwxr-x  7 sqream sqream 242 11월  1 22:16 sqream-dashboard
drwxrwxr-x  5 sqream sqream 102 11월  2 09:11 sqream-admin
drwxrwxr-x  3 sqream sqream 152 11월  2 12:31 sqream_script
drwxrwxr-x 10 sqream sqream 145 11월  2 13:20 sqream-db-v2022.1.2.1

[sqream@nt761xda /home/sqream/SQREAM]$ ln -sTf sqream-db-v2022.1.2.1 sqream

[sqream@nt761xda /home/sqream/SQREAM]$ ls -rlt
합계 0
drwxrwxr-x 10 sqream sqream 145 10월 27 18:31 sqream-db-v2022.1.2
drwxrwxr-x  2 sqream sqream  25 10월 27 18:37 sqream_license
drwxrwxr-x  3 sqream sqream  22 10월 27 18:54 sqream_cluster
drwxrwxr-x  3 sqream sqream  17 10월 27 19:53 sqream_config
drwxrwxr-x  3 sqream sqream  23 10월 29 22:36 logs
drwxrwxr-x  5 sqream sqream 102 10월 30 23:54 sqream-admin-5.4.4
drwxrwxr-x  5 sqream sqream  80 11월  1 21:32 prometheus
drwxrwxr-x  7 sqream sqream 242 11월  1 22:16 sqream-dashboard
drwxrwxr-x  5 sqream sqream 102 11월  2 09:11 sqream-admin
drwxrwxr-x  3 sqream sqream 152 11월  2 12:31 sqream_script
drwxrwxr-x 10 sqream sqream 145 11월  2 13:20 sqream-db-v2022.1.2.1
lrwxrwxrwx  1 sqream sqream  21 11월  2 13:43 sqream -> sqream-db-v2022.1.2.1

 

8. Upgrade Storage를 수행합니다.

[sqream@nt761xda /home/sqream/SQREAM]$ upgrade_storage /home/sqream/SQREAM/sqream_cluster/sqreamdb
get_leveldb_version path{/home/sqream/SQREAM/sqream_cluster/sqreamdb/leveldb}
current storage version 41
no need to upgrade

 

9. SQream Database를 기동 합니다.

[sqream@nt761xda /home/sqream/SQREAM]$ nohup /home/sqream/SQREAM/sqream/bin/metadata_server 127.0.0.1 3105 >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_metadata_server.log 2>&1 &
[1] 18562

[sqream@nt761xda /home/sqream/SQREAM]$ nohup /home/sqream/SQREAM/sqream/bin/server_picker 127.0.0.1 3105 3108 >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_server_picker.log 2>&1 &
[2] 18674

[sqream@nt761xda /home/sqream/SQREAM]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream0_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream0.log 2>&1 &
[3] 19268

[sqream@nt761xda /home/sqream/SQREAM]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream1_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream1.log 2>&1 &
[4] 19272

[sqream@nt761xda /home/sqream/SQREAM]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream2_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream2.log 2>&1 &
[5] 19276

[sqream@nt761xda /home/sqream/SQREAM]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream3_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream3.log 2>&1 &
[6] 19355

 

10. SQream Database에 접속해서 현재 Database의 버전을 확인합니다.

[sqream@nt761xda /home/sqream/SQREAM]$ sqream sql --database=master --username=sqream --password=sqream --host=127.0.0.1 --port=3108 --clustered --trim-varchars
Interactive client mode
To quit, use ^D or \q.

master=> select show_version();
v2022.1.2.1
1 row
time: 0.237170s

 

11. 현재 상태의 metadata_server를 백업합니다.

master=> SELECT backup_metadata('/home/sqream/SQREAM/sqream_cluster/sqreamdb/leveldb_20221102_new');
executed
time: 0.163811s

master=> \q
[sqream@nt761xda /home/sqream/SQREAM]$

• metadata_server를 백업받는 이유는, 백업받은 metadata_server로 덮어 씌움으로써 metadata_server를 정리하기 위함입니다.

 

12. SQream Database를 중지합니다.

[sqream@nt761xda /home/sqream/SQREAM]$ killall metadata_server

 

13. 현재 버전의 metadata_server는 이름 변경 후, 바로 전에 받은 metadata_server의 백업본으로 현재 metadata_server를 덮어쓰기 합니다.

[sqream@nt761xda /home/sqream/SQREAM]$ cd /home/sqream/SQREAM/sqream_cluster/sqreamdb

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ ls -rlt
합계 8
drwxrwxr-x 3 sqream sqream   20 10월 27 18:54 databases
drwxrwxr-x 3 sqream sqream   23 10월 27 20:07 temp
drwxrwxr-x 7 sqream sqream  142 11월  1 09:37 logs
drwxrwxr-x 2 sqream sqream  177 11월  2 13:37 leveldb_2022.1.2_20221102
drwxr-xr-x 2 sqream sqream 4096 11월  2 13:56 leveldb
drwxrwxr-x 2 sqream sqream  177 11월  2 13:59 leveldb_20221102_new

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ mv leveldb leveldb_2022.1.2.1_20221102

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ mv leveldb_20221102_new leveldb

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ ls -rlt
합계 8
drwxrwxr-x 3 sqream sqream   20 10월 27 18:54 databases
drwxrwxr-x 3 sqream sqream   23 10월 27 20:07 temp
drwxrwxr-x 7 sqream sqream  142 11월  1 09:37 logs
drwxrwxr-x 2 sqream sqream  177 11월  2 13:37 leveldb_2022.1.2_20221102
drwxr-xr-x 2 sqream sqream 4096 11월  2 13:56 leveldb_2022.1.2.1_20221102
drwxrwxr-x 2 sqream sqream  177 11월  2 13:59 leveldb

 

14. SQream Database를 기동 합니다.

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ nohup /home/sqream/SQREAM/sqream/bin/metadata_server 127.0.0.1 3105 >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_metadata_server.log 2>&1 &
[1] 20370

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ nohup /home/sqream/SQREAM/sqream/bin/server_picker 127.0.0.1 3105 3108 >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_server_picker.log 2>&1 &
[2] 20420

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream0_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream0.log 2>&1 &
[3] 20424

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream1_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream1.log 2>&1 &
[4] 20477

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream2_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream2.log 2>&1 &
[5] 20556

[sqream@nt761xda /home/sqream/SQREAM/sqream_cluster/sqreamdb]$ nohup /home/sqream/SQREAM/sqream/bin/sqreamd -config /home/sqream/SQREAM/sqream_config/4sq/sqream3_config.json >> /home/sqream/SQREAM/logs/127.0.0.1/127.0.0.1_sqream3.log 2>&1 &
[6] 20633

 

15. SQream Database에 접속해서 현재 Database의 버전을 확인합니다.

[sqream@nt761xda /home/sqream/SQREAM]$ sqream sql --database=master --username=sqream --password=sqream --host=127.0.0.1 --port=3108 --clustered --trim-varchars
Interactive client mode
To quit, use ^D or \q.

master=> select show_version();
v2022.1.2.1
1 row
time: 0.237170s