LV SYSTEM » 11.QUI HOẠCH HỆ THỐNG » 14. CMC-Q7-HCM

Feature #150

Cập nhật bởi Tùng Nguyễn cách đây 11 tháng

Yêu cầu: Enable compression trên data pool của S3 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_algorithm snappy 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_mode force 

 So sánh kết quả CPU trước và sau khi enable compress ( S3 gateway và các node) 
 Cách test: + Upload file lớn ( 500MB - 1GB) 

 Link kết quả:  
 https://docs.google.com/spreadsheets/d/1pGO0wn9Stg_3RKpjIpUq2nrsQEPRLeZl3n-8kdALJq0/edit#gid=0 
 https://docs.google.com/spreadsheets/d/1euil2yZ0S6TwR1ZOKru79nLmPWdUpGIAeUsTbe0SoKk/edit#gid=422264090 

 ==== 
 Phụ thuộc vào 2 giá trị sau 
 compression_max_blob_size 
 compression_min_blob_size 

 ![](clipboard-202311211146-5aqr0.png) 

 ==== 
 rgw_obj_stripe_size mặc định là 4M 
 sau khi upfile thì check số lượng compress_success  


 ========== 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_algorithm snappy 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_mode aggressive 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_max_blob_size 1073741824 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_min_blob_size 1048576 

 ![](clipboard-202312040855-coesv.png) 
 ![](clipboard-202312040901-b9q5q.png) 
 ![](clipboard-202312040936-iww3f.png) 

 ceph osd pool set CMC-G1.rgw.buckets.data compression_algorithm snappy 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_mode force 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_max_blob_size 1073741824 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_min_blob_size 1048576 

 ![](clipboard-202312040919-otkg8.png) 
 ![](clipboard-202312040919-0yatv.png) 
 ![](clipboard-202312040936-vnpiw.png) 

 ceph osd pool set CMC-G1.rgw.buckets.data compression_algorithm snappy 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_mode passive 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_max_blob_size 1073741824 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_min_blob_size 1048576 

 ![](clipboard-202312040930-esmlh.png) 
 ![](clipboard-202312040931-ouapq.png) 
 ![](clipboard-202312040936-vlell.png) 

 ceph osd pool set CMC-G1.rgw.buckets.data compression_algorithm snappy 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_mode none 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_max_blob_size 1073741824 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_min_blob_size 1048576 

 ![](clipboard-202312040943-8dkcz.png) 
 ![](clipboard-202312040944-zsrai.png) 
 ![](clipboard-202312040950-i1uj3.png) 


 ceph osd pool set CMC-G1.rgw.buckets.data compression_algorithm snappy 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_mode none 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_max_blob_size 0 
 ceph osd pool set CMC-G1.rgw.buckets.data compression_min_blob_size 0 

 ![](clipboard-202312041010-yb1vt.png) 
 ![](clipboard-202312041011-tqcbb.png) 
 ![](clipboard-202312041014-wlbov.png) 

 ==== 
 12/12/2023 
 compression_max_blob_size 4194304 
 compression_min_blob_size 4096 

 Test upload file 994MB đang gặp tình trạng sau: 
 Test lần 1: compressed còn 747MB -> chưa load đầy đủ object 
 Test lần 2: compressed còn 885 MB 
 Test lần 3: không compressed 
 === 
 20/12/2023 
 ![](clipboard-202312200856-fwnsv.png) 
 lượng data compressed chưa đáng kể, cần test kỹ thêm 

Quay lại