Klustron 1.3 Performance Test Report
Klustron 1.3 Performance Test Report
Version: v1.3.1
Cluster Topology and Configuration:
| Cluster Topology | Compute Node | Storage Node | Management Node | haproxy | sysbench | benchmarksql |
|---|---|---|---|---|---|---|
| 192.168.0.20 | √ | √ | √ | |||
| 192.168.0.21 | √ | √ | √ | |||
| 192.168.0.22 | √ | √ | √ | √ | √ | √ |
Cluster Description: Compute Nodes: Three machines, each deploying a compute node. Storage Nodes: Three shards, each shard with a single primary; the single primaries of the three shards are distributed across these three machines. Management Nodes: The cluster management consists of three machines, forming three nodes, with one primary and two backups.
Machine Configuration: CentOS 8.5 32c 128g 1.9T NVMe SSD 10GbE network card.
Load Balancing: haproxy 2.5.0
sysbench:1.0.20
benchmarksql:5.0
Pre-load Test Preparation:
Create a cluster with 3 shards and 3 compute nodes.
Modifications to compute node system variables before load testing:
alter system set statement_timeout=6000000;
alter system set mysql_read_timeout=1200;
alter system set mysql_write_timeout=1200;
alter system set lock_timeout=1200000;
alter system set log_min_duration_statement=1200000;
alter system set effective_cache_size = '8GB';
alter system set work_mem = '128MB';
alter system set wal_buffers='64MB';
alter system set autovacuum=false;
Note: Modifications to each node require a restart to take effect.
Modifications to storage node system variables before load testing:
mysql -h xxx -P xxx -upgx -ppgx_pwd #Log into the master of each shard to make modifications
set global innodb_buffer_pool_size=32*1024*1024*1024;
set global lock_wait_timeout=1200;
set global innodb_lock_wait_timeout=1200;
set global fullsync_timeout=1200000;
set global enable_fullsync=false;
set global innodb_flush_log_at_trx_commit=2;
set global sync_binlog=0;
set global max_binlog_size=1*1024*1024*1024;
set global enable_fullsync=off;
Set each shard to avoid switchover through XPanel by navigating to [Cluster MGT] -> [Cluster Switch Free Settings]
Remove the backup machines from each shard.
Sysbench
oltp_point_select
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 0.81 | 2.86 | 64.47 | 70.55 |
| TPS | 113007.37 | 95306.52 | 73943.31 | 66162.5 |
| QPS | 113007.37 | 95306.52 | 73943.31 | 66162.5 |
| CPU (32vC) | 20:29% 21:27% 22:27% | 20:28% 21:26% 22:27% | 20:27% 21:26% 22:26% | 20:27% 21:25% 22:26% |
| Memory (128G) | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% | 20:34% 21:34% 22:34% |
| IO Utilization | 20:7% 21:7% 22:7% | 20:7% 21:5% 22:4% | 20:5% 21:3% 22:3% | 20:6% 21:7% 22:4% |
oltp_update_non_index
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 1.44 | 12.3 | 51.02 | 58.92 |
| TPS | 66057.79 | 63286.77 | 54899.43 | 51132.19 |
| QPS | 66057.79 | 63286.77 | 54899.43 | 51132.19 |
| CPU (32vC) | 20:34% 21:32% 22:36% | 20:31% 21:33% 22:36% | 20:33% 21:30% 22:35% | 20:31% 21:32% 22:33% |
| Memory (128G) | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:35% 21:35% 22:35% |
| IO Utilization | 20:27% 21:18% 22:39% | 20:99% 21:43% 22:95% | 20:95% 21:99% 22:95% | 20:94% 21:91% 22:96% |
oltp_update_index
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 2.43 | 11.24 | 46.63 | 55.82 |
| TPS | 64748.63 | 54121.36 | 46875.16 | 46347.41 |
| QPS | 64748.63 | 54121.36 | 46875.16 | 46347.41 |
| CPU (32vC) | 20:40% 21:42% 22:40% | 20:33% 21:32% 22:29% | 20:33% 21:28% 22:28% | 20:32% 21:26% 22:34% |
| Memory (128G) | 20:20% 21:21% 22:18% | 20:20% 21:22% 22:19% | 20:21% 21:23% 22:23% | 20:21% 21:23% 22:21% |
| IO Utilization | 20:92% 21:97% 22:98% | 20:99% 21:91% 22:94% | 20:96% 21:94% 22:96% | 20:93% 21:92% 22:97% |
oltp_read_write
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 186.54 | 411.96 | 612.21 | 427.07 |
| TPS | 642.61 | 1940.16 | 3095.1 | 3218.29 |
| QPS | 2570.43 | 7760.64 | 12380.38 | 12869.15 |
| CPU (32vC) | 20:11% 21:10% 22:12% | 20:20% 21:16% 22:21% | 20:23% 21:22% 22:25% | 20:25% 21:24% 22:26% |
| Memory (128G) | 20:35% 21:35% 22:35% | 20:36% 21:36% 22:36% | 20:37% 21:37% 22:37% | 20:38% 21:38% 22:38% |
| IO Utilization | 20:93% 21:98% 22:98% | 20:60% 21:13% 22:51% | 20:52% 21:54% 22:51% | 20:63% 21:57% 22:61% |
oltp_read_only
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 183.21 | 502.2 | 383.33 | 427.07 |
| TPS | 644.99 | 865.42 | 3086 | 3450.44 |
| QPS | 2579.96 | 3461.67 | 12334.18 | 13783.17 |
| CPU (32vC) | 20:11% 21:11% 22:12% | 20:29% 21:27% 22:27% | 20:28% 21:27% 22:26% | 20:28% 21:27% 22:26% |
| Memory (128G) | 20:34% 21:34% 22:34% | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% |
| IO Utilization | 20:100% 21:100% 22:100% | 20:55% 21:60% 22:58% | 20:65% 21:70% 22:68% | 20:75% 21:71% 22:68% |
oltp_write_only
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 183.21 | 260.72 | 459.18 | 637.08 |
| TPS | 651.22 | 433.68 | 264.01 | 198.25 |
| QPS | 2604.9 | 1812.3 | 896.45 | 503.76 |
| CPU (32vC) | 20:4% 21:4% 22:14% | 20:5% 21:3% 22:10% | 20:6% 21:8% 22:9% | 20:6% 21:7% 22:8% |
| Memory (128G) | 20:34% 21:34% 22:34% | 20:35% 21:34% 22:34% | 20:35% 21:34% 22:34% | 20:36% 21:34% 22:34% |
| IO Utilization | 20:100% 21:99% 22:100% | 20:100% 21:100% 22:100% | 20:100% 21:100% 22:100% | 20:100% 21:100% 22:100% |
oltp_insert
| Load Test Duration | 5min | 5min | 5min | 5min |
|---|---|---|---|---|
| Concurrent Users | 100 | 300 | 600 | 900 |
| 95% Latency (ms) | 0.87 | 7.84 | 27.66 | 43.39 |
| TPS | 110055.32 | 98261.53 | 75309.96 | 77354.33 |
| QPS | 110055.32 | 98261.53 | 75309.96 | 77354.33 |
| CPU (32vC) | 20:34% 21:26% 22:27% | 20:33% 21:22% 22:29% | 20:29% 21:27% 22:24% | 20:25% 21:23% 22:38% |
| Memory (128G) | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:35% 21:35% 22:35% |
| IO Utilization | 20:56% 21:58% 22:64% | 20:94% 21:47% 22:93% | 20:91% 21:85% 22:93% | 20:94% 21:96% 22:94% |
TPC-C
| Load Test Duration | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| warehouse | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 |
| Concurrent Users | 50 | 50 | 60 | 70 | 80 | 90 | 100 | 150 | 200 | 300 | 400 | 500 |
| tpmC (Transactions per Minute of type C) | 86851.53 | 86653.63 | 84991.98 | 84124.6 | 81586.18 | 83623.86 | 46545.82 | 32384.51 | 21039.78 | 21356.62 | 21970.13 | 22568.62 |
| tmpTotal | 193198.13 | 192866.59 | 188799.55 | 186880.09 | 181188.01 | 185844.57 | 103319.45 | 71928.44 | 46754.49 | 47422.62 | 48836.39 | 50230.18 |
| Notes | node:18,19,20 | node:20,21,22 | ||||||||||
| CPU (32vC) | 18:40% 19:39% 20:36% | 20:35% 21:33% 22:33% | 20:38% 21:35% 22:36% | 20:37% 21:32% 22:36% | 20:37% 21:34% 22:36% | 20:36% 21:29% 22:35% | 20:32% 21:30% 22:33% | 20:11% 21:31% 22:29% | 20:26% 21:9% 22:8% | 20:27% 21:8% 22:8% | 20:25% 21:7% 22:8% | 20:27% 21:19% 22:45% |
| Memory (128G) | 18:25% 19:20% 20:20% | 20:23% 21:20% 22:21% | 20:23% 21:22% 22:22% | 20:24% 21:22% 22:23% | 20:25% 21:22% 22:23% | 20:26% 21:22% 22:23% | 20:26% 21:23% 22:24% | 20:27% 21:24% 22:25% | 20:27% 21:24% 22:25% | 20:27% 21:24% 22:26% | 20:28% 21:24% 22:26% | 20:28% 21:24% 22:26% |
| IO Utilization | 18:70% 19:75% 20:72% | 20:65% 21:67% 22:62% | 20:73% 21:67% 22:72% | 20:78% 21:75% 22:71% | 20:62% 21:65% 22:66% | 20:82% 21:83% 22:85% | 20:81% 21:89% 22:89% | 20:30% 21:35% 22:55% | 20:28% 21:36% 22:44% | 20:22% 21:32% 22:21% | 20:25% 21:24% 22:23% | 20:25% 21:24% 22:31% |
TPC-H
| queries | cost (seconds) | result | error |
|---|---|---|---|
| Q1 | 15.8 | succ | |
| Q2 | 1.36 | succ | |
| Q3 | 1598.1 | succ | |
| Q4 | 3.12 | succ | |
| Q5 | 30.23 | succ | |
| Q6 | 2.6 | succ | |
| Q7 | 2262.64 | succ | |
| Q8 | 5.3 | succ | |
| Q9 | 14.33 | succ | |
| Q10 | 5.15 | succ | |
| Q11 | 0.88 | succ | |
| Q12 | 3.77 | succ | |
| Q13 | 2.54 | succ | |
| Q14 | 2.79 | succ | |
| Q15 | 5.36 | succ | |
| Q16 | 0.88 | succ | |
| Q17 | 10.97 | succ | |
| Q18 | 13.9 | succ | |
| Q19 | 3.14 | succ | |
| Q20 | 4.28 | succ | |
| Q21 | 9.64 | succ | |
| Q22 | 0.71 | succ |
TPC-DS
totalCost: 2986.81s
| query | cost (seconds) | result | error |
|---|---|---|---|
| Q1 | 0.24 | succ | |
| Q2 | 4.84 | succ | |
| Q3 | 1.51 | succ | |
| Q4 | 30.63 | succ | |
| Q5 | 5.18 | succ | |
| Q6 | 141.67 | succ | |
| Q7 | 5.73 | succ | |
| Q8 | 2.1 | succ | |
| Q9 | 11.49 | succ | |
| Q10 | 6.03 | succ | |
| Q11 | 20.22 | succ | |
| Q12 | 0.52 | succ | |
| Q13 | 2.21 | succ | |
| Q14 | 9.95 | succ | |
| Q15 | 1.08 | succ | |
| Q16 | 0.75 | succ | |
| Q17 | 6.73 | succ | |
| Q18 | 4.26 | succ | |
| Q19 | 1.77 | succ | |
| Q20 | 1.03 | succ | |
| Q21 | 5.88 | succ | |
| Q22 | 13.06 | succ | |
| Q23 | 20.25 | succ | |
| Q24 | 4.44 | succ | |
| Q25 | 1292.55 | succ | |
| Q26 | 3.52 | succ | |
| Q27 | 3.47 | succ | |
| Q28 | 7.56 | succ | |
| Q29 | 2.66 | succ | |
| Q30 | 0.35 | succ | |
| Q31 | 19.19 | succ | |
| Q32 | 2.14 | succ | |
| Q33 | 3.07 | succ | |
| Q34 | 0.09 | succ | |
| Q35 | 5.05 | succ | |
| Q36 | 0.07 | succ | |
| Q37 | 0.04 | succ | |
| Q38 | 4.56 | succ | |
| Q39 | 15.45 | succ | |
| Q40 | 1.38 | succ | |
| Q41 | 0.05 | succ | |
| Q42 | 1.6 | succ | |
| Q43 | 0.06 | succ | |
| Q44 | 1.1 | succ | |
| Q45 | 1029.89 | succ | |
| Q46 | 0.07 | succ | |
| Q47 | 6.47 | succ | |
| Q48 | 2.05 | succ | |
| Q49 | 3.12 | succ | |
| Q50 | 4.58 | succ | |
| Q51 | 4.21 | succ | |
| Q52 | 1.52 | succ | |
| Q53 | 1.61 | succ | |
| Q54 | 0.85 | succ | |
| Q55 | 1.59 | succ | |
| Q56 | 3.08 | succ | |
| Q57 | 2.86 | succ | |
| Q58 | 9.27 | succ | |
| Q59 | 6.34 | succ | |
| Q60 | 3.1 | succ | |
| Q61 | 0.14 | succ | |
| Q62 | 1 | succ | |
| Q63 | 1.63 | succ | |
| Q64 | 11.11 | succ | |
| Q65 | 3.68 | succ | |
| Q66 | 1.37 | succ | |
| Q67 | 10.05 | succ | |
| Q68 | 0.09 | succ | |
| Q69 | 5.24 | succ | |
| Q70 | 5.04 | succ | |
| Q71 | 1.62 | succ | |
| Q72 | 28.57 | succ | |
| Q73 | 0.09 | succ | |
| Q74 | 7.49 | succ | |
| Q75 | 5.74 | succ | |
| Q76 | 1.54 | succ | |
| Q77 | 4.75 | succ | |
| Q78 | 25.25 | succ | |
| Q79 | 2.49 | succ | |
| Q80 | 6.69 | succ | |
| Q81 | 0.33 | succ | |
| Q82 | 5.95 | succ | |
| Q83 | 1.2 | succ | |
| Q84 | 19.2 | succ | |
| Q85 | 2.63 | succ | |
| Q86 | 0.73 | succ | |
| Q87 | 4.54 | succ | |
| Q88 | 10.27 | succ | |
| Q89 | 1.85 | succ | |
| Q90 | 0.79 | succ | |
| Q91 | 1.12 | succ | |
| Q92 | 1.1 | succ | |
| Q93 | 3.59 | succ | |
| Q94 | 0.52 | succ | |
| Q95 | 32.88 | succ | |
| Q96 | 1.25 | succ | |
| Q97 | 3.23 | succ | |
| Q98 | 1.83 | succ | |
| Q99 | 2.03 | succ |
