Compare Macrobenchmarks

Comparing results for 16.0.0 and main.

OLTP

Click here to see the query plans comparison for this benchmark.

16.0.0 main Improved by %
QPS Total 25,364.0 25,650.4 1.1
QPS Reads 17,754.8 17,955.2 1.1
QPS Writes 5,064.0 5,123.1 1.2
QPS Other 2,545.3 2,572.0 1.0
TPS 1,268.2 1,282.5 1.1
Latency 45.0 44.6 0.9
Errors 0.0 0.0 0.0
Reconnects 0.0 0.0 0.0
Time 600 600 0
Threads 0.0 0.0 0.0
Total CPU time 12,669.90 12,414.40 2.02
CPU time vtgate 7,361.66 7,006.38 4.83
CPU time vttablet 5,308.21 5,408.03 -1.88
Total Allocs bytes 897 GB 894 GB 0.33
Allocs bytes vtgate 515 GB 508 GB 1.22
Allocs bytes vttablet 382 GB 386 GB -0.87

OLTP-READONLY

Click here to see the query plans comparison for this benchmark.

16.0.0 main Improved by %
QPS Total 25,029.8 25,351.2 1.3
QPS Reads 17,520.8 17,745.8 1.3
QPS Writes 4,998.5 5,062.0 1.3
QPS Other 2,510.4 2,543.4 1.3
TPS 1,251.5 1,267.6 1.3
Latency 45.0 44.2 1.8
Errors 0.0 0.0 0.0
Reconnects 0.0 0.0 0.0
Time 600 600 0
Threads 0.0 0.0 0.0
Total CPU time 13,551.50 13,217.20 2.47
CPU time vtgate 7,341.26 7,102.96 3.25
CPU time vttablet 6,210.21 6,114.25 1.55
Total Allocs bytes 900 GB 900 GB 0.08
Allocs bytes vtgate 512 GB 508 GB 0.91
Allocs bytes vttablet 388 GB 392 GB -1.02

OLTP-READONLY-OLAP

Click here to see the query plans comparison for this benchmark.

16.0.0 main Improved by %
QPS Total 25,914.3 23,570.6 -9.9
QPS Reads 22,675.0 20,624.2 -9.9
QPS Writes 0.0 0.0 0.0
QPS Other 3,239.3 2,946.3 -9.9
TPS 1,619.7 1,473.2 -9.9
Latency 69.3 91.6 -32.2
Errors 0.0 0.0 0.0
Reconnects 0.0 0.0 0.0
Time 600 600 0
Threads 0.0 0.0 0.0
Total CPU time 20,914.70 21,690.80 -3.71
CPU time vtgate 13,702.60 14,580.25 -6.40
CPU time vttablet 7,212.08 7,110.54 1.41
Total Allocs bytes 1.1 TB 1.0 TB 9.12
Allocs bytes vtgate 633 GB 576 GB 9.05
Allocs bytes vttablet 493 GB 447 GB 9.20

OLTP-SET

Click here to see the query plans comparison for this benchmark.

16.0.0 main Improved by %
QPS Total 24,807.8 25,238.4 1.7
QPS Reads 17,365.4 17,666.8 1.7
QPS Writes 4,954.7 5,039.5 1.7
QPS Other 2,487.7 2,532.1 1.8
TPS 1,240.4 1,261.9 1.7
Latency 45.0 44.2 1.8
Errors 0.0 0.0 0.0
Reconnects 0.0 0.0 0.0
Time 600 600 0
Threads 0.0 0.0 0.0
Total CPU time 13,536.10 13,358.85 1.31
CPU time vtgate 7,290.00 7,118.31 2.36
CPU time vttablet 6,246.10 6,240.51 0.09
Total Allocs bytes 894 GB 904 GB -1.06
Allocs bytes vtgate 507 GB 507 GB -0.14
Allocs bytes vttablet 387 GB 396 GB -2.27

TPCC

Click here to see the query plans comparison for this benchmark.

16.0.0 main Improved by %
QPS Total 3,159.3 3,147.3 -0.4
QPS Reads 1,443.1 1,436.8 -0.4
QPS Writes 1,493.8 1,488.7 -0.3
QPS Other 222.4 221.8 -0.3
TPS 111.2 110.9 -0.3
Latency 926.3 909.8 1.8
Errors 0.5 0.5 0.0
Reconnects 0.0 0.0 0.0
Time 600 601 0
Threads 0.0 0.0 0.0
Total CPU time 2,937.85 2,915.25 0.77
CPU time vtgate 1,716.17 1,667.87 2.81
CPU time vttablet 1,221.68 1,247.38 -2.10
Total Allocs bytes 68 GB 67 GB 0.93
Allocs bytes vtgate 44 GB 44 GB 2.04
Allocs bytes vttablet 23 GB 23 GB -1.22