| Concurrency,"TTFT (Mean, ms)","TTFT (p50, ms)","TTFT (p90, ms)","ITL (Mean, ms)","ITL (p50, ms)","ITL (p90, ms)","TPS (Mean, tokens/s)","TPS (p50, tokens/s)","TPS (p90, tokens/s)","Latency (Mean, s)","Latency (p50, s)","Latency (p90, s)",Throughput (RPS) | |
| 1,73.46,73.00,77.13,8.31,8.32,8.33,112.61,113.16,113.41,1.12,1.13,1.13,0.90 | |
| 2,136.82,136.60,145.17,9.92,9.92,9.99,91.60,91.55,92.47,1.40,1.40,1.41,0.72 | |
| 4,130.01,135.92,154.24,12.11,12.15,12.56,76.61,76.16,79.66,1.66,1.68,1.71,0.60 | |
| 8,136.87,139.21,166.22,14.99,15.00,15.41,62.58,62.44,64.24,2.03,2.05,2.09,0.49 | |
| 16,163.07,156.90,214.95,18.42,18.40,18.88,51.03,51.28,52.15,2.49,2.50,2.58,0.40 | |
| 32,134.69,132.20,151.28,22.12,22.01,22.40,43.37,43.39,43.91,2.94,2.95,2.98,0.34 | |