Batch vs Parallel Requests Bench
Compare performance of sequential, parallel, and batched request execution strategies
Configuration

Number of requests per batch

Max parallel requests

Randomness in request duration

Recommendation

For this configuration, batched execution often provides a good balance between parallelism and resource usage.

Fastest Method

Batched

76.6% faster than slowest

Total Time

912ms

Performance Comparison
Sequential
3897ms
5.1 req/s
Parallel
993ms
20.1 req/s
Batched
912ms
21.9 req/s
Sequential
3897ms

Executes one request at a time, waiting for each to complete before starting the next

0ms3897ms

Throughput

5.1 req/s

Avg Latency

195ms

Min Latency

160ms

Max Latency

239ms

Parallel
993ms

Executes multiple requests simultaneously, limited by concurrency setting

0ms993ms

Throughput

20.1 req/s

Avg Latency

193ms

Min Latency

162ms

Max Latency

239ms

Batched
912ms

Divides requests into batches, executing each batch in parallel, then moving to the next batch

0ms912ms

Throughput

21.9 req/s

Avg Latency

206ms

Min Latency

160ms

Max Latency

233ms

馃弳 Winner!

76.6% faster than the slowest method