================================================================ NOSTR RELAY BENCHMARK AGGREGATE REPORT ================================================================ Generated: 2025-11-20T15:53:41+00:00 Benchmark Configuration: Events per test: 50000 Concurrent workers: 24 Test duration: 60s Relays tested: 8 ================================================================ SUMMARY BY RELAY ================================================================ Relay: next-orly-badger ---------------------------------------- Status: COMPLETED Events/sec: 17836.33 Events/sec: 6340.29 Events/sec: 17836.33 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.176626ms Bottom 10% Avg Latency: 659.571µs Avg Latency: 1.150109ms P95 Latency: 1.79182ms P95 Latency: 1.87572ms P95 Latency: 870.11µs Relay: next-orly-dgraph ---------------------------------------- Status: COMPLETED Events/sec: 16687.23 Events/sec: 6230.59 Events/sec: 16687.23 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.299973ms Bottom 10% Avg Latency: 703.285µs Avg Latency: 1.216351ms P95 Latency: 2.203343ms P95 Latency: 2.205777ms P95 Latency: 869.669µs Relay: next-orly-neo4j ---------------------------------------- Status: COMPLETED Events/sec: 17497.93 Events/sec: 6254.20 Events/sec: 17497.93 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.220061ms Bottom 10% Avg Latency: 689.107µs Avg Latency: 1.207729ms P95 Latency: 1.873592ms P95 Latency: 2.026464ms P95 Latency: 860.711µs Relay: khatru-sqlite ---------------------------------------- Status: COMPLETED Events/sec: 15692.37 Events/sec: 6031.64 Events/sec: 15692.37 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.434878ms Bottom 10% Avg Latency: 773.12µs Avg Latency: 1.438112ms P95 Latency: 2.364988ms P95 Latency: 2.530373ms P95 Latency: 869.767µs Relay: khatru-badger ---------------------------------------- Status: COMPLETED Events/sec: 15459.86 Events/sec: 6208.94 Events/sec: 15459.86 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.468719ms Bottom 10% Avg Latency: 802.399µs Avg Latency: 1.250479ms P95 Latency: 2.396216ms P95 Latency: 2.142422ms P95 Latency: 869.166µs Relay: relayer-basic ---------------------------------------- Status: COMPLETED Events/sec: 15191.51 Events/sec: 6144.49 Events/sec: 15191.51 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.494499ms Bottom 10% Avg Latency: 790.923µs Avg Latency: 1.322915ms P95 Latency: 2.461731ms P95 Latency: 2.255818ms P95 Latency: 888.112µs Relay: strfry ---------------------------------------- Status: COMPLETED Events/sec: 16583.98 Events/sec: 5979.92 Events/sec: 16583.98 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.325163ms Bottom 10% Avg Latency: 732.389µs Avg Latency: 1.467778ms P95 Latency: 2.114188ms P95 Latency: 2.793392ms P95 Latency: 878.634µs Relay: nostr-rs-relay ---------------------------------------- Status: COMPLETED Events/sec: 15250.43 Events/sec: 6286.54 Events/sec: 15250.43 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.477342ms Bottom 10% Avg Latency: 760.393µs Avg Latency: 1.167307ms P95 Latency: 2.527756ms P95 Latency: 2.003086ms P95 Latency: 868.365µs ================================================================ DETAILED RESULTS ================================================================ Individual relay reports are available in: - /reports/run_20251120_152640/khatru-badger_results.txt - /reports/run_20251120_152640/khatru-sqlite_results.txt - /reports/run_20251120_152640/next-orly-badger_results.txt - /reports/run_20251120_152640/next-orly-dgraph_results.txt - /reports/run_20251120_152640/next-orly-neo4j_results.txt - /reports/run_20251120_152640/nostr-rs-relay_results.txt - /reports/run_20251120_152640/relayer-basic_results.txt - /reports/run_20251120_152640/strfry_results.txt ================================================================ BENCHMARK COMPARISON TABLE ================================================================ Relay Status Peak Tput/s Avg Latency Success Rate ---- ------ ----------- ----------- ------------ next-orly-badger OK 17836.33 1.176626ms 100.0% next-orly-dgraph OK 16687.23 1.299973ms 100.0% next-orly-neo4j OK 17497.93 1.220061ms 100.0% khatru-sqlite OK 15692.37 1.434878ms 100.0% khatru-badger OK 15459.86 1.468719ms 100.0% relayer-basic OK 15191.51 1.494499ms 100.0% strfry OK 16583.98 1.325163ms 100.0% nostr-rs-relay OK 15250.43 1.477342ms 100.0% ================================================================ End of Report ================================================================