================================================================ NOSTR RELAY BENCHMARK AGGREGATE REPORT ================================================================ Generated: 2025-11-19T12:08:43+00:00 Benchmark Configuration: Events per test: 50000 Concurrent workers: 24 Test duration: 60s Relays tested: 8 ================================================================ SUMMARY BY RELAY ================================================================ Relay: next-orly-badger ---------------------------------------- Status: COMPLETED Events/sec: 17949.86 Events/sec: 6293.77 Events/sec: 17949.86 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.089014ms Bottom 10% Avg Latency: 552.633µs Avg Latency: 749.292µs P95 Latency: 1.801326ms P95 Latency: 1.544064ms P95 Latency: 797.32µs Relay: next-orly-dgraph ---------------------------------------- Status: COMPLETED Events/sec: 17627.19 Events/sec: 6241.01 Events/sec: 17627.19 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.103766ms Bottom 10% Avg Latency: 537.227µs Avg Latency: 973.956µs P95 Latency: 1.895983ms P95 Latency: 1.938364ms P95 Latency: 839.77µs Relay: next-orly-neo4j ---------------------------------------- Status: COMPLETED Events/sec: 15536.46 Events/sec: 6269.18 Events/sec: 15536.46 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.414281ms Bottom 10% Avg Latency: 704.384µs Avg Latency: 919.794µs P95 Latency: 2.486204ms P95 Latency: 1.842478ms P95 Latency: 828.598µs Relay: khatru-sqlite ---------------------------------------- Status: COMPLETED Events/sec: 17237.90 Events/sec: 6137.41 Events/sec: 17237.90 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.195398ms Bottom 10% Avg Latency: 614.1µs Avg Latency: 967.476µs P95 Latency: 2.00684ms P95 Latency: 2.046996ms P95 Latency: 843.455µs Relay: khatru-badger ---------------------------------------- Status: COMPLETED Events/sec: 16911.23 Events/sec: 6231.83 Events/sec: 16911.23 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.187112ms Bottom 10% Avg Latency: 540.572µs Avg Latency: 957.9µs P95 Latency: 2.183304ms P95 Latency: 1.888493ms P95 Latency: 824.399µs Relay: relayer-basic ---------------------------------------- Status: COMPLETED Events/sec: 17836.39 Events/sec: 6270.82 Events/sec: 17836.39 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.081434ms Bottom 10% Avg Latency: 525.619µs Avg Latency: 951.65µs P95 Latency: 1.853627ms P95 Latency: 1.779976ms P95 Latency: 831.883µs Relay: strfry ---------------------------------------- Status: COMPLETED Events/sec: 16470.06 Events/sec: 6004.96 Events/sec: 16470.06 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.261656ms Bottom 10% Avg Latency: 566.551µs Avg Latency: 1.02418ms P95 Latency: 2.241835ms P95 Latency: 2.314062ms P95 Latency: 821.493µs Relay: nostr-rs-relay ---------------------------------------- Status: COMPLETED Events/sec: 16764.35 Events/sec: 6300.71 Events/sec: 16764.35 Success Rate: 100.0% Success Rate: 100.0% Success Rate: 100.0% Avg Latency: 1.245012ms Bottom 10% Avg Latency: 614.335µs Avg Latency: 869.47µs P95 Latency: 2.151312ms P95 Latency: 1.707251ms P95 Latency: 816.334µs ================================================================ DETAILED RESULTS ================================================================ Individual relay reports are available in: - /reports/run_20251119_114143/khatru-badger_results.txt - /reports/run_20251119_114143/khatru-sqlite_results.txt - /reports/run_20251119_114143/next-orly-badger_results.txt - /reports/run_20251119_114143/next-orly-dgraph_results.txt - /reports/run_20251119_114143/next-orly-neo4j_results.txt - /reports/run_20251119_114143/nostr-rs-relay_results.txt - /reports/run_20251119_114143/relayer-basic_results.txt - /reports/run_20251119_114143/strfry_results.txt ================================================================ BENCHMARK COMPARISON TABLE ================================================================ Relay Status Peak Tput/s Avg Latency Success Rate ---- ------ ----------- ----------- ------------ next-orly-badger OK 17949.86 1.089014ms 100.0% next-orly-dgraph OK 17627.19 1.103766ms 100.0% next-orly-neo4j OK 15536.46 1.414281ms 100.0% khatru-sqlite OK 17237.90 1.195398ms 100.0% khatru-badger OK 16911.23 1.187112ms 100.0% relayer-basic OK 17836.39 1.081434ms 100.0% strfry OK 16470.06 1.261656ms 100.0% nostr-rs-relay OK 16764.35 1.245012ms 100.0% ================================================================ End of Report ================================================================