relayer-basic_results.txt raw
1 Starting Nostr Relay Benchmark (Badger Backend)
2 Data Directory: /tmp/benchmark_relayer-basic_8
3 Events: 50000, Workers: 24, Duration: 1m0s
4 1763653413403632ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
5 1763653413403714ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
6 1763653413403774ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
7 1763653413403787ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
8 1763653413403798ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
9 1763653413403814ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
10 1763653413403819ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
11 1763653413403829ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
12 1763653413403835ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
13
14 ╔════════════════════════════════════════════════════════╗
15 ║ BADGER BACKEND BENCHMARK SUITE ║
16 ╚════════════════════════════════════════════════════════╝
17
18 === Starting Badger benchmark ===
19 RunPeakThroughputTest (Badger)..
20
21 === Peak Throughput Test ===
22 2025/11/20 15:43:33 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
23 2025/11/20 15:43:33 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
24 Events saved: 50000/50000 (100.0%), errors: 0
25 Duration: 3.291311068s
26 Events/sec: 15191.51
27 Avg latency: 1.494499ms
28 P90 latency: 2.107626ms
29 P95 latency: 2.461731ms
30 P99 latency: 3.662388ms
31 Bottom 10% Avg latency: 790.923µs
32 Wiping database between tests...
33 RunBurstPatternTest (Badger)..
34
35 === Burst Pattern Test ===
36 Burst completed: 5000 events in 344.087556ms
37 Burst completed: 5000 events in 311.578355ms
38 Burst completed: 5000 events in 276.67865ms
39 Burst completed: 5000 events in 295.952793ms
40 Burst completed: 5000 events in 314.347861ms
41 Burst completed: 5000 events in 365.599791ms
42 Burst completed: 5000 events in 312.086332ms
43 Burst completed: 5000 events in 299.872209ms
44 Burst completed: 5000 events in 328.254546ms
45 Burst completed: 5000 events in 283.179754ms
46 Burst test completed: 50000 events in 8.137375007s, errors: 0
47 Events/sec: 6144.49
48 Wiping database between tests...
49 RunMixedReadWriteTest (Badger)..
50
51 === Mixed Read/Write Test ===
52 Generating 1000 unique synthetic events (minimum 300 bytes each)...
53 Generated 1000 events:
54 Average content size: 312 bytes
55 All events are unique (incremental timestamps)
56 All events are properly signed
57
58 Pre-populating database for read tests...
59 Generating 50000 unique synthetic events (minimum 300 bytes each)...
60 Generated 50000 events:
61 Average content size: 314 bytes
62 All events are unique (incremental timestamps)
63 All events are properly signed
64
65 Mixed test completed: 25000 writes, 25000 reads in 24.527874554s
66 Combined ops/sec: 2038.50
67 Wiping database between tests...
68 RunQueryTest (Badger)..
69
70 === Query Test ===
71 Generating 10000 unique synthetic events (minimum 300 bytes each)...
72 Generated 10000 events:
73 Average content size: 313 bytes
74 All events are unique (incremental timestamps)
75 All events are properly signed
76
77 Pre-populating database with 10000 events for query tests...
78 Query test completed: 404814 queries in 1m0.005258143s
79 Queries/sec: 6746.31
80 Avg query latency: 1.649233ms
81 P95 query latency: 6.427316ms
82 P99 query latency: 10.348647ms
83 Wiping database between tests...
84 RunConcurrentQueryStoreTest (Badger)..
85
86 === Concurrent Query/Store Test ===
87 Generating 5000 unique synthetic events (minimum 300 bytes each)...
88 Generated 5000 events:
89 Average content size: 313 bytes
90 All events are unique (incremental timestamps)
91 All events are properly signed
92
93 Pre-populating database with 5000 events for concurrent query/store test...
94 Generating 50000 unique synthetic events (minimum 300 bytes each)...
95 Generated 50000 events:
96 Average content size: 314 bytes
97 All events are unique (incremental timestamps)
98 All events are properly signed
99
100 Concurrent test completed: 321308 operations (271308 queries, 50000 writes) in 1m0.002966019s
101 Operations/sec: 5354.87
102 Avg latency: 1.426015ms
103 Avg query latency: 1.403835ms
104 Avg write latency: 1.546366ms
105 P95 latency: 3.544854ms
106 P99 latency: 5.812454ms
107
108 === Badger benchmark completed ===
109
110
111 ================================================================================
112 BENCHMARK REPORT
113 ================================================================================
114
115 Test: Peak Throughput
116 Duration: 3.291311068s
117 Total Events: 50000
118 Events/sec: 15191.51
119 Success Rate: 100.0%
120 Concurrent Workers: 24
121 Memory Used: 96 MB
122 Avg Latency: 1.494499ms
123 P90 Latency: 2.107626ms
124 P95 Latency: 2.461731ms
125 P99 Latency: 3.662388ms
126 Bottom 10% Avg Latency: 790.923µs
127 ----------------------------------------
128
129 Test: Burst Pattern
130 Duration: 8.137375007s
131 Total Events: 50000
132 Events/sec: 6144.49
133 Success Rate: 100.0%
134 Concurrent Workers: 24
135 Memory Used: 204 MB
136 Avg Latency: 1.322915ms
137 P90 Latency: 1.930428ms
138 P95 Latency: 2.255818ms
139 P99 Latency: 3.262786ms
140 Bottom 10% Avg Latency: 503.483µs
141 ----------------------------------------
142
143 Test: Mixed Read/Write
144 Duration: 24.527874554s
145 Total Events: 50000
146 Events/sec: 2038.50
147 Success Rate: 100.0%
148 Concurrent Workers: 24
149 Memory Used: 132 MB
150 Avg Latency: 383.613µs
151 P90 Latency: 799.103µs
152 P95 Latency: 888.112µs
153 P99 Latency: 1.115605ms
154 Bottom 10% Avg Latency: 1.022007ms
155 ----------------------------------------
156
157 Test: Query Performance
158 Duration: 1m0.005258143s
159 Total Events: 404814
160 Events/sec: 6746.31
161 Success Rate: 100.0%
162 Concurrent Workers: 24
163 Memory Used: 125 MB
164 Avg Latency: 1.649233ms
165 P90 Latency: 4.874718ms
166 P95 Latency: 6.427316ms
167 P99 Latency: 10.348647ms
168 Bottom 10% Avg Latency: 7.248468ms
169 ----------------------------------------
170
171 Test: Concurrent Query/Store
172 Duration: 1m0.002966019s
173 Total Events: 321308
174 Events/sec: 5354.87
175 Success Rate: 100.0%
176 Concurrent Workers: 24
177 Memory Used: 89 MB
178 Avg Latency: 1.426015ms
179 P90 Latency: 2.835111ms
180 P95 Latency: 3.544854ms
181 P99 Latency: 5.812454ms
182 Bottom 10% Avg Latency: 4.119764ms
183 ----------------------------------------
184
185 Report saved to: /tmp/benchmark_relayer-basic_8/benchmark_report.txt
186 AsciiDoc report saved to: /tmp/benchmark_relayer-basic_8/benchmark_report.adoc
187
188 RELAY_NAME: relayer-basic
189 RELAY_URL: ws://relayer-basic:7447
190 TEST_TIMESTAMP: 2025-11-20T15:46:51+00:00
191 BENCHMARK_CONFIG:
192 Events: 50000
193 Workers: 24
194 Duration: 60s
195