khatru-sqlite_results.txt raw
1 Starting Nostr Relay Benchmark (Badger Backend)
2 Data Directory: /tmp/benchmark_khatru-sqlite_8
3 Events: 50000, Workers: 24, Duration: 1m0s
4 1764845699509026ℹ️ migrating to version 1... /build/pkg/database/migrations.go:68
5 1764845699509106ℹ️ migrating to version 2... /build/pkg/database/migrations.go:75
6 1764845699509128ℹ️ migrating to version 3... /build/pkg/database/migrations.go:82
7 1764845699509133ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:304
8 1764845699509146ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:349
9 1764845699509159ℹ️ migrating to version 4... /build/pkg/database/migrations.go:89
10 1764845699509164ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:357
11 1764845699509172ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:446
12 1764845699509178ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:555
13 1764845699509192ℹ️ migrating to version 5... /build/pkg/database/migrations.go:96
14 1764845699509197ℹ️ re-encoding events with optimized tag binary format... /build/pkg/database/migrations.go:562
15 1764845699509206ℹ️ found 0 events with e/p tags to re-encode /build/pkg/database/migrations.go:649
16 1764845699509211ℹ️ no events need re-encoding /build/pkg/database/migrations.go:652
17 1764845699509224ℹ️ migrating to version 6... /build/pkg/database/migrations.go:103
18 1764845699509228ℹ️ converting events to compact serial-reference format... /build/pkg/database/migrations.go:706
19 1764845699509238ℹ️ found 0 events to convert to compact format /build/pkg/database/migrations.go:846
20 1764845699509242ℹ️ no events need conversion /build/pkg/database/migrations.go:849
21
22 ╔════════════════════════════════════════════════════════╗
23 ║ BADGER BACKEND BENCHMARK SUITE ║
24 ╚════════════════════════════════════════════════════════╝
25
26 === Starting Badger benchmark ===
27 RunPeakThroughputTest (Badger)..
28
29 === Peak Throughput Test ===
30 2025/12/04 10:54:59 INFO: Successfully loaded embedded libsecp256k1 v5.0.0 from /tmp/orly-libsecp256k1/libsecp256k1.so
31 Events saved: 50000/50000 (100.0%), errors: 0
32 Duration: 4.109596583s
33 Events/sec: 12166.64
34 Avg latency: 1.93573ms
35 P90 latency: 2.871977ms
36 P95 latency: 3.44036ms
37 P99 latency: 5.475515ms
38 Bottom 10% Avg latency: 961.636µs
39 Wiping database between tests...
40 RunBurstPatternTest (Badger)..
41
42 === Burst Pattern Test ===
43 Burst completed: 5000 events in 515.356224ms
44 Burst completed: 5000 events in 399.9581ms
45 Burst completed: 5000 events in 459.416277ms
46 Burst completed: 5000 events in 428.20652ms
47 Burst completed: 5000 events in 747.547021ms
48 Burst completed: 5000 events in 647.984214ms
49 Burst completed: 5000 events in 488.90592ms
50 Burst completed: 5000 events in 377.505306ms
51 Burst completed: 5000 events in 465.109125ms
52 Burst completed: 5000 events in 429.364917ms
53 Burst test completed: 50000 events in 9.965909051s, errors: 0
54 Events/sec: 5017.10
55 Wiping database between tests...
56 RunMixedReadWriteTest (Badger)..
57
58 === Mixed Read/Write Test ===
59 Generating 1000 unique synthetic events (minimum 300 bytes each)...
60 Generated 1000 events:
61 Average content size: 312 bytes
62 All events are unique (incremental timestamps)
63 All events are properly signed
64
65 Pre-populating database for read tests...
66 Generating 50000 unique synthetic events (minimum 300 bytes each)...
67 Generated 50000 events:
68 Average content size: 314 bytes
69 All events are unique (incremental timestamps)
70 All events are properly signed
71
72 Mixed test completed: 25000 writes, 25000 reads in 24.612452482s
73 Combined ops/sec: 2031.49
74 Wiping database between tests...
75 RunQueryTest (Badger)..
76
77 === Query Test ===
78 Generating 10000 unique synthetic events (minimum 300 bytes each)...
79 Generated 10000 events:
80 Average content size: 313 bytes
81 All events are unique (incremental timestamps)
82 All events are properly signed
83
84 Pre-populating database with 10000 events for query tests...
85 Query test completed: 302291 queries in 1m0.005394665s
86 Queries/sec: 5037.73
87 Avg query latency: 3.277291ms
88 P95 query latency: 12.307232ms
89 P99 query latency: 18.488169ms
90 Wiping database between tests...
91 RunConcurrentQueryStoreTest (Badger)..
92
93 === Concurrent Query/Store Test ===
94 Generating 5000 unique synthetic events (minimum 300 bytes each)...
95 Generated 5000 events:
96 Average content size: 313 bytes
97 All events are unique (incremental timestamps)
98 All events are properly signed
99
100 Pre-populating database with 5000 events for concurrent query/store test...
101 Generating 50000 unique synthetic events (minimum 300 bytes each)...
102 Generated 50000 events:
103 Average content size: 314 bytes
104 All events are unique (incremental timestamps)
105 All events are properly signed
106
107 Concurrent test completed: 243436 operations (193436 queries, 50000 writes) in 1m0.00468811s
108 Operations/sec: 4056.95
109 Avg latency: 2.220391ms
110 Avg query latency: 2.393422ms
111 Avg write latency: 1.550983ms
112 P95 latency: 6.295105ms
113 P99 latency: 16.788623ms
114
115 === Badger benchmark completed ===
116
117
118 ================================================================================
119 BENCHMARK REPORT
120 ================================================================================
121
122 Test: Peak Throughput
123 Duration: 4.109596583s
124 Total Events: 50000
125 Events/sec: 12166.64
126 Success Rate: 100.0%
127 Concurrent Workers: 24
128 Memory Used: 243 MB
129 Avg Latency: 1.93573ms
130 P90 Latency: 2.871977ms
131 P95 Latency: 3.44036ms
132 P99 Latency: 5.475515ms
133 Bottom 10% Avg Latency: 961.636µs
134 ----------------------------------------
135
136 Test: Burst Pattern
137 Duration: 9.965909051s
138 Total Events: 50000
139 Events/sec: 5017.10
140 Success Rate: 100.0%
141 Concurrent Workers: 24
142 Memory Used: 257 MB
143 Avg Latency: 2.375602ms
144 P90 Latency: 3.854368ms
145 P95 Latency: 5.019226ms
146 P99 Latency: 8.287248ms
147 Bottom 10% Avg Latency: 1.013228ms
148 ----------------------------------------
149
150 Test: Mixed Read/Write
151 Duration: 24.612452482s
152 Total Events: 50000
153 Events/sec: 2031.49
154 Success Rate: 100.0%
155 Concurrent Workers: 24
156 Memory Used: 190 MB
157 Avg Latency: 432.265µs
158 P90 Latency: 913.499µs
159 P95 Latency: 1.051763ms
160 P99 Latency: 1.395767ms
161 Bottom 10% Avg Latency: 1.160261ms
162 ----------------------------------------
163
164 Test: Query Performance
165 Duration: 1m0.005394665s
166 Total Events: 302291
167 Events/sec: 5037.73
168 Success Rate: 100.0%
169 Concurrent Workers: 24
170 Memory Used: 234 MB
171 Avg Latency: 3.277291ms
172 P90 Latency: 9.787032ms
173 P95 Latency: 12.307232ms
174 P99 Latency: 18.488169ms
175 Bottom 10% Avg Latency: 13.509646ms
176 ----------------------------------------
177
178 Test: Concurrent Query/Store
179 Duration: 1m0.00468811s
180 Total Events: 243436
181 Events/sec: 4056.95
182 Success Rate: 100.0%
183 Concurrent Workers: 24
184 Memory Used: 148 MB
185 Avg Latency: 2.220391ms
186 P90 Latency: 4.746928ms
187 P95 Latency: 6.295105ms
188 P99 Latency: 16.788623ms
189 Bottom 10% Avg Latency: 8.681502ms
190 ----------------------------------------
191
192 Report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.txt
193 AsciiDoc report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.adoc
194
195 RELAY_NAME: khatru-sqlite
196 RELAY_URL: ws://khatru-sqlite:3334
197 TEST_TIMESTAMP: 2025-12-04T10:58:19+00:00
198 BENCHMARK_CONFIG:
199 Events: 50000
200 Workers: 24
201 Duration: 60s
202