Project

General

Profile

rest-bench_segfault.txt

Italo Santos, 02/25/2015 10:23 PM

Download (11.4 KB)

 
1
root@host:~# rest-bench -t 128 --api-host=hostname --access-key=access_key --secret=secret_key --bucket=bench --uri_style=vhost --no-cleanup write
2
host=hostname
3
 Maintaining 128 concurrent writes of 4194304 bytes for up to 10 seconds or 0 objects
4
 Object prefix: benchmark_data_cpro24374_14928
5
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
6
     0       1         1         0         0         0         -         0
7
     1     128       128         0         0         0         -         0
8
     2     128       129         1   1.97244         2   1.23336   1.23336
9
     3     128       129         1   1.19953         0         -   1.23336
10
     4     128       138        10     9.227        18   4.27861   3.86935
11
     5     127       182        55   41.2308       180   5.25191    4.6642
12
ERROR: benchmark_data_cpro24374_14928_object124: ConnectionFailed
13
ERROR: benchmark_data_cpro24374_14928_object110: ConnectionFailed
14
ERROR: benchmark_data_cpro24374_14928_object57: ConnectionFailed
15
ERROR: benchmark_data_cpro24374_14928_object113: ConnectionFailed
16
ERROR: benchmark_data_cpro24374_14928_object26: ConnectionFailed
17
ERROR: benchmark_data_cpro24374_14928_object117: ConnectionFailed
18
ERROR: benchmark_data_cpro24374_14928_object56: ConnectionFailed
19
ERROR: benchmark_data_cpro24374_14928_object109: ConnectionFailed
20
     6     128       216        88   55.5478       132   1.85818   4.23068
21
ERROR: benchmark_data_cpro24374_14928_object119: ConnectionFailed
22
ERROR: benchmark_data_cpro24374_14928_object71: ConnectionFailed
23
ERROR: benchmark_data_cpro24374_14928_object10: ConnectionFailed
24
ERROR: benchmark_data_cpro24374_14928_object111: ConnectionFailed
25
ERROR: benchmark_data_cpro24374_14928_object17: ConnectionFailed
26
ERROR: benchmark_data_cpro24374_14928_object80: ConnectionFailed
27
ERROR: benchmark_data_cpro24374_14928_object104: ConnectionFailed
28
ERROR: benchmark_data_cpro24374_14928_object122: ConnectionFailed
29
ERROR: benchmark_data_cpro24374_14928_object127: ConnectionFailed
30
ERROR: benchmark_data_cpro24374_14928_object16: ConnectionFailed
31
ERROR: benchmark_data_cpro24374_14928_object65: ConnectionFailed
32
ERROR: benchmark_data_cpro24374_14928_object47: ConnectionFailed
33
ERROR: benchmark_data_cpro24374_14928_object90: ConnectionFailed
34
ERROR: benchmark_data_cpro24374_14928_object121: ConnectionFailed
35
ERROR: benchmark_data_cpro24374_14928_object108: ConnectionFailed
36
ERROR: benchmark_data_cpro24374_14928_object115: ConnectionFailedERROR: benchmark_data_cpro24374_14928_object81: ConnectionFailed
37
ERROR: benchmark_data_cpro24374_14928_object82: ConnectionFailed
38

    
39
ERROR: benchmark_data_cpro24374_14928_object114: ConnectionFailed
40
ERROR: benchmark_data_cpro24374_14928_object21: ConnectionFailed
41
ERROR: benchmark_data_cpro24374_14928_object79: ConnectionFailed
42
ERROR: benchmark_data_cpro24374_14928_object49: ConnectionFailed
43
ERROR: benchmark_data_cpro24374_14928_object116: ConnectionFailed
44
ERROR: benchmark_data_cpro24374_14928_object73: ConnectionFailed
45
ERROR: benchmark_data_cpro24374_14928_object123: ConnectionFailed
46
ERROR: benchmark_data_cpro24374_14928_object94: ConnectionFailed
47
ERROR: benchmark_data_cpro24374_14928_object52: ConnectionFailed
48
ERROR: benchmark_data_cpro24374_14928_object24: ConnectionFailed
49
ERROR: benchmark_data_cpro24374_14928_object103: ConnectionFailed
50
ERROR: benchmark_data_cpro24374_14928_object118: ConnectionFailed
51
ERROR: benchmark_data_cpro24374_14928_object125: ConnectionFailed
52
ERROR: benchmark_data_cpro24374_14928_object40: ConnectionFailed
53
ERROR: benchmark_data_cpro24374_14928_object38: ConnectionFailed
54
ERROR: benchmark_data_cpro24374_14928_object35: ConnectionFailed
55
ERROR: ERROR: benchmark_data_cpro24374_14928_object105: ConnectionFailed
56
benchmark_data_cpro24374_14928_object84: ConnectionFailed
57
ERROR: benchmark_data_cpro24374_14928_object20: ConnectionFailed
58
error during benchmark: -5
59
common/WorkQueue.cc: In function 'virtual ThreadPool::~ThreadPool()' thread 7f7b45f2d7c0 time 2015-02-25 18:46:30.393222
60
common/WorkQueue.cc: 68: FAILED assert(_threads.empty())
61
 ceph version 0.87 (c51c8f9d80fa4e0168aa52685b8de40e42758578)
62
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0x4cd9fb]
63
 2: (ThreadPool::~ThreadPool()+0x126) [0x4c93a6]
64
 3: (RESTDispatcher::~RESTDispatcher()+0xe1) [0x4b6191]
65
 4: (main()+0x42e) [0x4b071e]
66
 5: (__libc_start_main()+0xf5) [0x7f7b43debec5]
67
 6: rest-bench() [0x4b1a47]
68
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
69
2015-02-25 18:46:30.394252 7f7b45f2d7c0 -1 common/WorkQueue.cc: In function 'virtual ThreadPool::~ThreadPool()' thread 7f7b45f2d7c0 time 2015-02-25 18:46:30.393222
70
common/WorkQueue.cc: 68: FAILED assert(_threads.empty())
71

    
72
 ceph version 0.87 (c51c8f9d80fa4e0168aa52685b8de40e42758578)
73
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0x4cd9fb]
74
 2: (ThreadPool::~ThreadPool()+0x126) [0x4c93a6]
75
 3: (RESTDispatcher::~RESTDispatcher()+0xe1) [0x4b6191]
76
 4: (main()+0x42e) [0x4b071e]
77
 5: (__libc_start_main()+0xf5) [0x7f7b43debec5]
78
 6: rest-bench() [0x4b1a47]
79
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
80

    
81
--- begin dump of recent events ---
82
   -13> 2015-02-25 18:46:21.767160 7f7b45f2d7c0  5 asok(0x4319850) register_command perfcounters_dump hook 0x4319710
83
   -12> 2015-02-25 18:46:21.767197 7f7b45f2d7c0  5 asok(0x4319850) register_command 1 hook 0x4319710
84
   -11> 2015-02-25 18:46:21.767289 7f7b45f2d7c0  5 asok(0x4319850) register_command perf dump hook 0x4319710
85
   -10> 2015-02-25 18:46:21.767320 7f7b45f2d7c0  5 asok(0x4319850) register_command perfcounters_schema hook 0x4319710
86
    -9> 2015-02-25 18:46:21.767343 7f7b45f2d7c0  5 asok(0x4319850) register_command 2 hook 0x4319710
87
    -8> 2015-02-25 18:46:21.767351 7f7b45f2d7c0  5 asok(0x4319850) register_command perf schema hook 0x4319710
88
    -7> 2015-02-25 18:46:21.767359 7f7b45f2d7c0  5 asok(0x4319850) register_command config show hook 0x4319710
89
    -6> 2015-02-25 18:46:21.767382 7f7b45f2d7c0  5 asok(0x4319850) register_command config set hook 0x4319710
90
    -5> 2015-02-25 18:46:21.767391 7f7b45f2d7c0  5 asok(0x4319850) register_command config get hook 0x4319710
91
    -4> 2015-02-25 18:46:21.767399 7f7b45f2d7c0  5 asok(0x4319850) register_command config diff hook 0x4319710
92
    -3> 2015-02-25 18:46:21.767434 7f7b45f2d7c0  5 asok(0x4319850) register_command log flush hook 0x4319710
93
    -2> 2015-02-25 18:46:21.767458 7f7b45f2d7c0  5 asok(0x4319850) register_command log dump hook 0x4319710
94
    -1> 2015-02-25 18:46:21.767467 7f7b45f2d7c0  5 asok(0x4319850) register_command log reopen hook 0x4319710
95
     0> 2015-02-25 18:46:30.394252 7f7b45f2d7c0 -1 common/WorkQueue.cc: In function 'virtual ThreadPool::~ThreadPool()' thread 7f7b45f2d7c0 time 2015-02-25 18:46:30.393222
96
common/WorkQueue.cc: 68: FAILED assert(_threads.empty())
97

    
98
 ceph version 0.87 (c51c8f9d80fa4e0168aa52685b8de40e42758578)
99
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0x4cd9fb]
100
 2: (ThreadPool::~ThreadPool()+0x126) [0x4c93a6]
101
 3: (RESTDispatcher::~RESTDispatcher()+0xe1) [0x4b6191]
102
 4: (main()+0x42e) [0x4b071e]
103
 5: (__libc_start_main()+0xf5) [0x7f7b43debec5]
104
 6: rest-bench() [0x4b1a47]
105
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
106

    
107
--- logging levels ---
108
   0/ 5 none
109
   0/ 1 lockdep
110
   0/ 1 context
111
   1/ 1 crush
112
   1/ 5 mds
113
   1/ 5 mds_balancer
114
   1/ 5 mds_locker
115
   1/ 5 mds_log
116
   1/ 5 mds_log_expire
117
   1/ 5 mds_migrator
118
   0/ 1 buffer
119
   0/ 1 timer
120
   0/ 1 filer
121
   0/ 1 striper
122
   0/ 1 objecter
123
   0/ 5 rados
124
   0/ 5 rbd
125
   0/ 5 rbd_replay
126
   0/ 5 journaler
127
   0/ 5 objectcacher
128
   0/ 5 client
129
   0/ 5 osd
130
   0/ 5 optracker
131
   0/ 5 objclass
132
   1/ 3 filestore
133
   1/ 3 keyvaluestore
134
   1/ 3 journal
135
   0/ 5 ms
136
   1/ 5 mon
137
   0/10 monc
138
   1/ 5 paxos
139
   0/ 5 tp
140
   1/ 5 auth
141
   1/ 5 crypto
142
   1/ 1 finisher
143
   1/ 5 heartbeatmap
144
   1/ 5 perfcounter
145
   1/ 5 rgw
146
   1/10 civetweb
147
   1/ 5 javaclient
148
   1/ 5 asok
149
   1/ 1 throttle
150
   0/ 0 refs
151
  -2/-2 (syslog threshold)
152
  99/99 (stderr threshold)
153
  max_recent       500
154
  max_new         1000
155
  log_file
156
--- end dump of recent events ---
157
terminate called after throwing an instance of 'ceph::FailedAssertion'
158
*** Caught signal (Aborted) **
159
 in thread 7f7b45f2d7c0
160
 ceph version 0.87 (c51c8f9d80fa4e0168aa52685b8de40e42758578)
161
 1: rest-bench() [0x4c240a]
162
 2: (()+0x10340) [0x7f7b45907340]
163
 3: (gsignal()+0x39) [0x7f7b43e00bb9]
164
 4: (abort()+0x148) [0x7f7b43e03fc8]
165
 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f7b4470c6b5]
166
 6: (()+0x5e836) [0x7f7b4470a836]
167
 7: (()+0x5e863) [0x7f7b4470a863]
168
 8: (()+0x5eaa2) [0x7f7b4470aaa2]
169
 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x278) [0x4cdbe8]
170
 10: (ThreadPool::~ThreadPool()+0x126) [0x4c93a6]
171
 11: (RESTDispatcher::~RESTDispatcher()+0xe1) [0x4b6191]
172
 12: (main()+0x42e) [0x4b071e]
173
 13: (__libc_start_main()+0xf5) [0x7f7b43debec5]
174
 14: rest-bench() [0x4b1a47]
175
2015-02-25 18:46:30.398877 7f7b45f2d7c0 -1 *** Caught signal (Aborted) **
176
 in thread 7f7b45f2d7c0
177

    
178
 ceph version 0.87 (c51c8f9d80fa4e0168aa52685b8de40e42758578)
179
 1: rest-bench() [0x4c240a]
180
 2: (()+0x10340) [0x7f7b45907340]
181
 3: (gsignal()+0x39) [0x7f7b43e00bb9]
182
 4: (abort()+0x148) [0x7f7b43e03fc8]
183
 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f7b4470c6b5]
184
 6: (()+0x5e836) [0x7f7b4470a836]
185
 7: (()+0x5e863) [0x7f7b4470a863]
186
 8: (()+0x5eaa2) [0x7f7b4470aaa2]
187
 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x278) [0x4cdbe8]
188
 10: (ThreadPool::~ThreadPool()+0x126) [0x4c93a6]
189
 11: (RESTDispatcher::~RESTDispatcher()+0xe1) [0x4b6191]
190
 12: (main()+0x42e) [0x4b071e]
191
 13: (__libc_start_main()+0xf5) [0x7f7b43debec5]
192
 14: rest-bench() [0x4b1a47]
193
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
194

    
195
--- begin dump of recent events ---
196
     0> 2015-02-25 18:46:30.398877 7f7b45f2d7c0 -1 *** Caught signal (Aborted) **
197
 in thread 7f7b45f2d7c0
198

    
199
 ceph version 0.87 (c51c8f9d80fa4e0168aa52685b8de40e42758578)
200
 1: rest-bench() [0x4c240a]
201
 2: (()+0x10340) [0x7f7b45907340]
202
 3: (gsignal()+0x39) [0x7f7b43e00bb9]
203
 4: (abort()+0x148) [0x7f7b43e03fc8]
204
 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f7b4470c6b5]
205
 6: (()+0x5e836) [0x7f7b4470a836]
206
 7: (()+0x5e863) [0x7f7b4470a863]
207
 8: (()+0x5eaa2) [0x7f7b4470aaa2]
208
 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x278) [0x4cdbe8]
209
 10: (ThreadPool::~ThreadPool()+0x126) [0x4c93a6]
210
 11: (RESTDispatcher::~RESTDispatcher()+0xe1) [0x4b6191]
211
 12: (main()+0x42e) [0x4b071e]
212
 13: (__libc_start_main()+0xf5) [0x7f7b43debec5]
213
 14: rest-bench() [0x4b1a47]
214
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
215

    
216
--- logging levels ---
217
   0/ 5 none
218
   0/ 1 lockdep
219
   0/ 1 context
220
   1/ 1 crush
221
   1/ 5 mds
222
   1/ 5 mds_balancer
223
   1/ 5 mds_locker
224
   1/ 5 mds_log
225
   1/ 5 mds_log_expire
226
   1/ 5 mds_migrator
227
   0/ 1 buffer
228
   0/ 1 timer
229
   0/ 1 filer
230
   0/ 1 striper
231
   0/ 1 objecter
232
   0/ 5 rados
233
   0/ 5 rbd
234
   0/ 5 rbd_replay
235
   0/ 5 journaler
236
   0/ 5 objectcacher
237
   0/ 5 client
238
   0/ 5 osd
239
   0/ 5 optracker
240
   0/ 5 objclass
241
   1/ 3 filestore
242
   1/ 3 keyvaluestore
243
   1/ 3 journal
244
   0/ 5 ms
245
   1/ 5 mon
246
   0/10 monc
247
   1/ 5 paxos
248
   0/ 5 tp
249
   1/ 5 auth
250
   1/ 5 crypto
251
   1/ 1 finisher
252
   1/ 5 heartbeatmap
253
   1/ 5 perfcounter
254
   1/ 5 rgw
255
   1/10 civetweb
256
   1/ 5 javaclient
257
   1/ 5 asok
258
   1/ 1 throttle
259
   0/ 0 refs
260
  -2/-2 (syslog threshold)
261
  99/99 (stderr threshold)
262
  max_recent       500
263
  max_new         1000
264
  log_file
265
--- end dump of recent events ---
266
Aborted