Project

General

Profile

Actions
Copy link

Bug #12013

closed

assert(info->on_notify_finish) in Objecter::handle_watch_notify(MWatchNotify*)'

Added by Kefu Chai almost 9 years ago. Updated about 7 years ago.

Status:
Can't reproduce
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://pulpito.ceph.com/ubuntu-2015-06-12_21:23:04-rados-wip-kefu-testing---basic-multi/930883/

crashed in multi_stress_watch.

2015-06-13T23:03:52.876 INFO:tasks.workunit.client.0.burnupi34.stderr:Iteration 8274
2015-06-13T23:03:52.886 INFO:tasks.workunit.client.0.burnupi34.stderr:Iteration 8275
2015-06-13T23:03:52.916 INFO:tasks.workunit.client.0.burnupi34.stderr:Iteration 8276
2015-06-13T23:03:52.926 INFO:tasks.workunit.client.0.burnupi34.stderr:Iteration 8277
2015-06-13T23:03:52.936 INFO:tasks.workunit.client.0.burnupi34.stderr:Iteration 8278
2015-06-13T23:03:52.948 INFO:tasks.workunit.client.0.burnupi34.stderr:Iteration 8279
2015-06-13T23:03:52.948 INFO:tasks.workunit.client.0.burnupi34.stderr:osdc/Objecter.cc: In function 'void Objecter::handle_watch_notify(MWatchNotify*)' thread 7fd17c7f8700 time 2015-06-13 23:03:52.942877
2015-06-13T23:03:52.948 INFO:tasks.workunit.client.0.burnupi34.stderr:osdc/Objecter.cc: 796: FAILED assert(info->on_notify_finish)
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: ceph version 9.0.1-903-gfffc4bd (fffc4bd7cbdb2e7796497024bca1ec202fe27c7f)
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: 1: (()+0x1587eb) [0x7fd18a0657eb]
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: 2: (()+0xcbce5) [0x7fd189fd8ce5]
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: 3: (()+0xe86eb) [0x7fd189ff56eb]
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: 4: (()+0x2d63a6) [0x7fd18a1e33a6]
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: 5: (()+0x2f645a) [0x7fd18a20345a]
2015-06-13T23:03:52.949 INFO:tasks.workunit.client.0.burnupi34.stderr: 6: (()+0x2f9acd) [0x7fd18a206acd]
2015-06-13T23:03:52.950 INFO:tasks.workunit.client.0.burnupi34.stderr: 7: (()+0x8182) [0x7fd189cf7182]
2015-06-13T23:03:52.950 INFO:tasks.workunit.client.0.burnupi34.stderr: 8: (clone()+0x6d) [0x7fd188ffc38d]
2015-06-13T23:03:52.950 INFO:tasks.workunit.client.0.burnupi34.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2015-06-13T23:03:52.950 INFO:tasks.workunit.client.0.burnupi34.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion'
2015-06-13T23:03:52.965 INFO:tasks.workunit.client.0.burnupi34.stderr:Aborted (core dumped)
2015-06-13T23:03:52.967 INFO:tasks.workunit:Stopping ['rados/stress_watch.sh'] on client.0...

it was a test branch, but i don't this issue is related to the changes under testing. and i am not able to reproduce it using the same configuration, see http://pulpito.ceph.com/ubuntu-2015-06-14_06:07:33-rados-wip-kefu-testing---basic-multi/933027/ .

Actions
Copy link
 #1

Updated by Kefu Chai almost 9 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by Kefu Chai almost 9 years ago

  • Source changed from Community (dev) to Development
Actions
Copy link
 #3

Updated by Samuel Just almost 9 years ago

  • Priority changed from Normal to Urgent
Actions
Copy link
 #4

Updated by David Zafman almost 9 years ago

  • Status changed from New to In Progress
  • Assignee set to David Zafman

Trying to understand how this could happen and reproduce it.

Actions
Copy link
 #5

Updated by Samuel Just almost 9 years ago

  • Priority changed from Urgent to High
Actions
Copy link
 #6

Updated by David Zafman over 8 years ago

  • Status changed from In Progress to 12
  • Assignee deleted (David Zafman)
Actions
Copy link
 #7

Updated by Samuel Just over 8 years ago

  • Status changed from 12 to Can't reproduce
Actions
Copy link
 #8

Updated by Yuri Weinstein about 8 years ago

  • Status changed from Can't reproduce to New

Run: http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-04-11_02:00:06-rados-infernalis-distro-basic-openstack/
Job: 33362
Logs: http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-04-11_02:00:06-rados-infernalis-distro-basic-openstack/33362/teuthology.log

2016-04-11T07:20:01.009 INFO:tasks.workunit.client.0.target094164.stderr:osdc/Objecter.cc: In function 'void Objecter::handle_watch_notify(MWatchNotify*)' thread 7f28e0666700 time 2016-04-11 07:20:00.966804
2016-04-11T07:20:01.009 INFO:tasks.workunit.client.0.target094164.stderr:osdc/Objecter.cc: 821: FAILED assert(info->on_notify_finish)
2016-04-11T07:20:01.009 INFO:tasks.workunit.client.0.target094164.stderr: ceph version 9.2.1-14-geff3ff4 (eff3ff4cbe9bfef7c6429b183f7dc0a16359c395)
2016-04-11T07:20:01.009 INFO:tasks.workunit.client.0.target094164.stderr: 1: (()+0x13cbeb) [0x7f28e8474beb]
2016-04-11T07:20:01.009 INFO:tasks.workunit.client.0.target094164.stderr: 2: (()+0xb4cf4) [0x7f28e83eccf4]
2016-04-11T07:20:01.009 INFO:tasks.workunit.client.0.target094164.stderr: 3: (()+0xc96fb) [0x7f28e84016fb]
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr: 4: (()+0x2ab936) [0x7f28e85e3936]
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr: 5: (()+0x2c4414) [0x7f28e85fc414]
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr: 6: (()+0x2cc6dd) [0x7f28e86046dd]
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr: 7: (()+0x8182) [0x7f28e8122182]
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr: 8: (clone()+0x6d) [0x7f28e742747d]
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2016-04-11T07:20:01.010 INFO:tasks.workunit.client.0.target094164.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion'
Actions
Copy link
 #9

Updated by Sage Weil about 7 years ago

  • Status changed from New to Can't reproduce
Actions
Copy link

Also available in: Atom PDF