Project

General

Profile

Actions
Copy link

Bug #10629

closed

osd/PG.cc: 2775: FAILED assert(values.size() == 2)

Added by Sage Weil over 9 years ago. Updated about 9 years ago.

Status:
Duplicate
Priority:
Urgent
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2015-01-23T20:28:29.264 INFO:tasks.thrashosds.thrasher:Use ceph_objectstore_tool to remove past intervals
2015-01-23T20:28:29.264 INFO:teuthology.orchestra.run.mira002:Running: 'sudo ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --log-file=/var/log/ceph/objectstore_tool.\\$pid.log --op list-pgs'
2015-01-23T20:28:31.577 INFO:teuthology.orchestra.run.mira002:Running: 'sudo ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --log-file=/var/log/ceph/objectstore_tool.\\$pid.log --op rm-past-intervals --pgid 2.1'
2015-01-23T20:28:32.183 INFO:teuthology.orchestra.run.mira002.stderr:osd/PG.cc: In function 'static epoch_t PG::peek_map_epoch(ObjectStore*, spg_t, ceph::bufferlist*)' thread 7f1c29671900 time 2015-01-23 20:28:32.181137
2015-01-23T20:28:32.184 INFO:teuthology.orchestra.run.mira002.stderr:osd/PG.cc: 2775: FAILED assert(values.size() == 2)
2015-01-23T20:28:32.184 INFO:teuthology.orchestra.run.mira002.stderr: ceph version 0.91-716-gb782030 (b782030e872254f2175196f966863a26b20f7296)
2015-01-23T20:28:32.184 INFO:teuthology.orchestra.run.mira002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0xbc4ccb]
2015-01-23T20:28:32.184 INFO:teuthology.orchestra.run.mira002.stderr: 2: (PG::peek_map_epoch(ObjectStore*, spg_t, ceph::buffer::list*)+0x865) [0x6b42c5]
2015-01-23T20:28:32.185 INFO:teuthology.orchestra.run.mira002.stderr: 3: (main()+0x45ea) [0x65990a]
2015-01-23T20:28:32.185 INFO:teuthology.orchestra.run.mira002.stderr: 4: (__libc_start_main()+0xf5) [0x7f1c23f2fec5]
2015-01-23T20:28:32.185 INFO:teuthology.orchestra.run.mira002.stderr: 5: ceph-objectstore-tool() [0x672e17]
2015-01-23T20:28:32.185 INFO:teuthology.orchestra.run.mira002.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2015-01-23T20:28:32.186 INFO:teuthology.orchestra.run.mira002.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion'
2015-01-23T20:28:32.187 INFO:teuthology.orchestra.run.mira002.stderr:*** Caught signal (Aborted) **
2015-01-23T20:28:32.187 INFO:teuthology.orchestra.run.mira002.stderr: in thread 7f1c29671900
2015-01-23T20:28:32.187 INFO:teuthology.orchestra.run.mira002.stderr: ceph version 0.91-716-gb782030 (b782030e872254f2175196f966863a26b20f7296)
2015-01-23T20:28:32.187 INFO:teuthology.orchestra.run.mira002.stderr: 1: ceph-objectstore-tool() [0xae3e6a]
2015-01-23T20:28:32.188 INFO:teuthology.orchestra.run.mira002.stderr: 2: (()+0x10340) [0x7f1c28118340]
2015-01-23T20:28:32.188 INFO:teuthology.orchestra.run.mira002.stderr: 3: (gsignal()+0x39) [0x7f1c23f44bb9]
2015-01-23T20:28:32.188 INFO:teuthology.orchestra.run.mira002.stderr: 4: (abort()+0x148) [0x7f1c23f47fc8]
2015-01-23T20:28:32.188 INFO:teuthology.orchestra.run.mira002.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f1c248506b5]
2015-01-23T20:28:32.189 INFO:teuthology.orchestra.run.mira002.stderr: 6: (()+0x5e836) [0x7f1c2484e836]
2015-01-23T20:28:32.189 INFO:teuthology.orchestra.run.mira002.stderr: 7: (()+0x5e863) [0x7f1c2484e863]
2015-01-23T20:28:32.189 INFO:teuthology.orchestra.run.mira002.stderr: 8: (()+0x5eaa2) [0x7f1c2484eaa2]
2015-01-23T20:28:32.189 INFO:teuthology.orchestra.run.mira002.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x278) [0xbc4eb8]
2015-01-23T20:28:32.190 INFO:teuthology.orchestra.run.mira002.stderr: 10: (PG::peek_map_epoch(ObjectStore*, spg_t, ceph::buffer::list*)+0x865) [0x6b42c5]
2015-01-23T20:28:32.190 INFO:teuthology.orchestra.run.mira002.stderr: 11: (main()+0x45ea) [0x65990a]
2015-01-23T20:28:32.190 INFO:teuthology.orchestra.run.mira002.stderr: 12: (__libc_start_main()+0xf5) [0x7f1c23f2fec5]
2015-01-23T20:28:32.191 INFO:teuthology.orchestra.run.mira002.stderr: 13: ceph-objectstore-tool() [0x672e17]

ubuntu@teuthology:/a/samuelj-2015-01-23_06:57:45-rados-master-wip-testing-vanilla-fixes-basic-multi/719677

pg 2.1_head appears on disk, but never in the osd log. it was imported a bit earlier:


2015-01-23T20:28:04.706 INFO:tasks.thrashosds.thrasher:Moving pg 2.1 from osd.2 to osd.0
2015-01-23T20:28:04.706 INFO:teuthology.orchestra.run.mira002:Running: 'sudo ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --log-file=/var/log/ceph/objectstore_tool.\\$pid.log --op import --file /home/ubun
tu/cephtest/data/exp.2.1.2'
2015-01-23T20:28:04.829 INFO:teuthology.orchestra.run.mira002.stdout:Importing pgid 2.1

i tarred up the osd.0 data directories for reference. job is still running to, if you get to it before it gets cleaned up.

Related issues 1 (0 open — 1 closed)

Is duplicate of Ceph - Bug #6003: journal Unable to read past sequence 406 ...ResolvedSamuel Just08/15/2013

Actions
Actions
Copy link

Also available in: Atom PDF