Project

General

Profile

Actions

Bug #5055

closed

osd: crash in FileJournal::wrap_read_bl

Added by Tamilarasi muthamizhan almost 11 years ago. Updated almost 11 years ago.

Status:
Rejected
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

logs: ubuntu@teuthology:/a/teuthology-2013-05-12_01:00:05-rados-master-testing-basic/11664

2013-05-12T05:21:53.889 INFO:teuthology.task.ceph.osd.1.err:2013-05-12 05:22:12.878074 7fbe3924a780 -1 journal FileJournal::wrap_read_bl: safe_read_exact 104091206~766394 returned -5
2013-05-12T05:21:53.892 INFO:teuthology.task.ceph.osd.1.err:os/FileJournal.cc: In function 'void FileJournal::wrap_read_bl(off64_t, int64_t, ceph::bufferlist*, off64_t*)' thread 7fbe3924a780 time 2013-05-12 05:22:12.878104
2013-05-12T05:21:53.892 INFO:teuthology.task.ceph.osd.1.err:os/FileJournal.cc: 1640: FAILED assert(0)
2013-05-12T05:21:53.892 INFO:teuthology.task.ceph.osd.1.err: ceph version 0.61-249-gb5e9b56 (b5e9b56fc93dd4896c802aff1096430b523ad84c)
2013-05-12T05:21:53.892 INFO:teuthology.task.ceph.osd.1.err: 1: (FileJournal::wrap_read_bl(long, long, ceph::buffer::list*, long*)+0x2dc) [0x70f89c]
2013-05-12T05:21:53.892 INFO:teuthology.task.ceph.osd.1.err: 2: (FileJournal::do_read_entry(long, long*, ceph::buffer::list*, unsigned long*, std::ostream*, FileJournal::entry_header_t*)+0x2f1) [0x71a781]
2013-05-12T05:21:53.892 INFO:teuthology.task.ceph.osd.1.err: 3: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x280) [0x71b330]
2013-05-12T05:21:53.893 INFO:teuthology.task.ceph.osd.1.err: 4: (JournalingObjectStore::journal_replay(unsigned long)+0x33d) [0x762a3d]
2013-05-12T05:21:53.893 INFO:teuthology.task.ceph.osd.1.err: 5: (FileStore::mount()+0x3994) [0x747094]
2013-05-12T05:21:53.893 INFO:teuthology.task.ceph.osd.1.err: 6: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x60fdaa]
2013-05-12T05:21:53.893 INFO:teuthology.task.ceph.osd.1.err: 7: (OSD::convertfs(std::string const&, std::string const&)+0x47) [0x610827]
2013-05-12T05:21:53.893 INFO:teuthology.task.ceph.osd.1.err: 8: (main()+0x2239) [0x5804e9]
2013-05-12T05:21:53.893 INFO:teuthology.task.ceph.osd.1.err: 9: (__libc_start_main()+0xed) [0x7fbe36ce676d]
2013-05-12T05:21:53.894 INFO:teuthology.task.ceph.osd.1.err: 10: ceph-osd() [0x582cad]
2013-05-12T05:21:53.894 INFO:teuthology.task.ceph.osd.1.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-05-12T05:21:53.894 INFO:teuthology.task.ceph.osd.1.err:2013-05-12 05:22:12.880790 7fbe3924a780 -1 os/FileJournal.cc: In function 'void FileJournal::wrap_read_bl(off64_t, int64_t, ceph::bufferlist*, off64_t*)' thread 7fbe3924a780 time 2013-05-12 05:22:12.878104

ubuntu@teuthology:/a/teuthology-2013-05-12_01:00:05-rados-master-testing-basic/11664$ cat config.yaml 
kernel: &id001
  kdb: true
  sha1: b5b09be30cf99f9c699e825629f02e3bce555d44
machine_type: plana
nuke-on-error: true
overrides:
  ceph:
    conf:
      mds:
        debug mds: 20
        debug ms: 1
      mon:
        debug mon: 20
        debug ms: 20
        debug paxos: 20
      osd:
        filestore flush min: 0
    fs: xfs
    log-whitelist:
    - slow request
    sha1: b5e9b56fc93dd4896c802aff1096430b523ad84c
  s3tests:
    branch: master
  workunit:
    sha1: b5e9b56fc93dd4896c802aff1096430b523ad84c
roles:
- - mon.0
  - mon.1
  - mon.2
  - mds.0
  - client.0
- - osd.0
- - osd.1
- - osd.2
targets:
  ubuntu@plana19.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0IExVUuQEnwBzUbN6+jgEb/qLLsSDFLAe0OPv+R3Q3uUZn+4QjB+FQ3sMMEwaGpEhUfbpWn3xZbCmi4NngTsgPDjImYJPMeMecaxvVXqAJt4IM6gdBN0415lrKXtbXaGBJCmeFFDB+xN+JN6Qhk8DWN62DnJB8MS5vKn9u0S3HvtGzY/QrnutT3AX9I4097isbTepLFRC4n2CoAC9srXaxAprFgLgOIYHm386B3W7yK3yfIImWofvZxYpPCsr/7ws8DSgdRX9eDucGQfY2WcYKCEIgZclGPBhExm7q/ahHUqYKrzWY3RD93AuXJVgOJk5Yp8C1Ryx8vyJkAxBW4nb
  ubuntu@plana30.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEzCaiAZLBoqkSTHnjHm2BVYysqJcG3wVhKv7Z/tZYeJcDjR5Q/RgsaXHXqDdh5aW51DeRN7ysvl3TSyPhVg2cW4pAM1vCZbMjaic6Ejg9EWrrQSYAWresy+G1AN/fieV5Hdj588u+9NRRiCNmDxKXW219KFAf8xQn2L5zIBuGIu4JEfX2W/hlICOujxbdsH5i90kzsri0TITWHG1ZM8lwCVFyBUJdNi7FmNVgn4c0DjaMWp61jZBIuKtIYI41ZRLCLTjW+iRCNoqCfIc96fMs6FAjYk920WufUntpwJaPIW0pnlrsSbAPw+VSP031rY9teklXcoMPNH/MUdTDgfk7
  ubuntu@plana41.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkgrMFU0RPLM3d4x1XXKdJ72MLaLClugHDHIc4UGIiK1o3qNmqYgsqp5ENVe2cwgD8M2xh25mQ1rLBYH6pzaxbgfQnKJlB27tpeOo1j/I45tUbYrng0CD8Z7BhPNB8KyODfm3CiaweHESvvrHvyXojOU6G/juyVDh3DJr2izPS3bsLQvReZq2EeDgzI/0iFgTUILlgB3BqA3yV+AkvRVWaQ/xyd8re1RavmftxULfcFlBu/gTO3u/2+p5idG1Pg4zuzqocMzyWXWrbbH5huvfjk24hb+ud3Ed4qBzQbinaKVaz2jz9Z9wMwzVjqIYgbgfUJxkk4CsIRlCdFBk7yKNp
  ubuntu@plana43.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/sM+tk86Dl9EeTk49zN9mfwYFfwJcYKVIdEnfFpNie9+cM+X1SSorAP+J08fzKa5P4S44izIiAG8bVHzWpWg667ks1FUBNXaUuJQrd2gUU3VFCBgx/sZeWrc7ShUtCTKYImrfIvXEemAc65bQKga10StnfOtZy+NgfwOJb7S05RBnGzfzqtAU7Ny+SEjZcu+80/uIOHWlPwxU4/nkOUEVKzGg77a9e5vrg49MuKXRr8aF03+gTEc2WBKXkpMCHlIU0tB96QN+vdCHjz9gIcZ7aq+3SN6KRSVEoWd2CwYwOTpRHrmYpFQG7zkZkJxRDQ17QXNfg4v/CRfQzEs0MpJt
tasks:
- internal.lock_machines:
  - 4
  - plana
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install: null
- ceph: null
- thrashosds:
    chance_down: 1.0
    powercycle: true
- ceph-fuse: null
- workunit:
    clients:
      all:
      - suites/ffsb.sh

Actions #1

Updated by Samuel Just almost 11 years ago

  • Assignee set to Samuel Just
Actions #2

Updated by Samuel Just almost 11 years ago

  • Status changed from New to Rejected

wrap_read_bl returned EIO.

Actions

Also available in: Atom PDF