Actions
Bug #10920
closedceph-osd fails on startup: ERROR: osd init failed: (1) Operation not permitted
Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
the teuth failure trace looks like
764068/summary.yaml:failure_reason: 'Command failed on plana12 with status 1: ''sync && sudo umount -f 764068/summary.yaml- /var/lib/ceph/osd/ceph-0'''
the mkfs succeeds:
2015-02-18T19:50:23.967 INFO:teuthology.orchestra.run.plana12:Running: 'sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/monmap' 2015-02-18T19:50:24.230 INFO:teuthology.orchestra.run.plana12.stderr:2015-02-18 19:50:24.229139 7f0055b74780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2015-02-18T19:50:24.688 INFO:teuthology.orchestra.run.plana12.stderr:2015-02-18 19:50:24.687402 7f0055b74780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2015-02-18T19:50:24.696 INFO:teuthology.orchestra.run.plana12.stderr:2015-02-18 19:50:24.696016 7f0055b74780 -1 filestore(/var/lib/ceph/osd/ceph-0) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory 2015-02-18T19:50:24.914 INFO:teuthology.orchestra.run.plana12.stderr:2015-02-18 19:50:24.913537 7f0055b74780 -1 created object store /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal for osd.0 fsid 76b60f12-f734-48c6-be64-1a8e72ec3f3a 2015-02-18T19:50:24.915 INFO:teuthology.orchestra.run.plana12.stderr:2015-02-18 19:50:24.913595 7f0055b74780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2015-02-18T19:50:24.915 INFO:teuthology.orchestra.run.plana12.stderr:2015-02-18 19:50:24.913749 7f0055b74780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring
but startup fails:
2015-02-18T19:50:32.504 INFO:tasks.ceph.osd.1:Started
2015-02-18T19:50:32.572 INFO:tasks.ceph.osd.1.plana34.stdout:starting osd.1 at :/0 osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal
2015-02-18T19:50:32.886 INFO:tasks.ceph.osd.1.plana34.stderr:2015-02-18 19:50:32.884957 7f6698ad3780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2015-02-18T19:50:32.893 INFO:tasks.ceph.osd.1.plana34.stderr:2015-02-18 19:50:32.892711 7f6698ad3780 -1 osd.1 0 log_to_monitors {default=true}
2015-02-18T19:50:32.994 INFO:tasks.ceph.osd.1.plana34.stderr:2015-02-18 19:50:32.993355 7f6698ad3780 -1 ESC[0;31m ** ERROR: osd init failed: (1) Operation not permittedESC[0m
2015-02-18T19:50:33.161 INFO:tasks.ceph.osd.1.plana34.stderr:daemon-helper: command failed with exit status 1
..and because ceph.py hasn't started yet (i think?) it doesn't gather up any useful logs.
ubuntu@teuthology:/a/sage-2015-02-17_22:30:59-rados-wip-sage-testing-distro-basic-multi/764068
ubuntu@teuthology:/a/sage-2015-02-17_22:30:59-rados-wip-sage-testing-distro-basic-multi/764162
ubuntu@teuthology:/a/sage-2015-02-17_22:30:59-rados-wip-sage-testing-distro-basic-multi/764256
Actions