Project

General

Profile

Actions
Copy link

Bug #43065

open

mira109 bad disk

Added by Yuri Weinstein over 4 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
Ceph - v14.2.5
ceph-qa-suite:
ceph-deploy
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2019-11-29_05:55:03-ceph-deploy-nautilus-distro-basic-mira/
Jobs: '4552171', '4552179', '4552155'
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2019-11-29_05:55:03-ceph-deploy-nautilus-distro-basic-mira/4552155/teuthology.log

2019-11-29T10:47:55.415 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING] Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.0 --yes-i-really-mean-it
2019-11-29T10:47:55.527 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]  stderr: 2019-11-29 10:47:55.479 7f32b804f700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory
2019-11-29T10:47:55.527 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING] 2019-11-29 10:47:55.479 7f32b804f700 -1 AuthRegistry(0x7f32b0080e88) no keyring found at /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx
2019-11-29T10:47:55.807 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]  stderr: purged osd.0
2019-11-29T10:47:55.807 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING] Traceback (most recent call last):
2019-11-29T10:47:55.807 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/sbin/ceph-volume", line 11, in <module>
2019-11-29T10:47:55.807 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     load_entry_point('ceph-volume==1.0.0', 'console_scripts', 'ceph-volume')()
2019-11-29T10:47:55.808 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/main.py", line 38, in __init__
2019-11-29T10:47:55.808 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     self.main(self.argv)
2019-11-29T10:47:55.808 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/decorators.py", line 59, in newfunc
2019-11-29T10:47:55.808 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     return f(*a, **kw)
2019-11-29T10:47:55.808 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/main.py", line 149, in main
2019-11-29T10:47:55.809 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     terminal.dispatch(self.mapper, subcommand_args)
2019-11-29T10:47:55.809 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/terminal.py", line 194, in dispatch
2019-11-29T10:47:55.809 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     instance.main()
2019-11-29T10:47:55.809 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/devices/lvm/main.py", line 40, in main
2019-11-29T10:47:55.810 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     terminal.dispatch(self.mapper, self.argv)
2019-11-29T10:47:55.810 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/terminal.py", line 194, in dispatch
2019-11-29T10:47:55.814 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     instance.main()
2019-11-29T10:47:55.814 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/devices/lvm/create.py", line 69, in main
2019-11-29T10:47:55.816 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     self.create(args)
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/decorators.py", line 16, in is_root
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     return func(*a, **kw)
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/devices/lvm/create.py", line 26, in create
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     prepare_step.safe_prepare(args)
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/devices/lvm/prepare.py", line 219, in safe_prepare
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     self.prepare()
2019-11-29T10:47:55.817 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/decorators.py", line 16, in is_root
2019-11-29T10:47:55.818 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     return func(*a, **kw)
2019-11-29T10:47:55.820 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/devices/lvm/prepare.py", line 294, in prepare
2019-11-29T10:47:55.820 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     osd_fsid,
2019-11-29T10:47:55.820 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/devices/lvm/prepare.py", line 63, in prepare_filestore
2019-11-29T10:47:55.820 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     prepare_utils.format_device(device)
2019-11-29T10:47:55.820 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/util/prepare.py", line 245, in format_device
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     process.run(command)
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]   File "/usr/lib/python2.7/dist-packages/ceph_volume/process.py", line 153, in run
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING]     raise RuntimeError(msg)
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][WARNING] RuntimeError: command returned non-zero exit status: 1
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[mira109][ERROR ] RuntimeError: command returned non-zero exit status: 1
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[ceph_deploy.osd][ERROR ] Failed to execute command: /usr/sbin/ceph-volume --cluster ceph lvm create --filestore --data vg_hdd/lv_4 --journal vg_hdd/lv_2
2019-11-29T10:47:55.821 INFO:teuthology.orchestra.run.mira041.stderr:[ceph_deploy][ERROR ] GenericError: Failed to create 1 OSDs
2019-11-29T10:47:55.822 INFO:teuthology.orchestra.run.mira041.stderr:
2019-11-29T10:47:55.842 DEBUG:teuthology.orchestra.run:got remote process result: 1
2019-11-29T10:47:55.842 INFO:tasks.ceph_deploy:Error encountered, logging exception before tearing down ceph-deploy
2019-11-29T10:47:55.843 INFO:tasks.ceph_deploy:Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_ceph_nautilus/qa/tasks/ceph_deploy.py", line 395, in build_ceph_cluster
    no_of_osds = ceph_volume_osd_create(ctx, config)
  File "/home/teuthworker/src/git.ceph.com_ceph_nautilus/qa/tasks/ceph_deploy.py", line 306, in ceph_volume_osd_create
    raise RuntimeError("ceph-deploy: Failed to create osds")
RuntimeError: ceph-deploy: Failed to create osds
Actions
Copy link
 #1

Updated by Sage Weil over 4 years ago

  • Project changed from Ceph to sepia
  • Subject changed from "ceph-deploy: Failed to create osds " in ceph-deploy to mira109 bad disk

mira109:
2019-11-29T12:51:25.133 INFO:teuthology.orchestra.run.mira038.stderr:[mira109][WARNING] stderr: mkfs.xfs: libxfs_device_zero write failed: Input/output error
[ 635.051528] blk_update_request: I/O error, dev dm-0, sector 2930277152
[ 635.058445] blk_update_request: I/O error, dev dm-0, sector 2930277152

Actions
Copy link
 #2

Updated by adam kraitman over 4 years ago

  • Priority changed from Urgent to Normal
Actions
Copy link

Also available in: Atom PDF