Ceph » RADOS

/a/teuthology-2020-04-26_07:01:02-rados-master-distro-basic-smithi/4985666

2020-04-26T19:18:59.437 INFO:teuthology.orchestra.run.smithi045:> CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t
2020-04-26T19:19:54.159 INFO:tasks.ceph.mgr.x.smithi045.stderr:2020-04-26T19:19:54.157+0000 7fce37e0e700 -1 mgr.server reply reply (11) Resource temporarily unavailable Some objects (0.008913) are degraded; try again later
2020-04-26T19:19:54.662 INFO:tasks.ceph.mgr.x.smithi045.stderr:2020-04-26T19:19:54.659+0000 7fce37e0e700 -1 mgr.server reply reply (2) No such file or directory plan test_plan not found
2020-04-26T19:19:55.169 INFO:tasks.ceph.mgr.x.smithi045.stderr:2020-04-26T19:19:55.166+0000 7fce37e0e700 -1 mgr.server reply reply (2) No such file or directory plan test_plan not found
2020-04-26T19:19:55.817 INFO:tasks.cram.client.0.smithi045.stdout:/home/ubuntu/cephtest/archive/cram.client.0/misplaced.t: failed
2020-04-26T19:19:55.827 DEBUG:teuthology.orchestra.run:got remote process result: 1
2020-04-26T19:19:55.828 INFO:tasks.cram.client.0.smithi045.stdout:--- misplaced.t
2020-04-26T19:19:55.828 INFO:tasks.cram.client.0.smithi045.stdout:+++ misplaced.t.err
2020-04-26T19:19:55.828 INFO:tasks.cram.client.0.smithi045.stdout:@@ -13,11 +13,13 @@
2020-04-26T19:19:55.829 INFO:tasks.cram.client.0.smithi045.stdout: # Turn off active balancer to use manual commands
2020-04-26T19:19:55.829 INFO:tasks.cram.client.0.smithi045.stdout:   $ ceph balancer off
2020-04-26T19:19:55.829 INFO:tasks.cram.client.0.smithi045.stdout:   $ ceph balancer optimize test_plan balancer_opt
2020-04-26T19:19:55.829 INFO:tasks.cram.client.0.smithi045.stdout:+  Error EAGAIN: Some objects (0.008913) are degraded; try again later
2020-04-26T19:19:55.830 INFO:tasks.cram.client.0.smithi045.stdout:+  [11]
2020-04-26T19:19:55.830 INFO:tasks.cram.client.0.smithi045.stdout:   $ ceph balancer ls
2020-04-26T19:19:55.830 INFO:tasks.cram.client.0.smithi045.stdout:-  [
2020-04-26T19:19:55.836 INFO:tasks.cram.client.0.smithi045.stdout:-      "test_plan" 
2020-04-26T19:19:55.836 INFO:tasks.cram.client.0.smithi045.stdout:-  ]
2020-04-26T19:19:55.837 INFO:tasks.cram.client.0.smithi045.stdout:+  []
2020-04-26T19:19:55.837 INFO:tasks.cram.client.0.smithi045.stdout:   $ ceph balancer execute test_plan
2020-04-26T19:19:55.837 INFO:tasks.cram.client.0.smithi045.stdout:+  Error ENOENT: plan test_plan not found
2020-04-26T19:19:55.837 INFO:tasks.cram.client.0.smithi045.stdout:+  [2]
2020-04-26T19:19:55.838 INFO:tasks.cram.client.0.smithi045.stdout:   $ ceph balancer eval
2020-04-26T19:19:55.838 INFO:tasks.cram.client.0.smithi045.stdout:   current cluster score [0-9]*\.?[0-9]+.* (re)
2020-04-26T19:19:55.838 INFO:tasks.cram.client.0.smithi045.stdout: # Plan is gone after execution ?
2020-04-26T19:19:55.838 INFO:tasks.cram.client.0.smithi045.stdout:# Ran 1 tests, 0 skipped, 1 failed.

The degraded state cleared about two minutes later.

2020-04-26T19:19:57.061875+0000 mgr.x (mgr.4103) 90 : cluster [DBG] pgmap v93: 8 pgs: 8 active+clean; 0 B data, 59 GiB used, 238 GiB / 300 GiB avail
2020-04-26T19:19:57.759798+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 194/21766 objects degraded (0.891%), 5 pgs degraded)
2020-04-26T19:19:57.759830+0000 mon.a (mon.0) 139 : cluster [INF] Cluster is now healthy