Bug #58460
Updated by Prashant D over 1 year ago
- cluster status : <pre> cluster: id: 28f7427e-5558-4ffd-ae1a-51ec3042759a health: HEALTH_ERR full ratio(s) out of order Low space hindering backfill (add storage if this doesn't resolve itself): 21 pgs backfill_toofull Degraded data redundancy: 137452/498931805 objects degraded (0.028%), 21 pgs degraded, 21 pgs undersized services: mon: 5 daemons, quorum reesi003,reesi002,reesi001,ivan02,ivan01 (age 9d) mgr: reesi006.erytot(active, since 7d), standbys: reesi005.xxyjcw, reesi004.tplfrt mds: 4/4 daemons up, 5 standby, 1 hot standby osd: 166 osds: 166 up (since 41h), 165 in (since 15h); 67 remapped pgs rgw: 2 daemons active (2 hosts, 1 zones) data: volumes: 4/4 healthy pools: 24 pools, 2965 pgs objects: 104.01M objects, 118 TiB usage: 207 TiB used, 850 TiB / 1.0 PiB avail pgs: 137452/498931805 objects degraded (0.028%) 2768577/498931805 objects misplaced (0.555%) 2898 active+clean 46 active+remapped+backfilling 21 active+undersized+degraded+remapped+backfill_toofull io: client: 4.6 KiB/s rd, 84 B/s wr, 5 op/s rd, 0 op/s wr recovery: 0 B/s, 4 objects/s progress: Global Recovery Event (22h) [===========================.] (remaining: 31m) </pre> - ceph health detail <pre> HEALTH_ERR full ratio(s) out of order; Low space hindering backfill (add storage if this doesn't resolve itself): 21 pgs backfill_toofull; Degraded data redundancy: 137452/498931805 objects degraded (0.028%), 21 pgs degraded, 21 pgs undersized [ERR] OSD_OUT_OF_ORDER_FULL: full ratio(s) out of order osd_failsafe_full_ratio (0.97) < full_ratio (0.99), increased [WRN] PG_BACKFILL_FULL: Low space hindering backfill (add storage if this doesn't resolve itself): 21 pgs backfill_toofull pg 124.4 is active+undersized+degraded+remapped+backfill_toofull, acting [41,52] pg 124.9 is active+undersized+degraded+remapped+backfill_toofull, acting [41,52] ... </pre>