Actions
Bug #16805
closed"osd reweight-by-utilization" fails: Refusing to reweight: we only have 584164 kb used across all osds
% Done:
0%
Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2016-07-24T21:26:58.049 INFO:tasks.thrashosds.thrasher:Reweighting by: {'overage': '1000', 'type': 'reweight-by-utilization', 'max_change': '0.05'} 2016-07-24T21:26:58.050 INFO:teuthology.orchestra.run.mira101:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05'
2016-07-24T21:26:58.633 INFO:teuthology.orchestra.run.mira101.stderr:2016-07-25 04:26:58.629902 7f0889763700 1 -- 172.21.8.118:0/3981205993 <== mon.0 172.21.7.112:6789/0 8 ==== mo n_command_ack([{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 0.05}]=-33 Refusing to reweight: we only have 584164 kb used across all osds! v291) v1 ==== 17 6+0+0 (1169973010 0 0) 0x7f0870001240 con 0x7f0884064ec0
see http://pulpito.ceph.com/kchai-2016-07-24_20:41:33-rados-wip-kefu-testing---basic-mira/331659/
the mon_reweight_min_bytes_per_osd
by default is 100MB = 102400 kb. while we had 584164 kb on average.
Updated by Kefu Chai over 7 years ago
- Has duplicate Bug #16823: "Error EDOM: Refusing to reweight: we only have 592640 kb used across all osds!" in rados run added
Updated by Kefu Chai over 7 years ago
- Has duplicate Bug #16929: thrashosds test-reweight-by-utilization failing due to sanity check, need to fix test added
Updated by Kefu Chai over 7 years ago
- http://pulpito.ceph.com/kchai-2016-08-22_14:13:39-rados-wip-16805---basic-mira/378715/
- '/home/ubuntu/cephtest/archive/syslog/kern.log:2016-08-22T14:25:28.082631+00:00 mira112 kernel: [ INFO: possible circular locking dependency detected ] ' in syslog
- 1x at http://pulpito.ceph.com/kchai-2016-08-22_15:22:21-rados-wip-16805---basic-mira/
- '/home/ubuntu/cephtest/archive/syslog/kern.log:2016-08-22T15:32:59.880235+00:00 mira112 kernel: [ INFO: possible circular locking dependency detected ] ' in syslog
- 10x at http://pulpito.front.sepia.ceph.com:80/kchai-2016-08-22_15:23:53-rados-wip-16805---basic-mira/
Updated by Kefu Chai over 7 years ago
with 6 OSDs, 584164 * 1024 / 6 < 1024 * 1024 * 100. so we need to change "mon_reweight_min_bytes_per_osd" to a smaller number
Updated by Kefu Chai over 7 years ago
- Status changed from New to Fix Under Review
Updated by Kefu Chai over 7 years ago
- Status changed from Fix Under Review to Resolved
Actions