Project

General

Profile

Actions

Bug #16805

closed

"osd reweight-by-utilization" fails: Refusing to reweight: we only have 584164 kb used across all osds

Added by Kefu Chai almost 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2016-07-24T21:26:58.049 INFO:tasks.thrashosds.thrasher:Reweighting by: {'overage': '1000', 'type': 'reweight-by-utilization', 'max_change': '0.05'}
2016-07-24T21:26:58.050 INFO:teuthology.orchestra.run.mira101:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd
 reweight-by-utilization 1000 0.05'
2016-07-24T21:26:58.633 INFO:teuthology.orchestra.run.mira101.stderr:2016-07-25 04:26:58.629902 7f0889763700  1 -- 172.21.8.118:0/3981205993 <== mon.0 172.21.7.112:6789/0 8 ==== mo
n_command_ack([{"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 0.05}]=-33 Refusing to reweight: we only have 584164 kb used across all osds! v291) v1 ==== 17
6+0+0 (1169973010 0 0) 0x7f0870001240 con 0x7f0884064ec0

see http://pulpito.ceph.com/kchai-2016-07-24_20:41:33-rados-wip-kefu-testing---basic-mira/331659/

the mon_reweight_min_bytes_per_osd by default is 100MB = 102400 kb. while we had 584164 kb on average.


Related issues 2 (0 open2 closed)

Has duplicate Ceph - Bug #16823: "Error EDOM: Refusing to reweight: we only have 592640 kb used across all osds!" in rados runDuplicate07/26/2016

Actions
Has duplicate Ceph - Bug #16929: thrashosds test-reweight-by-utilization failing due to sanity check, need to fix testDuplicate08/04/2016

Actions
Actions #1

Updated by Kefu Chai over 7 years ago

  • Has duplicate Bug #16823: "Error EDOM: Refusing to reweight: we only have 592640 kb used across all osds!" in rados run added
Actions #2

Updated by Kefu Chai over 7 years ago

  • Has duplicate Bug #16929: thrashosds test-reweight-by-utilization failing due to sanity check, need to fix test added
Actions #3

Updated by Kefu Chai over 7 years ago

  • Description updated (diff)
Actions #4

Updated by Kefu Chai over 7 years ago

Actions #5

Updated by Kefu Chai over 7 years ago

with 6 OSDs, 584164 * 1024 / 6 < 1024 * 1024 * 100. so we need to change "mon_reweight_min_bytes_per_osd" to a smaller number

Actions #6

Updated by Kefu Chai over 7 years ago

  • Status changed from New to Fix Under Review
Actions #7

Updated by Kefu Chai over 7 years ago

  • Status changed from Fix Under Review to Resolved
Actions

Also available in: Atom PDF