Project

General

Profile

Bug #40871

osd status reports old crush location after osd moves

Added by Noah Watkins about 1 year ago. Updated about 1 year ago.

Status:
Pending Backport
Priority:
High
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
luminous, mimic, nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

Scenario:

Move an OSD disk from host=worker1 to a new node (host=worker0) and on that new node we update the crush location (e.g. host=worker0). After the OSD starts up `ceph osd status` reports the old location, but `ceph osd tree` reports the new location.

[nwatkins@smash rook]$ kubectl -n rook-ceph exec -it rook-ceph-tools-7cf4cc7568-kz4q6 ceph osd status
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| id |   host  |  used | avail | wr ops | wr data | rd ops | rd data |   state   |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| 0  | worker1 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
| 1  | worker0 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
[nwatkins@smash rook]$ kubectl -n rook-ceph exec -it rook-ceph-tools-7cf4cc7568-kz4q6 ceph osd tree
ID CLASS WEIGHT  TYPE NAME        STATUS REWEIGHT PRI-AFF 
-1       0.01758 root default                             
-5       0.01758     host worker0                         
 0   hdd 0.00879         osd.0        up  1.00000 1.00000 
 1   hdd 0.00879         osd.1        up  1.00000 1.00000 

And then after restarting the manager, `ceph osd status` also starts reporting the correct location

[nwatkins@smash rook]$ kubectl -n rook-ceph exec -it rook-ceph-tools-7cf4cc7568-kz4q6 ceph osd status
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| id |   host  |  used | avail | wr ops | wr data | rd ops | rd data |   state   |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| 0  | worker0 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
| 1  | worker0 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+

related: http://tracker.ceph.com/issues/40011


Related issues

Related to mgr - Bug #40011: ceph -s shows wrong number of pools when pool was deleted Resolved
Copied to mgr - Backport #41982: luminous: osd status reports old crush location after osd moves New
Copied to mgr - Backport #41983: nautilus: osd status reports old crush location after osd moves Resolved
Copied to mgr - Backport #41984: mimic: osd status reports old crush location after osd moves New
Copied to mgr - Bug #44446: osd status reports old crush location after osd moves Pending Backport

History

#2 Updated by Sebastian Wagner about 1 year ago

  • Related to Bug #40011: ceph -s shows wrong number of pools when pool was deleted added

#3 Updated by Kefu Chai about 1 year ago

  • Assignee set to Kefu Chai

#4 Updated by Kefu Chai about 1 year ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 30448

#5 Updated by Kefu Chai about 1 year ago

  • Backport set to mimic, nautilus

#6 Updated by Kefu Chai about 1 year ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from mimic, nautilus to luminous, mimic, nautilus

#7 Updated by Nathan Cutler about 1 year ago

  • Copied to Backport #41982: luminous: osd status reports old crush location after osd moves added

#8 Updated by Nathan Cutler about 1 year ago

  • Copied to Backport #41983: nautilus: osd status reports old crush location after osd moves added

#9 Updated by Nathan Cutler about 1 year ago

  • Copied to Backport #41984: mimic: osd status reports old crush location after osd moves added

#10 Updated by Kefu Chai 7 months ago

  • Copied to Bug #44446: osd status reports old crush location after osd moves added

Also available in: Atom PDF