Project

General

Profile

Actions

Bug #40871

closed

osd status reports old crush location after osd moves

Added by Noah Watkins almost 5 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
luminous, mimic, nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Scenario:

Move an OSD disk from host=worker1 to a new node (host=worker0) and on that new node we update the crush location (e.g. host=worker0). After the OSD starts up `ceph osd status` reports the old location, but `ceph osd tree` reports the new location.

[nwatkins@smash rook]$ kubectl -n rook-ceph exec -it rook-ceph-tools-7cf4cc7568-kz4q6 ceph osd status
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| id |   host  |  used | avail | wr ops | wr data | rd ops | rd data |   state   |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| 0  | worker1 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
| 1  | worker0 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
[nwatkins@smash rook]$ kubectl -n rook-ceph exec -it rook-ceph-tools-7cf4cc7568-kz4q6 ceph osd tree
ID CLASS WEIGHT  TYPE NAME        STATUS REWEIGHT PRI-AFF 
-1       0.01758 root default                             
-5       0.01758     host worker0                         
 0   hdd 0.00879         osd.0        up  1.00000 1.00000 
 1   hdd 0.00879         osd.1        up  1.00000 1.00000 

And then after restarting the manager, `ceph osd status` also starts reporting the correct location

[nwatkins@smash rook]$ kubectl -n rook-ceph exec -it rook-ceph-tools-7cf4cc7568-kz4q6 ceph osd status
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| id |   host  |  used | avail | wr ops | wr data | rd ops | rd data |   state   |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+
| 0  | worker0 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
| 1  | worker0 | 1027M | 8188M |    0   |     0   |    0   |     0   | exists,up |
+----+---------+-------+-------+--------+---------+--------+---------+-----------+

related: http://tracker.ceph.com/issues/40011


Related issues 5 (0 open5 closed)

Related to mgr - Bug #40011: ceph -s shows wrong number of pools when pool was deletedResolvedDaniel Oliveira

Actions
Copied to mgr - Backport #41982: luminous: osd status reports old crush location after osd movesRejectedActions
Copied to mgr - Backport #41983: nautilus: osd status reports old crush location after osd movesResolvedKefu ChaiActions
Copied to mgr - Backport #41984: mimic: osd status reports old crush location after osd movesRejectedActions
Copied to mgr - Bug #44446: osd status reports old crush location after osd movesResolvedKefu Chai

Actions
Actions #2

Updated by Sebastian Wagner over 4 years ago

  • Related to Bug #40011: ceph -s shows wrong number of pools when pool was deleted added
Actions #3

Updated by Kefu Chai over 4 years ago

  • Assignee set to Kefu Chai
Actions #4

Updated by Kefu Chai over 4 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 30448
Actions #5

Updated by Kefu Chai over 4 years ago

  • Backport set to mimic, nautilus
Actions #6

Updated by Kefu Chai over 4 years ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from mimic, nautilus to luminous, mimic, nautilus
Actions #7

Updated by Nathan Cutler over 4 years ago

  • Copied to Backport #41982: luminous: osd status reports old crush location after osd moves added
Actions #8

Updated by Nathan Cutler over 4 years ago

  • Copied to Backport #41983: nautilus: osd status reports old crush location after osd moves added
Actions #9

Updated by Nathan Cutler over 4 years ago

  • Copied to Backport #41984: mimic: osd status reports old crush location after osd moves added
Actions #10

Updated by Kefu Chai about 4 years ago

  • Copied to Bug #44446: osd status reports old crush location after osd moves added
Actions #11

Updated by Nathan Cutler about 3 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions

Also available in: Atom PDF