Actions
Bug #51223
openstatfs: a cluster with filestore and bluestore OSD's will report bytes_used == stored
Status:
New
Priority:
Low
Assignee:
-
Category:
Administration/Usability
Target version:
-
% Done:
0%
Source:
Community (dev)
Tags:
Backport:
Regression:
Yes
Severity:
4 - irritation
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Cluster migrated from Luminous mixed bluestore+filestore OSD's to Nautilus 14.2.21
After last filestore OSD purged from cluster, USED calculated properly
RAW STORAGE:
CLASS SIZE AVAIL USED RAW USED %RAW USED
hdd 595 TiB 322 TiB 273 TiB 273 TiB 45.85
nvme 52 TiB 33 TiB 19 TiB 19 TiB 36.17
TOTAL 648 TiB 356 TiB 292 TiB 292 TiB 45.07
POOLS:
POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL
replicated_rbd 1 1024 30 TiB 7.83M 89 TiB 26.19 84 TiB
erasure_rbd_meta 6 16 2.9 MiB 154 9.9 MiB 0 9.3 TiB
erasure_rbd_data 7 512 45 TiB 11.65M 92 TiB 26.80 151 TiB
.rgw.root 12 16 13 KiB 23 4.1 MiB 0 84 TiB
default.rgw.control 13 8 0 B 8 0 B 0 84 TiB
default.rgw.meta 14 16 47 KiB 211 2.2 MiB 0 9.3 TiB
default.rgw.log 15 16 112 MiB 345 113 MiB 0 84 TiB
default.rgw.buckets.index 16 32 2.7 GiB 717 2.7 GiB 0 9.3 TiB
default.rgw.buckets.non-ec 17 16 1.3 MiB 5.80k 16 MiB 0 84 TiB
default.rgw.buckets.data 18 512 16 TiB 34.95M 50 TiB 16.59 84 TiB
replicated_rbd_nvme 19 512 3.6 TiB 962.40k 11 TiB 28.00 9.3 TiB
unredundant_rbd_nvme 20 512 3.9 TiB 1.04M 7.9 TiB 22.07 14 TiB
fs_data 21 512 11 TiB 12.44M 35 TiB 12.06 84 TiB
fs_meta 22 32 1.3 GiB 642.13k 1.8 GiB 0 9.3 TiB
fs_data_nvme 23 32 20 GiB 5.97k 59 GiB 0.20 9.3 TiB
kubernetes_rbd 24 32 148 GiB 38.22k 445 GiB 0.17 84 TiB
When filestore OSD present in cluster STORED == USED:
RAW STORAGE:
CLASS SIZE AVAIL USED RAW USED %RAW USED
hdd 595 TiB 336 TiB 259 TiB 259 TiB 43.48
nvme 52 TiB 34 TiB 18 TiB 18 TiB 34.91
TOTAL 647 TiB 370 TiB 277 TiB 277 TiB 42.79
POOLS:
POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL
replicated_rbd 1 1024 29 TiB 7.74M 29 TiB 10.83 81 TiB
erasure_rbd_meta 6 16 2.9 MiB 154 2.9 MiB 0 7.0 TiB
erasure_rbd_data 7 512 44 TiB 11.64M 44 TiB 15.47 146 TiB
.rgw.root 12 16 11 KiB 22 11 KiB 0 81 TiB
default.rgw.control 13 16 0 B 8 0 B 0 81 TiB
default.rgw.meta 14 16 45 KiB 211 45 KiB 0 7.0 TiB
default.rgw.log 15 16 95 MiB 345 95 MiB 0 81 TiB
default.rgw.buckets.index 16 16 8.0 GiB 717 8.0 GiB 0.04 7.0 TiB
default.rgw.buckets.non-ec 17 16 810 KiB 5.74k 810 KiB 0 81 TiB
default.rgw.buckets.data 18 512 14 TiB 33.47M 14 TiB 5.33 81 TiB
replicated_rbd_nvme 19 256 3.4 TiB 898.17k 3.4 TiB 13.90 7.0 TiB
unredundant_rbd_nvme 20 128 3.9 TiB 1.03M 3.9 TiB 15.71 11 TiB
fs_data 21 256 11 TiB 12.28M 11 TiB 4.33 81 TiB
fs_meta 22 16 5.5 GiB 636.90k 5.5 GiB 0.03 7.0 TiB
fs_data_nvme 23 64 20 GiB 5.97k 20 GiB 0.09 7.0 TiB
kubernetes_rbd 24 32 142 GiB 36.75k 142 GiB 0.06 81 TiB
ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME
-1 594.00000 - 647 TiB 277 TiB 284 TiB 74 GiB 801 GiB 370 TiB 42.79 1.00 - root default
-7 594.00000 - 647 TiB 277 TiB 284 TiB 74 GiB 801 GiB 370 TiB 42.79 1.00 - datacenter rtcloud
-8 198.00000 - 216 TiB 91 TiB 94 TiB 24 GiB 255 GiB 125 TiB 42.20 0.99 - rack rack2
-2 69.00000 - 75 TiB 32 TiB 34 TiB 15 GiB 90 GiB 43 TiB 43.19 1.01 - host ceph-osd0.opentech.local
0 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 171 MiB 7.1 GiB 3.2 TiB 42.27 0.99 74 up osd.0
4 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 183 MiB 7.7 GiB 3.0 TiB 45.04 1.05 78 up osd.4
7 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 143 MiB 6.8 GiB 3.2 TiB 42.40 0.99 75 up osd.7
9 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.6 TiB 115 MiB 8.5 GiB 2.9 TiB 47.73 1.12 83 up osd.9
46 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 152 MiB 7.5 GiB 3.0 TiB 45.79 1.07 81 up osd.46
47 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.6 TiB 139 MiB 7.8 GiB 2.9 TiB 47.79 1.12 84 up osd.47
126 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 152 MiB 7.4 GiB 3.2 TiB 42.58 0.99 75 up osd.126
127 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 131 MiB 7.2 GiB 3.2 TiB 41.93 0.98 72 up osd.127
128 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 121 MiB 7.3 GiB 3.2 TiB 42.56 0.99 72 up osd.128
129 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 124 MiB 8.1 GiB 2.9 TiB 46.93 1.10 82 up osd.129
130 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 119 MiB 7.5 GiB 3.1 TiB 43.82 1.02 75 up osd.130
131 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 133 MiB 7.5 GiB 3.1 TiB 43.52 1.02 74 up osd.131
24 nvme 3.00000 1.00000 2.9 TiB 1.1 TiB 1.8 TiB 1.8 GiB 0 B 1.8 TiB 36.42 0.85 76 up osd.24
74 nvme 3.00000 1.00000 2.9 TiB 953 GiB 2.0 TiB 6.8 GiB 0 B 2.0 TiB 32.22 0.75 80 up osd.74
84 nvme 3.00000 1.00000 2.9 TiB 1009 GiB 1.9 TiB 4.5 GiB 0 B 1.9 TiB 34.11 0.80 82 up osd.84
-6 69.00000 - 75 TiB 32 TiB 34 TiB 9.6 GiB 90 GiB 43 TiB 43.06 1.01 - host ceph-osd2.opentech.local
12 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 88 MiB 7.5 GiB 3.0 TiB 45.11 1.05 79 up osd.12
15 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 151 MiB 7.5 GiB 3.0 TiB 44.75 1.05 80 up osd.15
18 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 97 MiB 7.4 GiB 3.2 TiB 42.66 1.00 76 up osd.18
19 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 140 MiB 7.2 GiB 3.2 TiB 42.82 1.00 76 up osd.19
50 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 124 MiB 8.0 GiB 3.1 TiB 43.15 1.01 76 up osd.50
51 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 169 MiB 7.9 GiB 2.9 TiB 47.25 1.10 83 up osd.51
52 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 108 MiB 7.2 GiB 3.1 TiB 43.48 1.02 74 up osd.52
53 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 134 MiB 7.3 GiB 3.1 TiB 43.05 1.01 76 up osd.53
58 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 97 MiB 7.7 GiB 2.9 TiB 46.59 1.09 83 up osd.58
59 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 166 MiB 7.3 GiB 3.1 TiB 43.84 1.02 77 up osd.59
60 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 123 MiB 7.4 GiB 3.1 TiB 44.57 1.04 77 up osd.60
61 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 158 MiB 7.4 GiB 3.1 TiB 44.17 1.03 76 up osd.61
75 nvme 3.00000 1.00000 2.9 TiB 1015 GiB 1.9 TiB 1.9 GiB 0 B 1.9 TiB 34.31 0.80 74 up osd.75
85 nvme 3.00000 1.00000 2.9 TiB 975 GiB 1.9 TiB 4.1 GiB 0 B 1.9 TiB 32.94 0.77 77 up osd.85
86 nvme 3.00000 1.00000 2.9 TiB 1004 GiB 1.9 TiB 2.1 GiB 0 B 1.9 TiB 33.92 0.79 75 up osd.86
-12 60.00000 - 66 TiB 27 TiB 26 TiB 24 MiB 75 GiB 40 TiB 40.09 0.94 - host ceph-osd6.opentech.local
68 hdd 5.00000 1.00000 5.5 TiB 1.7 TiB 1.6 TiB 141 KiB 4.3 GiB 3.8 TiB 30.93 0.72 56 up osd.68
69 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 148 KiB 7.2 GiB 3.0 TiB 46.25 1.08 80 up osd.69
80 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 178 KiB 6.3 GiB 3.2 TiB 42.39 0.99 76 up osd.80
81 hdd 5.00000 1.00000 5.5 TiB 2.2 TiB 2.1 TiB 112 KiB 6.0 GiB 3.3 TiB 39.75 0.93 71 up osd.81
82 hdd 5.00000 1.00000 5.5 TiB 2.1 TiB 2.0 TiB 2.6 MiB 6.0 GiB 3.5 TiB 37.47 0.88 66 up osd.82
83 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 3.0 MiB 7.0 GiB 3.2 TiB 42.90 1.00 78 up osd.83
90 hdd 5.00000 1.00000 5.5 TiB 1.8 TiB 1.7 TiB 17 MiB 5.4 GiB 3.7 TiB 32.77 0.77 60 up osd.90
91 hdd 5.00000 1.00000 5.5 TiB 2.7 TiB 2.7 TiB 24 KiB 7.8 GiB 2.8 TiB 49.26 1.15 88 up osd.91
92 hdd 5.00000 1.00000 5.5 TiB 2.1 TiB 2.0 TiB 273 KiB 6.4 GiB 3.4 TiB 37.76 0.88 67 up osd.92
93 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 88 KiB 6.4 GiB 3.0 TiB 46.49 1.09 82 up osd.93
94 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 216 KiB 6.9 GiB 3.2 TiB 42.82 1.00 74 up osd.94
95 hdd 5.00000 1.00000 5.5 TiB 1.8 TiB 1.7 TiB 68 KiB 5.0 GiB 3.7 TiB 32.31 0.75 63 up osd.95
-9 198.00000 - 216 TiB 93 TiB 96 TiB 24 GiB 267 GiB 123 TiB 42.92 1.00 - rack rack3
-3 69.00000 - 75 TiB 33 TiB 34 TiB 15 GiB 92 GiB 42 TiB 43.57 1.02 - host ceph-osd3.opentech.local
20 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 109 MiB 7.4 GiB 3.1 TiB 43.82 1.02 76 up osd.20
21 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 98 MiB 7.2 GiB 3.2 TiB 42.45 0.99 74 up osd.21
22 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 119 MiB 7.8 GiB 3.1 TiB 44.63 1.04 78 up osd.22
23 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 186 MiB 7.4 GiB 3.1 TiB 44.40 1.04 78 up osd.23
34 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 127 MiB 7.3 GiB 3.2 TiB 42.13 0.98 74 up osd.34
35 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 81 MiB 8.3 GiB 2.9 TiB 47.28 1.10 82 up osd.35
36 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 151 MiB 7.6 GiB 3.1 TiB 44.44 1.04 76 up osd.36
37 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 123 MiB 7.7 GiB 3.0 TiB 44.73 1.05 78 up osd.37
48 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 108 MiB 7.7 GiB 3.0 TiB 45.65 1.07 79 up osd.48
49 hdd 5.00000 1.00000 5.5 TiB 2.7 TiB 2.6 TiB 173 MiB 8.2 GiB 2.8 TiB 48.83 1.14 83 up osd.49
64 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 144 MiB 7.6 GiB 3.2 TiB 42.77 1.00 73 up osd.64
65 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 92 MiB 7.7 GiB 3.0 TiB 45.02 1.05 76 up osd.65
30 nvme 3.00000 1.00000 2.9 TiB 1.0 TiB 1.9 TiB 5.0 GiB 0 B 1.9 TiB 35.55 0.83 81 up osd.30
76 nvme 3.00000 1.00000 2.9 TiB 1018 GiB 1.9 TiB 2.2 GiB 0 B 1.9 TiB 34.40 0.80 77 up osd.76
88 nvme 3.00000 1.00000 2.9 TiB 1.0 TiB 1.9 TiB 5.9 GiB 0 B 1.9 TiB 35.41 0.83 83 up osd.88
-11 69.00000 - 75 TiB 32 TiB 34 TiB 8.8 GiB 90 GiB 43 TiB 43.03 1.01 - host ceph-osd5.opentech.local
10 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 160 MiB 7.2 GiB 3.2 TiB 42.73 1.00 74 up osd.10
13 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 178 MiB 7.8 GiB 3.0 TiB 45.95 1.07 79 up osd.13
16 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 146 MiB 7.7 GiB 3.1 TiB 44.47 1.04 78 up osd.16
17 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 140 MiB 8.1 GiB 3.0 TiB 46.41 1.08 83 up osd.17
27 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 86 MiB 7.2 GiB 3.1 TiB 43.78 1.02 77 up osd.27
31 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 161 MiB 7.7 GiB 3.0 TiB 46.17 1.08 78 up osd.31
32 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 182 MiB 7.1 GiB 3.1 TiB 43.23 1.01 76 up osd.32
33 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 172 MiB 7.4 GiB 3.1 TiB 44.08 1.03 77 up osd.33
70 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.2 TiB 179 MiB 7.1 GiB 3.2 TiB 41.52 0.97 72 up osd.70
71 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 136 MiB 7.6 GiB 3.1 TiB 44.43 1.04 78 up osd.71
72 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 133 MiB 7.8 GiB 3.2 TiB 41.91 0.98 72 up osd.72
73 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 159 MiB 7.4 GiB 3.1 TiB 44.35 1.04 79 up osd.73
29 nvme 3.00000 1.00000 2.9 TiB 1.0 TiB 1.9 TiB 1.4 GiB 0 B 1.9 TiB 34.77 0.81 77 up osd.29
78 nvme 3.00000 1.00000 2.9 TiB 1.0 TiB 1.9 TiB 3.4 GiB 0 B 1.9 TiB 34.87 0.81 77 up osd.78
89 nvme 3.00000 1.00000 2.9 TiB 1.0 TiB 1.9 TiB 2.3 GiB 0 B 1.9 TiB 35.33 0.83 75 up osd.89
-13 60.00000 - 66 TiB 28 TiB 27 TiB 591 MiB 85 GiB 38 TiB 42.04 0.98 - host ceph-osd7.opentech.local
96 hdd 5.00000 1.00000 5.5 TiB 1.6 TiB 1.6 TiB 16 KiB 4.3 GiB 3.9 TiB 28.97 0.68 53 up osd.96
97 hdd 5.00000 1.00000 5.5 TiB 2.1 TiB 2.1 TiB 3.9 MiB 6.3 GiB 3.4 TiB 38.60 0.90 69 up osd.97
98 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 68 KiB 6.8 GiB 3.1 TiB 43.25 1.01 80 up osd.98
99 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 9.8 MiB 7.6 GiB 3.1 TiB 42.60 1.00 78 up osd.99
100 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 230 KiB 7.4 GiB 3.1 TiB 43.33 1.01 76 up osd.100
101 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 2.5 MiB 6.8 GiB 3.1 TiB 43.28 1.01 78 up osd.101
102 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 129 MiB 8.1 GiB 3.0 TiB 46.23 1.08 77 up osd.102
103 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 108 MiB 7.6 GiB 3.2 TiB 41.61 0.97 75 up osd.103
104 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 214 KiB 7.1 GiB 2.9 TiB 46.72 1.09 82 up osd.104
107 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 129 MiB 7.9 GiB 3.1 TiB 42.97 1.00 73 up osd.107
110 hdd 5.00000 1.00000 5.5 TiB 2.1 TiB 2.1 TiB 106 MiB 7.1 GiB 3.4 TiB 38.81 0.91 69 up osd.110
113 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.6 TiB 102 MiB 8.3 GiB 2.8 TiB 48.17 1.13 84 up osd.113
-10 198.00000 - 216 TiB 93 TiB 94 TiB 26 GiB 279 GiB 122 TiB 43.27 1.01 - rack rack4
-4 69.00000 - 75 TiB 32 TiB 34 TiB 12 GiB 88 GiB 43 TiB 42.69 1.00 - host ceph-osd1.opentech.local
1 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 124 MiB 7.5 GiB 3.1 TiB 43.91 1.03 79 up osd.1
2 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 184 MiB 7.4 GiB 3.1 TiB 44.26 1.03 80 up osd.2
3 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 144 MiB 7.7 GiB 3.0 TiB 45.86 1.07 83 up osd.3
5 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 153 MiB 7.2 GiB 3.2 TiB 42.66 1.00 77 up osd.5
38 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 95 MiB 7.4 GiB 3.1 TiB 44.12 1.03 76 up osd.38
39 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 112 MiB 7.5 GiB 3.0 TiB 45.60 1.07 80 up osd.39
40 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 112 MiB 8.0 GiB 3.0 TiB 45.28 1.06 79 up osd.40
41 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 93 MiB 7.2 GiB 3.1 TiB 43.22 1.01 75 up osd.41
54 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 163 MiB 7.3 GiB 3.1 TiB 43.85 1.02 78 up osd.54
55 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 135 MiB 7.2 GiB 3.2 TiB 42.70 1.00 75 up osd.55
56 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 146 MiB 7.1 GiB 3.2 TiB 42.09 0.98 74 up osd.56
57 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.2 TiB 123 MiB 6.7 GiB 3.3 TiB 40.85 0.95 72 up osd.57
25 nvme 3.00000 1.00000 2.9 TiB 1.2 TiB 1.7 TiB 6.2 GiB 0 B 1.7 TiB 40.08 0.94 84 up osd.25
79 nvme 3.00000 1.00000 2.9 TiB 934 GiB 2.0 TiB 925 MiB 0 B 2.0 TiB 31.58 0.74 68 up osd.79
87 nvme 3.00000 1.00000 2.9 TiB 987 GiB 1.9 TiB 3.7 GiB 0 B 1.9 TiB 33.36 0.78 78 up osd.87
-5 69.00000 - 75 TiB 32 TiB 31 TiB 12 GiB 94 GiB 43 TiB 42.61 1.00 - host ceph-osd4.opentech.local
6 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 117 MiB 7.0 GiB 3.1 TiB 44.09 1.03 79 up osd.6
8 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 123 MiB 7.0 GiB 3.1 TiB 43.86 1.02 77 up osd.8
11 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 189 MiB 6.9 GiB 3.2 TiB 42.70 1.00 75 up osd.11
14 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 95 MiB 7.1 GiB 3.1 TiB 43.12 1.01 76 up osd.14
42 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 87 MiB 7.3 GiB 3.1 TiB 43.25 1.01 76 up osd.42
43 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 97 MiB 7.1 GiB 3.1 TiB 44.45 1.04 78 up osd.43
44 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 119 MiB 7.4 GiB 3.1 TiB 43.25 1.01 78 up osd.44
45 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 107 MiB 7.1 GiB 3.0 TiB 44.90 1.05 78 up osd.45
62 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.3 TiB 139 MiB 7.1 GiB 3.1 TiB 43.22 1.01 75 up osd.62
63 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.3 TiB 175 MiB 6.9 GiB 3.2 TiB 42.56 0.99 76 up osd.63
66 hdd 5.00000 1.00000 5.5 TiB 2.3 TiB 2.2 TiB 150 MiB 6.7 GiB 3.2 TiB 41.51 0.97 72 up osd.66
67 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 139 MiB 6.9 GiB 3.1 TiB 44.12 1.03 78 up osd.67
26 nvme 1.50000 1.00000 1.5 TiB 408 GiB 403 GiB 3.8 GiB 1.4 GiB 1.1 TiB 27.40 0.64 39 up osd.26
28 nvme 1.50000 1.00000 1.5 TiB 652 GiB 649 GiB 402 MiB 2.2 GiB 839 GiB 43.72 1.02 44 up osd.28
77 nvme 1.50000 1.00000 1.5 TiB 463 GiB 461 GiB 407 MiB 1.2 GiB 1.0 TiB 31.04 0.73 35 up osd.77
105 nvme 1.50000 1.00000 1.5 TiB 371 GiB 368 GiB 2.0 GiB 1.6 GiB 1.1 TiB 24.90 0.58 31 up osd.105
106 nvme 1.50000 1.00000 1.5 TiB 627 GiB 623 GiB 2.1 GiB 1.6 GiB 864 GiB 42.05 0.98 43 up osd.106
108 nvme 1.50000 1.00000 1.5 TiB 741 GiB 737 GiB 1.8 GiB 1.7 GiB 749 GiB 49.72 1.16 52 up osd.108
-14 60.00000 - 66 TiB 29 TiB 29 TiB 1.5 GiB 97 GiB 36 TiB 44.67 1.04 - host ceph-osd8.opentech.local
114 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.4 TiB 122 MiB 8.2 GiB 3.0 TiB 44.91 1.05 76 up osd.114
115 hdd 5.00000 1.00000 5.5 TiB 2.6 TiB 2.5 TiB 119 MiB 8.3 GiB 2.9 TiB 46.94 1.10 82 up osd.115
116 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 92 MiB 8.2 GiB 3.1 TiB 43.81 1.02 74 up osd.116
117 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 89 MiB 8.2 GiB 3.1 TiB 43.64 1.02 76 up osd.117
118 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 126 MiB 8.2 GiB 3.1 TiB 43.38 1.01 76 up osd.118
119 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 169 MiB 7.7 GiB 3.1 TiB 44.29 1.03 76 up osd.119
120 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 133 MiB 8.0 GiB 3.0 TiB 45.38 1.06 78 up osd.120
121 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 137 MiB 8.0 GiB 3.0 TiB 44.45 1.04 74 up osd.121
122 hdd 5.00000 1.00000 5.5 TiB 2.5 TiB 2.5 TiB 129 MiB 8.2 GiB 3.0 TiB 46.00 1.07 78 up osd.122
123 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 115 MiB 8.0 GiB 3.1 TiB 44.40 1.04 75 up osd.123
124 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 139 MiB 8.1 GiB 3.0 TiB 44.42 1.04 74 up osd.124
125 hdd 5.00000 1.00000 5.5 TiB 2.4 TiB 2.4 TiB 188 MiB 7.7 GiB 3.0 TiB 44.44 1.04 76 up osd.125
TOTAL 647 TiB 277 TiB 284 TiB 74 GiB 801 GiB 370 TiB 42.79
MIN/MAX VAR: 0.58/1.16 STDDEV: 4.77
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 594.00000 root default -7 594.00000 datacenter rtcloud -8 198.00000 rack rack2 -2 69.00000 host ceph-osd0.opentech.local 0 hdd 5.00000 osd.0 up 1.00000 1.00000 4 hdd 5.00000 osd.4 up 1.00000 1.00000 7 hdd 5.00000 osd.7 up 1.00000 1.00000 9 hdd 5.00000 osd.9 up 1.00000 1.00000 46 hdd 5.00000 osd.46 up 1.00000 1.00000 47 hdd 5.00000 osd.47 up 1.00000 1.00000 126 hdd 5.00000 osd.126 up 1.00000 1.00000 127 hdd 5.00000 osd.127 up 1.00000 1.00000 128 hdd 5.00000 osd.128 up 1.00000 1.00000 129 hdd 5.00000 osd.129 up 1.00000 1.00000 130 hdd 5.00000 osd.130 up 1.00000 1.00000 131 hdd 5.00000 osd.131 up 1.00000 1.00000 24 nvme 3.00000 osd.24 up 1.00000 1.00000 74 nvme 3.00000 osd.74 up 1.00000 1.00000 84 nvme 3.00000 osd.84 up 1.00000 1.00000 -6 69.00000 host ceph-osd2.opentech.local 12 hdd 5.00000 osd.12 up 1.00000 1.00000 15 hdd 5.00000 osd.15 up 1.00000 1.00000 18 hdd 5.00000 osd.18 up 1.00000 1.00000 19 hdd 5.00000 osd.19 up 1.00000 1.00000 50 hdd 5.00000 osd.50 up 1.00000 1.00000 51 hdd 5.00000 osd.51 up 1.00000 1.00000 52 hdd 5.00000 osd.52 up 1.00000 1.00000 53 hdd 5.00000 osd.53 up 1.00000 1.00000 58 hdd 5.00000 osd.58 up 1.00000 1.00000 59 hdd 5.00000 osd.59 up 1.00000 1.00000 60 hdd 5.00000 osd.60 up 1.00000 1.00000 61 hdd 5.00000 osd.61 up 1.00000 1.00000 75 nvme 3.00000 osd.75 up 1.00000 1.00000 85 nvme 3.00000 osd.85 up 1.00000 1.00000 86 nvme 3.00000 osd.86 up 1.00000 1.00000 -12 60.00000 host ceph-osd6.opentech.local 68 hdd 5.00000 osd.68 up 1.00000 1.00000 69 hdd 5.00000 osd.69 up 1.00000 1.00000 80 hdd 5.00000 osd.80 up 1.00000 1.00000 81 hdd 5.00000 osd.81 up 1.00000 1.00000 82 hdd 5.00000 osd.82 up 1.00000 1.00000 83 hdd 5.00000 osd.83 up 1.00000 1.00000 90 hdd 5.00000 osd.90 up 1.00000 1.00000 91 hdd 5.00000 osd.91 up 1.00000 1.00000 92 hdd 5.00000 osd.92 up 1.00000 1.00000 93 hdd 5.00000 osd.93 up 1.00000 1.00000 94 hdd 5.00000 osd.94 up 1.00000 1.00000 95 hdd 5.00000 osd.95 up 1.00000 1.00000 -9 198.00000 rack rack3 -3 69.00000 host ceph-osd3.opentech.local 20 hdd 5.00000 osd.20 up 1.00000 1.00000 21 hdd 5.00000 osd.21 up 1.00000 1.00000 22 hdd 5.00000 osd.22 up 1.00000 1.00000 23 hdd 5.00000 osd.23 up 1.00000 1.00000 34 hdd 5.00000 osd.34 up 1.00000 1.00000 35 hdd 5.00000 osd.35 up 1.00000 1.00000 36 hdd 5.00000 osd.36 up 1.00000 1.00000 37 hdd 5.00000 osd.37 up 1.00000 1.00000 48 hdd 5.00000 osd.48 up 1.00000 1.00000 49 hdd 5.00000 osd.49 up 1.00000 1.00000 64 hdd 5.00000 osd.64 up 1.00000 1.00000 65 hdd 5.00000 osd.65 up 1.00000 1.00000 30 nvme 3.00000 osd.30 up 1.00000 1.00000 76 nvme 3.00000 osd.76 up 1.00000 1.00000 88 nvme 3.00000 osd.88 up 1.00000 1.00000 -11 69.00000 host ceph-osd5.opentech.local 10 hdd 5.00000 osd.10 up 1.00000 1.00000 13 hdd 5.00000 osd.13 up 1.00000 1.00000 16 hdd 5.00000 osd.16 up 1.00000 1.00000 17 hdd 5.00000 osd.17 up 1.00000 1.00000 27 hdd 5.00000 osd.27 up 1.00000 1.00000 31 hdd 5.00000 osd.31 up 1.00000 1.00000 32 hdd 5.00000 osd.32 up 1.00000 1.00000 33 hdd 5.00000 osd.33 up 1.00000 1.00000 70 hdd 5.00000 osd.70 up 1.00000 1.00000 71 hdd 5.00000 osd.71 up 1.00000 1.00000 72 hdd 5.00000 osd.72 up 1.00000 1.00000 73 hdd 5.00000 osd.73 up 1.00000 1.00000 29 nvme 3.00000 osd.29 up 1.00000 1.00000 78 nvme 3.00000 osd.78 up 1.00000 1.00000 89 nvme 3.00000 osd.89 up 1.00000 1.00000 -13 60.00000 host ceph-osd7.opentech.local 96 hdd 5.00000 osd.96 up 1.00000 1.00000 97 hdd 5.00000 osd.97 up 1.00000 1.00000 98 hdd 5.00000 osd.98 up 1.00000 1.00000 99 hdd 5.00000 osd.99 up 1.00000 1.00000 100 hdd 5.00000 osd.100 up 1.00000 1.00000 101 hdd 5.00000 osd.101 up 1.00000 1.00000 102 hdd 5.00000 osd.102 up 1.00000 1.00000 103 hdd 5.00000 osd.103 up 1.00000 1.00000 104 hdd 5.00000 osd.104 up 1.00000 1.00000 107 hdd 5.00000 osd.107 up 1.00000 1.00000 110 hdd 5.00000 osd.110 up 1.00000 1.00000 113 hdd 5.00000 osd.113 up 1.00000 1.00000 -10 198.00000 rack rack4 -4 69.00000 host ceph-osd1.opentech.local 1 hdd 5.00000 osd.1 up 1.00000 1.00000 2 hdd 5.00000 osd.2 up 1.00000 1.00000 3 hdd 5.00000 osd.3 up 1.00000 1.00000 5 hdd 5.00000 osd.5 up 1.00000 1.00000 38 hdd 5.00000 osd.38 up 1.00000 1.00000 39 hdd 5.00000 osd.39 up 1.00000 1.00000 40 hdd 5.00000 osd.40 up 1.00000 1.00000 41 hdd 5.00000 osd.41 up 1.00000 1.00000 54 hdd 5.00000 osd.54 up 1.00000 1.00000 55 hdd 5.00000 osd.55 up 1.00000 1.00000 56 hdd 5.00000 osd.56 up 1.00000 1.00000 57 hdd 5.00000 osd.57 up 1.00000 1.00000 25 nvme 3.00000 osd.25 up 1.00000 1.00000 79 nvme 3.00000 osd.79 up 1.00000 1.00000 87 nvme 3.00000 osd.87 up 1.00000 1.00000 -5 69.00000 host ceph-osd4.opentech.local 6 hdd 5.00000 osd.6 up 1.00000 1.00000 8 hdd 5.00000 osd.8 up 1.00000 1.00000 11 hdd 5.00000 osd.11 up 1.00000 1.00000 14 hdd 5.00000 osd.14 up 1.00000 1.00000 42 hdd 5.00000 osd.42 up 1.00000 1.00000 43 hdd 5.00000 osd.43 up 1.00000 1.00000 44 hdd 5.00000 osd.44 up 1.00000 1.00000 45 hdd 5.00000 osd.45 up 1.00000 1.00000 62 hdd 5.00000 osd.62 up 1.00000 1.00000 63 hdd 5.00000 osd.63 up 1.00000 1.00000 66 hdd 5.00000 osd.66 up 1.00000 1.00000 67 hdd 5.00000 osd.67 up 1.00000 1.00000 26 nvme 1.50000 osd.26 up 1.00000 1.00000 28 nvme 1.50000 osd.28 up 1.00000 1.00000 77 nvme 1.50000 osd.77 up 1.00000 1.00000 105 nvme 1.50000 osd.105 up 1.00000 1.00000 106 nvme 1.50000 osd.106 up 1.00000 1.00000 108 nvme 1.50000 osd.108 up 1.00000 1.00000 -14 60.00000 host ceph-osd8.opentech.local 114 hdd 5.00000 osd.114 up 1.00000 1.00000 115 hdd 5.00000 osd.115 up 1.00000 1.00000 116 hdd 5.00000 osd.116 up 1.00000 1.00000 117 hdd 5.00000 osd.117 up 1.00000 1.00000 118 hdd 5.00000 osd.118 up 1.00000 1.00000 119 hdd 5.00000 osd.119 up 1.00000 1.00000 120 hdd 5.00000 osd.120 up 1.00000 1.00000 121 hdd 5.00000 osd.121 up 1.00000 1.00000 122 hdd 5.00000 osd.122 up 1.00000 1.00000 123 hdd 5.00000 osd.123 up 1.00000 1.00000 124 hdd 5.00000 osd.124 up 1.00000 1.00000 125 hdd 5.00000 osd.125 up 1.00000 1.00000
Files
No data to display
Actions