Bug #22351
closedCouldn't init storage provider (RADOS)
0%
Description
2017-12-08 16:25:46.172119 7f12bf18de00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:46.172213 7f12bf18de00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666104
2017-12-08 16:25:46.225049 7f12a735b700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:46.225062 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3470 obj=.rgw.root:default.realm state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.226295 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d30d0 obj=.rgw.root:converted state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.226827 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d27c0 obj=.rgw.root:default.realm state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:46.227262 7f12bf18de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:46.227698 7f12bf18de00 10 failed to list objects pool_iterate_begin() returned r=-2
2017-12-08 16:25:46.227729 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d29f0 obj=.rgw.root:zone_names.default state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:46.228175 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d29f0 obj=.rgw.root:zonegroups_names.default state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:46.228618 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3650 obj=.rgw.root:region_map state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.229140 7f12bf18de00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:46.229156 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2f90 obj=.rgw.root:default.realm state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.229680 7f12bf18de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:46.229699 7f12bf18de00 10 Creating default zonegroup
2017-12-08 16:25:46.230245 7f12bf18de00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:46.230714 7f12bf18de00 10 failed to list objects pool_iterate_begin() returned r=-2
2017-12-08 16:25:46.230728 7f12bf18de00 10 WARNING: store->list_zones() returned r=-2
2017-12-08 16:25:46.230776 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2cd0 obj=.rgw.root:zone_names.default state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:47.992320 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2ae0 obj=.rgw.root:default.realm state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:47.993477 7f12bf18de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:47.993503 7f12bf18de00 10 WARNING: failed to set zone as default, r=-22
2017-12-08 16:25:47.993520 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2f60 obj=.rgw.root:zonegroups_names.default state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:48.028604 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2c00 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.029513 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.029533 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.030393 7f12bf18de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:48.030488 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3340 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.031470 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.031490 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.032469 7f12bf18de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:48.032528 7f12bf18de00 20 zonegroup default
2017-12-08 16:25:48.032546 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3650 obj=.rgw.root:period_config.default state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.034898 7f12bf18de00 10 Cannot find current period zone using local zone
2017-12-08 16:25:48.034913 7f12bf18de00 10 Using default name default
2017-12-08 16:25:48.034925 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d34d0 obj=.rgw.root:zone_names.default state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.035917 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.035937 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.036833 7f12bf18de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:48.036882 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d34d0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.037811 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.037830 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.038767 7f12bf18de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:48.038826 7f12bf18de00 20 zone default
2017-12-08 16:25:48.931046 7f12bf18de00 1 ERROR: failed to initialize watch: (34) Numerical result out of range>prefetch_data=0
2017-12-08 16:25:48.933150 7f12bf18de00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:49.282950 7f10e1341e00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:49.283025 7f10e1341e00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666135
2017-12-08 16:25:49.333137 7f10c950f700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:49.333148 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea1271c0 obj=.rgw.root:default.realm state=0x7f10e3734860 s
2017-12-08 16:25:49.335661 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126e20 obj=.rgw.root:converted state=0x7f10e3734860 s->prefetch_data=0
2017-12-08 16:25:49.337515 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126510 obj=.rgw.root:default.realm state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.338473 7f10e1341e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:49.454314 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:49.454337 7f10e1341e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.454340 7f10e1341e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:49.454341 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:49.454374 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zone_names.default state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.455581 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.455601 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.456459 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.456510 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.457314 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.457327 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.458025 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.458088 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zonegroups_names.default state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.458878 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.458891 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.459609 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.459638 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.460586 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.460598 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.461480 7f10e1341e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:49.461534 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea1273a0 obj=.rgw.root:region_map state=0x7f10e3734860 s->prefetch_data=0
2017-12-08 16:25:49.462479 7f10e1341e00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:49.462499 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126ce0 obj=.rgw.root:default.realm state=0x7f10e3734860 s->prefetch_data=0
2017-12-08 16:25:49.463453 7f10e1341e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:49.463471 7f10e1341e00 10 Creating default zonegroup
2017-12-08 16:25:49.464125 7f10e1341e00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:49.576906 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:49.576918 7f10e1341e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.576920 7f10e1341e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:49.576931 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:49.576953 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea125ff0 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.577807 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.577834 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.578571 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.578614 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea125ff0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.579339 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.579351 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.579999 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.580159 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126a20 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.581301 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.581315 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.582135 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.582161 7f10e1341e00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.582166 7f10e1341e00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation>prefetch_data=0
2017-12-08 16:25:49.582173 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s
2017-12-08 16:25:49.582984 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.583007 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.583881 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.583911 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.584690 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.584705 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.585407 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.585444 7f10e1341e00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.585456 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cb0 obj=.rgw.root:zonegroups_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.586145 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.586160 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.586787 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.586824 7f10e1341e00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:49.586827 7f10e1341e00 10 create_default() returned EEXIST, we raced with another zonegroup creation>prefetch_data=0
2017-12-08 16:25:49.586833 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zonegroups_names.default state=0x7f10e3a3cc20 s
2017-12-08 16:25:49.587498 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.587522 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.588208 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.588239 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.589132 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.589157 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.589987 7f10e1341e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:49.590044 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126950 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.590955 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.590980 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.591781 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.591832 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea127090 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.592798 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.592811 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.593718 7f10e1341e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:49.593753 7f10e1341e00 20 zonegroup default
2017-12-08 16:25:49.593769 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea1273a0 obj=.rgw.root:period_config.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.594887 7f10e1341e00 10 Cannot find current period zone using local zone
2017-12-08 16:25:49.594898 7f10e1341e00 10 Using default name default
2017-12-08 16:25:49.594905 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea127220 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.595817 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.595832 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.596617 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.596647 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea127220 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.597536 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.597550 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.598318 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.598358 7f10e1341e00 20 zone default
2017-12-08 16:25:50.130678 7f10e1341e00 1 ERROR: failed to initialize watch: (34) Numerical result out of range>prefetch_data=0
2017-12-08 16:25:50.132593 7f10e1341e00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:50.528896 7fca1f4f4e00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:50.528973 7fca1f4f4e00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666157
2017-12-08 16:25:50.575876 7fca076c2700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:50.575898 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1ce0 obj=.rgw.root:default.realm state=0x7fca21936520 s
2017-12-08 16:25:50.578640 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1940 obj=.rgw.root:converted state=0x7fca21936520 s->prefetch_data=0
2017-12-08 16:25:50.580339 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1030 obj=.rgw.root:default.realm state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.581277 7fca1f4f4e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:50.698892 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:50.698913 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.698915 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:50.698917 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:50.698950 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zone_names.default state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.699728 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.699748 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.700584 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.700636 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.701514 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.701526 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.702333 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.702398 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zonegroups_names.default state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.703074 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.703087 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.704122 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.704151 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.705469 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.705481 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.706455 7fca1f4f4e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:50.706506 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1ec0 obj=.rgw.root:region_map state=0x7fca21936520 s->prefetch_data=0
2017-12-08 16:25:50.707407 7fca1f4f4e00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:50.707427 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1800 obj=.rgw.root:default.realm state=0x7fca21936520 s->prefetch_data=0
2017-12-08 16:25:50.708182 7fca1f4f4e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:50.708209 7fca1f4f4e00 10 Creating default zonegroup
2017-12-08 16:25:50.709148 7fca1f4f4e00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:50.819746 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:50.819757 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.819759 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:50.819770 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:50.819802 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c0b10 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.820522 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.820534 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.821566 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.821594 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c0b10 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.822392 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.822405 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.823087 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.823260 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1540 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.824066 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.824079 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.824824 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.824848 7fca1f4f4e00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.824853 7fca1f4f4e00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation>prefetch_data=0
2017-12-08 16:25:50.824860 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s
2017-12-08 16:25:50.825542 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.825554 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.826230 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.826258 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.826904 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.826928 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.827552 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.827597 7fca1f4f4e00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.827604 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c17d0 obj=.rgw.root:zonegroups_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.828246 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.828258 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.828942 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.828968 7fca1f4f4e00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:50.828970 7fca1f4f4e00 10 create_default() returned EEXIST, we raced with another zonegroup creation>prefetch_data=0
2017-12-08 16:25:50.828976 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zonegroups_names.default state=0x7fca21c44040 s
2017-12-08 16:25:50.829652 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.829665 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.830364 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.830405 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.831396 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.831410 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.832361 7fca1f4f4e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:50.832404 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1470 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.833253 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.833267 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.834037 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.834088 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1bb0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.835025 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.835038 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.836189 7fca1f4f4e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:50.836230 7fca1f4f4e00 20 zonegroup default
2017-12-08 16:25:50.836245 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1ec0 obj=.rgw.root:period_config.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.837228 7fca1f4f4e00 10 Cannot find current period zone using local zone
2017-12-08 16:25:50.837239 7fca1f4f4e00 10 Using default name default
2017-12-08 16:25:50.837246 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1d40 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.838080 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.838094 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.838835 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.838864 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1d40 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.839563 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.839575 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.840274 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.840312 7fca1f4f4e00 20 zone default
2017-12-08 16:25:51.365105 7fca1f4f4e00 1 ERROR: failed to initialize watch: (34) Numerical result out of range>prefetch_data=0
2017-12-08 16:25:51.366773 7fca1f4f4e00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:51.772064 7f37a592de00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:51.772130 7f37a592de00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666179
2017-12-08 16:25:51.814258 7f378dafb700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:51.814288 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0620 obj=.rgw.root:default.realm state=0x7f37a6bb8860 s
2017-12-08 16:25:51.816851 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0280 obj=.rgw.root:converted state=0x7f37a6bb8860 s->prefetch_data=0
2017-12-08 16:25:51.818560 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbf970 obj=.rgw.root:default.realm state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.819409 7f37a592de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:51.924089 7f37a592de00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:51.924109 7f37a592de00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:51.924111 7f37a592de00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:51.924113 7f37a592de00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:51.924146 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zone_names.default state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.925249 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.925267 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.926066 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:51.926110 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.926868 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.926879 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.927601 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:51.927657 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zonegroups_names.default state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.928376 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.928387 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.929074 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:51.929099 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.930034 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.930046 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.930865 7f37a592de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:51.930913 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0800 obj=.rgw.root:region_map state=0x7f37a6bb8860 s->prefetch_data=0
2017-12-08 16:25:51.931821 7f37a592de00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:51.931839 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0140 obj=.rgw.root:default.realm state=0x7f37a6bb8860 s->prefetch_data=0
2017-12-08 16:25:51.932764 7f37a592de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:51.932779 7f37a592de00 10 Creating default zonegroup
2017-12-08 16:25:51.933511 7f37a592de00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:52.036156 7f37a592de00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:52.036168 7f37a592de00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.036170 7f37a592de00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:52.036180 7f37a592de00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:52.036558 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbf450 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.037250 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.037263 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.038040 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.038068 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbf450 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.038865 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.038880 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.039543 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.039694 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfe80 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.040584 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.040596 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.041380 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.041417 7f37a592de00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.041422 7f37a592de00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation>prefetch_data=0
2017-12-08 16:25:52.041432 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s
2017-12-08 16:25:52.042230 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.042244 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.042943 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.042984 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.043769 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.043776 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.044490 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.044524 7f37a592de00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.044533 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0110 obj=.rgw.root:zonegroups_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.045233 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.045245 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.045923 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.045959 7f37a592de00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:52.045964 7f37a592de00 10 create_default() returned EEXIST, we raced with another zonegroup creation>prefetch_data=0
2017-12-08 16:25:52.045970 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zonegroups_names.default state=0x7f37a6ec6040 s
2017-12-08 16:25:52.046606 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.046629 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.047239 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.047268 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.048131 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.048144 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.048928 7f37a592de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:52.048984 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfdb0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.049584 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.049608 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.050135 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.050187 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc04f0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.051010 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.051036 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.051789 7f37a592de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:52.051829 7f37a592de00 20 zonegroup default
2017-12-08 16:25:52.051845 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0800 obj=.rgw.root:period_config.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.052768 7f37a592de00 10 Cannot find current period zone using local zone
2017-12-08 16:25:52.052778 7f37a592de00 10 Using default name default
2017-12-08 16:25:52.052785 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0680 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.053698 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.053713 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.054490 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.054518 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0680 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.055241 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.055253 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.055898 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.055948 7f37a592de00 20 zone default
2017-12-08 16:25:52.586099 7f37a592de00 1 ERROR: failed to initialize watch: (34) Numerical result out of range>prefetch_data=0
2017-12-08 16:25:52.587361 7f37a592de00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:52.768390 7f38d8305e00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:52.768449 7f38d8305e00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666201
2017-12-08 16:25:52.806844 7f38c04d3700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:52.806842 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189790 obj=.rgw.root:default.realm state=0x7f38d98d8860 s
2017-12-08 16:25:52.809239 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1893f0 obj=.rgw.root:converted state=0x7f38d98d8860 s->prefetch_data=0
2017-12-08 16:25:52.810755 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188ae0 obj=.rgw.root:default.realm state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.811711 7f38d8305e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:52.940380 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:52.940398 7f38d8305e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.940400 7f38d8305e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:52.940402 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:52.940431 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zone_names.default state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.941354 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.941371 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.942154 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.942525 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.943319 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.943329 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.943955 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.944010 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zonegroups_names.default state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.944728 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.944739 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.945419 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.945460 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.946489 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.946500 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.947416 7f38d8305e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:52.947462 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189970 obj=.rgw.root:region_map state=0x7f38d98d8860 s->prefetch_data=0
2017-12-08 16:25:52.948498 7f38d8305e00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:52.948515 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892b0 obj=.rgw.root:default.realm state=0x7f38d98d8860 s->prefetch_data=0
2017-12-08 16:25:52.949348 7f38d8305e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:52.949363 7f38d8305e00 10 Creating default zonegroup
2017-12-08 16:25:52.950047 7f38d8305e00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:53.061017 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:53.061028 7f38d8305e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:53.061030 7f38d8305e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:53.061038 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:53.061068 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1885c0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.061877 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.061888 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.062666 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.062691 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1885c0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.063442 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.063453 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.064065 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.064542 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188ff0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.065347 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.065358 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.066035 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.066056 7f38d8305e00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:53.066060 7f38d8305e00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation>prefetch_data=0
2017-12-08 16:25:53.066066 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s
2017-12-08 16:25:53.066757 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.066769 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.067404 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.067448 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.068031 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.068042 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.068663 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.068695 7f38d8305e00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:53.068702 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189280 obj=.rgw.root:zonegroups_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.069397 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.069409 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.070038 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.070062 7f38d8305e00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:53.070064 7f38d8305e00 10 create_default() returned EEXIST, we raced with another zonegroup creation>prefetch_data=0
2017-12-08 16:25:53.070070 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zonegroups_names.default state=0x7f38d9be6040 s
2017-12-08 16:25:53.070771 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.070783 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.071472 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.071498 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.072495 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.072506 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.073438 7f38d8305e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:53.073477 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188f20 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.074346 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.074359 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.075033 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.075100 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189660 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.076145 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.076156 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.077090 7f38d8305e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:53.077119 7f38d8305e00 20 zonegroup default
2017-12-08 16:25:53.077132 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189970 obj=.rgw.root:period_config.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.078547 7f38d8305e00 10 Cannot find current period zone using local zone
2017-12-08 16:25:53.078554 7f38d8305e00 10 Using default name default
2017-12-08 16:25:53.078560 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1897f0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.079270 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.079294 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.079922 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.079949 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1897f0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.080574 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.080585 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.081312 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.081348 7f38d8305e00 20 zone default
2017-12-08 16:25:53.720449 7f38d8305e00 -1 ERROR: failed to initialize watch: (34) Numerical result out of range
2017-12-08 16:25:53.722047 7f38d8305e00 -1 Couldn't init storage provider (RADOS)
Updated by Orit Wasserman over 6 years ago
- Status changed from New to Need More Info
what is your pool configuration?
Updated by Amine Liu over 6 years ago
Orit Wasserman wrote:
what is your pool configuration?
all default, just a default pool 'rbd'.
Updated by Javier M. Mellid over 6 years ago
Related to the ERROR: failed to initialize watch: (34) Numerical result out of range, it looks a class path issue. This old thread could help you:
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/038899.html
Related to 'Couldn't init storage provider (RADOS)'. I am watching the same issue in CentOS 7
Updated by Abhishek Lekshmanan over 6 years ago
can you tell us the ceph pg num and pgp num setting in ceph.conf (or rather paste teh ceph.conf retracting sensitive info)
Updated by Amine Liu over 6 years ago
Abhishek Lekshmanan wrote:
can you tell us the ceph pg num and pgp num setting in ceph.conf (or rather paste teh ceph.conf retracting sensitive info)
osd pool default size = 3
osd pool default min_size = 1
osd pool default pg num = 256
osd pool default pgp num = 256
objecter_inflight_ops = 10240
objecter_inflight_op_bytes = 1048576000
rgw_thread_pool_size = 1000
rgw_num_rados_handles = 100
rgw_max_chunk_size = 1048576
rgw_override_bucket_index_max_shards = 3
rgw_cache_enabled = true
mon_allow_pool_delete = true
[mon]
mon_allow_pool_delete = true
Updated by Brad Hubbard over 6 years ago
If this is a RADOS function returning ERANGE (34) then it should be possible to find it by attempting to start the rados gateway in the foreground (-f) under 'ltrace -f' and searching the output for the function returning that code.
Example:
# ltrace -fo /tmp/ltrace.out /usr/bin/radosgw --cluster ceph --name client.radosgw.myrgw --setuser ceph --setgroup ceph -f -d
Updated by Amine Liu over 6 years ago
Brad Hubbard wrote:
If this is a RADOS function returning ERANGE (34) then it should be possible to find it by attempting to start the rados gateway in the foreground (-f) under 'ltrace -f' and searching the output for the function returning that code.
Example:
[...]
Sorry, I don't have this test environment anymore.
Updated by Nikos Kormpakis over 6 years ago
Hello,
we're facing the same issue on a Luminous cluster.
Some info about the cluster:
Version: ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable)
Packages: Official packages from download.ceph.com
OS: Debian Jessie 8.9
Our ceph.conf:
[global] fsid = foobar ms_bind_ipv6 = true auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx mon_initial_members = A,B,C mon_host = X,Y,Z osd pool default size = 3 osd pool default min size = 2 osd pool default pg num = 1024 osd pool default pgp num = 1024 [mon] mon compact on start = true mon osd allow primary affinity = true [osd] osd_journal_size = 10240 osd max backfills = 1 osd recovery max active = 1 osd recovery threads = 1 osd recovery op priority = 1 osd disk thread ioprio class = idle osd disk thread ioprio priority = 7 osd scrub during recovery = false osd crush update on start = false
We tried to deploy radosgw with ceph-deploy. After deploying it successfully, we get the same error message when starting the service:
2018-01-16 17:30:05.058260 7f0fdaa80d00 0 deferred set uid:gid to 64045:64045 (ceph:ceph) 2018-01-16 17:30:05.058313 7f0fdaa80d00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 17678 2018-01-16 17:30:07.058787 7f0fdaa80d00 -1 ERROR: failed to initialize watch: (34) Numerical result out of range 2018-01-16 17:30:07.062551 7f0fdaa80d00 -1 Couldn't init storage provider (RADOS)
On all pools, pg_num === pgp_num (because it was mentioned before):
# ceph osd dump | grep pg_num pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1024 pgp_num 1024 last_change 574 flags hashpspool stripe_width 0 application rbd pool 2 'bench' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1024 pgp_num 1024 last_change 460 flags hashpspool stripe_width 0 pool 3 '.rgw.root' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1024 pgp_num 1024 last_change 704 flags hashpspool stripe_width 0 application rgw
Before deploying radosgw, the '.rgw.root' pool did not exist.
Also, I ran ltrace as Brad suggested. Functions returning 34 are the following:
# grep "= 34" ~/ltrace.out
8125 strlen("application/java-serialized-object") = 34
8125 strlen("application/vnd.font-fontforge-sfd") = 34
8125 strlen("application/vnd.stardivision.chart") = 34
8125 strlen("default_485560280.rgw.buckets.data") = 34
This behavior is reproducible so I can provide more information or logs, if needed.
Updated by Brad Hubbard over 6 years ago
It turns out what we need is the hexadecimal int representation of '-34' from the ltrace output.
$ c++filt </tmp/ltrace.out|grep "= 0xffffffde"
Updated by Brad Hubbard over 6 years ago
I'm able to reproduce something like what you are seeing, the messages are a little different.
What I see is this...
# c++filt </tmp/ltrace.out|grep "= 0xffffffde" 25450 std::basic_string<char, std::char_traits<char>, std::allocator<char> >::compare(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const(0x5606ab13b160, 0x7ffede71e230, 97, 0x5606ab198698) = 0xffffffde 25450 <... librados::Rados::pool_create(char const*, unsigned long) resumed> ) = 0xffffffde
You can confirm this by setting "debug mon = 20" on the monitors and you should see the primary report "prepare_pool_size returns -34" Due to a couple of problems with the way the error messages are being generated (or not generated) this particular message is misleading and there is some important information missing (I'm working on fixing this).
This looks like it might actually be happening due to OSDMonitor::check_pg_num code [1]
You'll need to look at your settings for pg_num, pgp_num, and mon_max_pg_per_osd.
See https://github.com/ceph/ceph/commit/3ea2e518d27e6c06182c2cb3d9c0b9a0dab8dd22
So this is actually by design if you are hitting the same issue.
Updated by Nikos Kormpakis over 6 years ago
Brad Hubbard wrote:
I'm able to reproduce something like what you are seeing, the messages are a little different.
What I see is this...
[...]
You can confirm this by setting "debug mon = 20" on the monitors and you should see the primary report "prepare_pool_size returns -34" Due to a couple of problems with the way the error messages are being generated (or not generated) this particular message is misleading and there is some important information missing (I'm working on fixing this).
This looks like it might actually be happening due to OSDMonitor::check_pg_num code [1]
You'll need to look at your settings for pg_num, pgp_num, and mon_max_pg_per_osd.
See https://github.com/ceph/ceph/commit/3ea2e518d27e6c06182c2cb3d9c0b9a0dab8dd22
So this is actually by design if you are hitting the same issue.
I think that we hit the exact same problem.
Grepping the ltrace output again, I get the same results as you:
# c++filt < ~/ltrace.out | grep "= 0xffffffde" 8125 memcmp(0x55850e39c208, 0x55850e39ce38, 11, 68) = 0xffffffde 8125 <... librados::Rados::pool_create(char const*) resumed> ) = 0xffffffde
Also, when setting "debug mon = 20" I can confirm that I get the same message regarding "prepare_pool_size":
2018-01-17 14:21:16.982977 7f1c187d8700 10 mon.rddemo-1027@0(leader).osd e775 prepare_pool_size returns -34
So, I set the "osd pool default pg num" "osd pool default pgp num" to their default values and the daemon started normally, creating all necessary pools.
But I still cannot understand why I'm hitting this error.
Regarding my cluster, I have the following settings:
mon_max_pg_per_osd = 200 (default value)
osd pool default pg num = 1024
osd pool default pgp num = 1024
osd: 48 osds: 47 up, 47 in
Current pools:
pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1024 pgp_num 1024 last_change 574 flags hashpspool stripe_width 0 application rbd
removed_snaps [1~3]
pool 2 'bench' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1024 pgp_num 1024 last_change 460 flags hashpspool stripe_width 0
pool 7 '.rgw.root' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1024 pgp_num 1024 last_change 789 owner 18446744073709551615 flags hashpspool stripe_width 0 application rgw
That means that I have a total of 3072 PGs on 48 OSDs, thus 3072/47 ~ 63 PGs/OSD. radosgw needs 3 more PGs. Default pg{,p}_num are 1024, so we will eventually have 6 pools (2 prexisting pools + 4 for radosgw). That means that my cluster will finally have 6*1024 = 6144, thus 6144/47 ~ 130 PGs per OSD.
Why is that not possible? If I understand correctly, the max number of PGs on my cluster is mon_max_pg_per_osd*num_osd = 200*48 = 9600, right?
PS: I don't have any insight into Ceph's codebase, so, a hint about the function you linked would be very helpful.
Updated by Brad Hubbard over 6 years ago
Nikos Kormpakis wrote:
But I still cannot understand why I'm hitting this error.
Regarding my cluster, I have the following settings:
[...]That means that I have a total of 3072 PGs on 48 OSDs, thus 3072/47 ~ 63 PGs/OSD. radosgw needs 3 more PGs. Default pg{,p}_num are 1024, so we will eventually have 6 pools (2 prexisting pools + 4 for radosgw). That means that my cluster will finally have 6*1024 = 6144, thus 6144/47 ~ 130 PGs per OSD.
(6*1024)*3 = 18432, thus 18432/47 ~ 392 PGs per OSD. You omitted the size of the pools.
Why is that not possible? If I understand correctly, the max number of PGs on my cluster is mon_max_pg_per_osd*num_osd = 200*48 = 9600, right?
Right.
PS: I don't have any insight into Ceph's codebase, so, a hint about the function you linked would be very helpful.
No problem.
Updated by Brad Hubbard over 6 years ago
https://ceph.com/pgcalc/ should be used as a guide/starting point.
Updated by Nikos Kormpakis about 6 years ago
Brad Hubbard wrote:
(6*1024)*3 = 18432, thus 18432/47 ~ 392 PGs per OSD. You omitted the size of the pools.
Oops, my bad.
Anyway, this is no longer an issue for me.
Thanks for your time and help.
Updated by Yehuda Sadeh about 6 years ago
- Status changed from Need More Info to Closed
Updated by Brad Hubbard about 6 years ago
- Project changed from rgw to RADOS
- Status changed from Closed to In Progress
- Target version changed from v11.2.2 to v12.2.3
- Release deleted (
luminous) - Release set to master
Reopening this and reassigning it to RADOS as there are a couple of changes we can make to logging to make this easier to debug.
Updated by Brad Hubbard about 6 years ago
- Backport set to luminous
- Affected Versions v13.0.0 added
- Component(RADOS) Monitor added
Updated by Nathan Cutler about 6 years ago
- Assignee set to Brad Hubbard
@Brad Assigning to you and leaving the backport field on "luminous" (but feel free to zero it out if it's enough to make these logging changes on master only).
Updated by Brad Hubbard about 6 years ago
No, I set it to Luminous based on the request by theanalyst in https://github.com/ceph/ceph/pull/20023. I'm fine with assigning it to me.
Updated by Vasu Kulkarni about 6 years ago
I have another couldn't init storage provider, I think a better error message would definitely benefit in fixing this issue by user
Updated by Brad Hubbard about 6 years ago
- Status changed from In Progress to Resolved
All of these PRs have merged on the RADOS side.
Updated by Nathan Cutler about 6 years ago
- Status changed from Resolved to Pending Backport
@Brad, I missed which PR is the luminous backport PR?
Updated by Nathan Cutler about 6 years ago
- Copied to Backport #23349: luminous: Couldn't init storage provider (RADOS) added
Updated by Brad Hubbard about 6 years ago
@Nathan Weinberg There wasn't one, I just set the backport field?
Just let me know if you need any action from me on this.
Updated by Nathan Cutler about 6 years ago
@Brad - I was confused because you changed the status to Resolved, apparently before the backport was done.
Could you attach a definitive list of PRs that need to be backported to luminous for this ticket?
Updated by Brad Hubbard about 6 years ago
@Nathan Weinberg Oops, sorry mate, my bad.
These are the two we need.
Updated by Nathan Cutler about 6 years ago
@Brad - that's perfect, thanks. Backport PR open.
Updated by Nathan Cutler about 6 years ago
- Status changed from Pending Backport to Resolved
Updated by Casey Bodley almost 6 years ago
- Related to Bug #23480: No meaningful error when RGW cannot create pools due to lack of available PGs added
Updated by Casey Bodley about 1 year ago
- Related to Bug #58692: Consider setting "bulk" autoscale pool flag when automatically creating a data pool for RGW added