Project

General

Profile

Actions

Bug #22351

closed

Couldn't init storage provider (RADOS)

Added by Amine Liu over 6 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Tags:
Backport:
luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Component(RADOS):
Monitor
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2017-12-08 16:25:46.172119 7f12bf18de00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:46.172213 7f12bf18de00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666104
2017-12-08 16:25:46.225049 7f12a735b700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:46.225062 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3470 obj=.rgw.root:default.realm state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.226295 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d30d0 obj=.rgw.root:converted state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.226827 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d27c0 obj=.rgw.root:default.realm state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:46.227262 7f12bf18de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:46.227698 7f12bf18de00 10 failed to list objects pool_iterate_begin() returned r=-2
2017-12-08 16:25:46.227729 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d29f0 obj=.rgw.root:zone_names.default state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:46.228175 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d29f0 obj=.rgw.root:zonegroups_names.default state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:46.228618 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3650 obj=.rgw.root:region_map state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.229140 7f12bf18de00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:46.229156 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2f90 obj=.rgw.root:default.realm state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:46.229680 7f12bf18de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:46.229699 7f12bf18de00 10 Creating default zonegroup
2017-12-08 16:25:46.230245 7f12bf18de00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:46.230714 7f12bf18de00 10 failed to list objects pool_iterate_begin() returned r=-2
2017-12-08 16:25:46.230728 7f12bf18de00 10 WARNING: store->list_zones() returned r=-2
2017-12-08 16:25:46.230776 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2cd0 obj=.rgw.root:zone_names.default state=0x7f12c07bc520 s->prefetch_data=0
2017-12-08 16:25:47.992320 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2ae0 obj=.rgw.root:default.realm state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:47.993477 7f12bf18de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:47.993503 7f12bf18de00 10 WARNING: failed to set zone as default, r=-22
2017-12-08 16:25:47.993520 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2f60 obj=.rgw.root:zonegroups_names.default state=0x7f12c07bc6c0 s->prefetch_data=0
2017-12-08 16:25:48.028604 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d2c00 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.029513 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.029533 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.030393 7f12bf18de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:48.030488 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3340 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.031470 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.031490 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.032469 7f12bf18de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:48.032528 7f12bf18de00 20 zonegroup default
2017-12-08 16:25:48.032546 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d3650 obj=.rgw.root:period_config.default state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.034898 7f12bf18de00 10 Cannot find current period zone using local zone
2017-12-08 16:25:48.034913 7f12bf18de00 10 Using default name default
2017-12-08 16:25:48.034925 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d34d0 obj=.rgw.root:zone_names.default state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.035917 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.035937 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.036833 7f12bf18de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:48.036882 7f12bf18de00 20 get_system_obj_state: rctx=0x7ffc550d34d0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f12c07bd080 s->prefetch_data=0
2017-12-08 16:25:48.037811 7f12bf18de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:48.037830 7f12bf18de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:48.038767 7f12bf18de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:48.038826 7f12bf18de00 20 zone default
2017-12-08 16:25:48.931046 7f12bf18de00 1 ERROR: failed to initialize watch: (34) Numerical result out of range
2017-12-08 16:25:48.933150 7f12bf18de00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:49.282950 7f10e1341e00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:49.283025 7f10e1341e00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666135
2017-12-08 16:25:49.333137 7f10c950f700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:49.333148 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea1271c0 obj=.rgw.root:default.realm state=0x7f10e3734860 s
>prefetch_data=0
2017-12-08 16:25:49.335661 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126e20 obj=.rgw.root:converted state=0x7f10e3734860 s->prefetch_data=0
2017-12-08 16:25:49.337515 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126510 obj=.rgw.root:default.realm state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.338473 7f10e1341e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:49.454314 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:49.454337 7f10e1341e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.454340 7f10e1341e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:49.454341 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:49.454374 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zone_names.default state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.455581 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.455601 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.456459 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.456510 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.457314 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.457327 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.458025 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.458088 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zonegroups_names.default state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.458878 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.458891 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.459609 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.459638 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126740 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f10e3734a00 s->prefetch_data=0
2017-12-08 16:25:49.460586 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.460598 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.461480 7f10e1341e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:49.461534 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea1273a0 obj=.rgw.root:region_map state=0x7f10e3734860 s->prefetch_data=0
2017-12-08 16:25:49.462479 7f10e1341e00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:49.462499 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126ce0 obj=.rgw.root:default.realm state=0x7f10e3734860 s->prefetch_data=0
2017-12-08 16:25:49.463453 7f10e1341e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:49.463471 7f10e1341e00 10 Creating default zonegroup
2017-12-08 16:25:49.464125 7f10e1341e00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:49.576906 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:49.576918 7f10e1341e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.576920 7f10e1341e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:49.576931 7f10e1341e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:49.576953 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea125ff0 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.577807 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.577834 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.578571 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.578614 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea125ff0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.579339 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.579351 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.579999 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.580159 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126a20 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.581301 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.581315 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.582135 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.582161 7f10e1341e00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.582166 7f10e1341e00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation
2017-12-08 16:25:49.582173 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s
>prefetch_data=0
2017-12-08 16:25:49.582984 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.583007 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.583881 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.583911 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.584690 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.584705 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.585407 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.585444 7f10e1341e00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:49.585456 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cb0 obj=.rgw.root:zonegroups_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.586145 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.586160 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.586787 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.586824 7f10e1341e00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:49.586827 7f10e1341e00 10 create_default() returned EEXIST, we raced with another zonegroup creation
2017-12-08 16:25:49.586833 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zonegroups_names.default state=0x7f10e3a3cc20 s
>prefetch_data=0
2017-12-08 16:25:49.587498 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.587522 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.588208 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.588239 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126cf0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.589132 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.589157 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.589987 7f10e1341e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:49.590044 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea126950 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.590955 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.590980 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.591781 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.591832 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea127090 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.592798 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.592811 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.593718 7f10e1341e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:49.593753 7f10e1341e00 20 zonegroup default
2017-12-08 16:25:49.593769 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea1273a0 obj=.rgw.root:period_config.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.594887 7f10e1341e00 10 Cannot find current period zone using local zone
2017-12-08 16:25:49.594898 7f10e1341e00 10 Using default name default
2017-12-08 16:25:49.594905 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea127220 obj=.rgw.root:zone_names.default state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.595817 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.595832 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.596617 7f10e1341e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:49.596647 7f10e1341e00 20 get_system_obj_state: rctx=0x7ffcea127220 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f10e3a3cc20 s->prefetch_data=0
2017-12-08 16:25:49.597536 7f10e1341e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:49.597550 7f10e1341e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:49.598318 7f10e1341e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:49.598358 7f10e1341e00 20 zone default
2017-12-08 16:25:50.130678 7f10e1341e00 1 ERROR: failed to initialize watch: (34) Numerical result out of range
2017-12-08 16:25:50.132593 7f10e1341e00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:50.528896 7fca1f4f4e00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:50.528973 7fca1f4f4e00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666157
2017-12-08 16:25:50.575876 7fca076c2700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:50.575898 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1ce0 obj=.rgw.root:default.realm state=0x7fca21936520 s
>prefetch_data=0
2017-12-08 16:25:50.578640 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1940 obj=.rgw.root:converted state=0x7fca21936520 s->prefetch_data=0
2017-12-08 16:25:50.580339 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1030 obj=.rgw.root:default.realm state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.581277 7fca1f4f4e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:50.698892 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:50.698913 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.698915 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:50.698917 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:50.698950 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zone_names.default state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.699728 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.699748 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.700584 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.700636 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.701514 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.701526 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.702333 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.702398 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zonegroups_names.default state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.703074 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.703087 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.704122 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.704151 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1260 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7fca219366c0 s->prefetch_data=0
2017-12-08 16:25:50.705469 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.705481 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.706455 7fca1f4f4e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:50.706506 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1ec0 obj=.rgw.root:region_map state=0x7fca21936520 s->prefetch_data=0
2017-12-08 16:25:50.707407 7fca1f4f4e00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:50.707427 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1800 obj=.rgw.root:default.realm state=0x7fca21936520 s->prefetch_data=0
2017-12-08 16:25:50.708182 7fca1f4f4e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:50.708209 7fca1f4f4e00 10 Creating default zonegroup
2017-12-08 16:25:50.709148 7fca1f4f4e00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:50.819746 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:50.819757 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.819759 7fca1f4f4e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:50.819770 7fca1f4f4e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:50.819802 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c0b10 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.820522 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.820534 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.821566 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.821594 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c0b10 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.822392 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.822405 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.823087 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.823260 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1540 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.824066 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.824079 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.824824 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.824848 7fca1f4f4e00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.824853 7fca1f4f4e00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation
2017-12-08 16:25:50.824860 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s
>prefetch_data=0
2017-12-08 16:25:50.825542 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.825554 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.826230 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.826258 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.826904 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.826928 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.827552 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.827597 7fca1f4f4e00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:50.827604 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c17d0 obj=.rgw.root:zonegroups_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.828246 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.828258 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.828942 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.828968 7fca1f4f4e00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:50.828970 7fca1f4f4e00 10 create_default() returned EEXIST, we raced with another zonegroup creation
2017-12-08 16:25:50.828976 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zonegroups_names.default state=0x7fca21c44040 s
>prefetch_data=0
2017-12-08 16:25:50.829652 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.829665 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.830364 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.830405 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1810 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.831396 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.831410 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.832361 7fca1f4f4e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:50.832404 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1470 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.833253 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.833267 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.834037 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.834088 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1bb0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.835025 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.835038 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.836189 7fca1f4f4e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:50.836230 7fca1f4f4e00 20 zonegroup default
2017-12-08 16:25:50.836245 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1ec0 obj=.rgw.root:period_config.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.837228 7fca1f4f4e00 10 Cannot find current period zone using local zone
2017-12-08 16:25:50.837239 7fca1f4f4e00 10 Using default name default
2017-12-08 16:25:50.837246 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1d40 obj=.rgw.root:zone_names.default state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.838080 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.838094 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.838835 7fca1f4f4e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:50.838864 7fca1f4f4e00 20 get_system_obj_state: rctx=0x7ffcc35c1d40 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7fca21c44040 s->prefetch_data=0
2017-12-08 16:25:50.839563 7fca1f4f4e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:50.839575 7fca1f4f4e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:50.840274 7fca1f4f4e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:50.840312 7fca1f4f4e00 20 zone default
2017-12-08 16:25:51.365105 7fca1f4f4e00 1 ERROR: failed to initialize watch: (34) Numerical result out of range
2017-12-08 16:25:51.366773 7fca1f4f4e00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:51.772064 7f37a592de00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:51.772130 7f37a592de00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666179
2017-12-08 16:25:51.814258 7f378dafb700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:51.814288 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0620 obj=.rgw.root:default.realm state=0x7f37a6bb8860 s
>prefetch_data=0
2017-12-08 16:25:51.816851 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0280 obj=.rgw.root:converted state=0x7f37a6bb8860 s->prefetch_data=0
2017-12-08 16:25:51.818560 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbf970 obj=.rgw.root:default.realm state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.819409 7f37a592de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:51.924089 7f37a592de00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:51.924109 7f37a592de00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:51.924111 7f37a592de00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:51.924113 7f37a592de00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:51.924146 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zone_names.default state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.925249 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.925267 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.926066 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:51.926110 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.926868 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.926879 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.927601 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:51.927657 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zonegroups_names.default state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.928376 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.928387 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.929074 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:51.929099 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfba0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f37a6bb8a00 s->prefetch_data=0
2017-12-08 16:25:51.930034 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:51.930046 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:51.930865 7f37a592de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:51.930913 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0800 obj=.rgw.root:region_map state=0x7f37a6bb8860 s->prefetch_data=0
2017-12-08 16:25:51.931821 7f37a592de00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:51.931839 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0140 obj=.rgw.root:default.realm state=0x7f37a6bb8860 s->prefetch_data=0
2017-12-08 16:25:51.932764 7f37a592de00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:51.932779 7f37a592de00 10 Creating default zonegroup
2017-12-08 16:25:51.933511 7f37a592de00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:52.036156 7f37a592de00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:52.036168 7f37a592de00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.036170 7f37a592de00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:52.036180 7f37a592de00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:52.036558 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbf450 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.037250 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.037263 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.038040 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.038068 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbf450 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.038865 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.038880 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.039543 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.039694 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfe80 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.040584 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.040596 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.041380 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.041417 7f37a592de00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.041422 7f37a592de00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation
2017-12-08 16:25:52.041432 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s
>prefetch_data=0
2017-12-08 16:25:52.042230 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.042244 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.042943 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.042984 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.043769 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.043776 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.044490 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.044524 7f37a592de00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.044533 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0110 obj=.rgw.root:zonegroups_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.045233 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.045245 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.045923 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.045959 7f37a592de00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:52.045964 7f37a592de00 10 create_default() returned EEXIST, we raced with another zonegroup creation
2017-12-08 16:25:52.045970 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zonegroups_names.default state=0x7f37a6ec6040 s
>prefetch_data=0
2017-12-08 16:25:52.046606 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.046629 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.047239 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.047268 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0150 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.048131 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.048144 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.048928 7f37a592de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:52.048984 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bbfdb0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.049584 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.049608 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.050135 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.050187 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc04f0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.051010 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.051036 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.051789 7f37a592de00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:52.051829 7f37a592de00 20 zonegroup default
2017-12-08 16:25:52.051845 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0800 obj=.rgw.root:period_config.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.052768 7f37a592de00 10 Cannot find current period zone using local zone
2017-12-08 16:25:52.052778 7f37a592de00 10 Using default name default
2017-12-08 16:25:52.052785 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0680 obj=.rgw.root:zone_names.default state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.053698 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.053713 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.054490 7f37a592de00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.054518 7f37a592de00 20 get_system_obj_state: rctx=0x7ffc11bc0680 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f37a6ec6040 s->prefetch_data=0
2017-12-08 16:25:52.055241 7f37a592de00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.055253 7f37a592de00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.055898 7f37a592de00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.055948 7f37a592de00 20 zone default
2017-12-08 16:25:52.586099 7f37a592de00 1 ERROR: failed to initialize watch: (34) Numerical result out of range
2017-12-08 16:25:52.587361 7f37a592de00 -1 Couldn't init storage provider (RADOS)
2017-12-08 16:25:52.768390 7f38d8305e00 0 deferred set uid:gid to 167:167 (ceph:ceph)
2017-12-08 16:25:52.768449 7f38d8305e00 0 ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable), process (unknown), pid 1666201
2017-12-08 16:25:52.806844 7f38c04d3700 2 RGWDataChangesLog::ChangesRenewThread: start
2017-12-08 16:25:52.806842 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189790 obj=.rgw.root:default.realm state=0x7f38d98d8860 s
>prefetch_data=0
2017-12-08 16:25:52.809239 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1893f0 obj=.rgw.root:converted state=0x7f38d98d8860 s->prefetch_data=0
2017-12-08 16:25:52.810755 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188ae0 obj=.rgw.root:default.realm state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.811711 7f38d8305e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:52.940380 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:52.940398 7f38d8305e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:52.940400 7f38d8305e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:52.940402 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:52.940431 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zone_names.default state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.941354 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.941371 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.942154 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.942525 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.943319 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.943329 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.943955 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:52.944010 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zonegroups_names.default state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.944728 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.944739 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.945419 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:52.945460 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188d10 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f38d98d8a00 s->prefetch_data=0
2017-12-08 16:25:52.946489 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:52.946500 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:52.947416 7f38d8305e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:52.947462 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189970 obj=.rgw.root:region_map state=0x7f38d98d8860 s->prefetch_data=0
2017-12-08 16:25:52.948498 7f38d8305e00 10 cannot find current period zonegroup using local zonegroup
2017-12-08 16:25:52.948515 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892b0 obj=.rgw.root:default.realm state=0x7f38d98d8860 s->prefetch_data=0
2017-12-08 16:25:52.949348 7f38d8305e00 10 could not read realm id: (2) No such file or directory
2017-12-08 16:25:52.949363 7f38d8305e00 10 Creating default zonegroup
2017-12-08 16:25:52.950047 7f38d8305e00 10 couldn't find old data placement pools config, setting up new ones for the zone
2017-12-08 16:25:53.061017 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:53.061028 7f38d8305e00 20 RGWRados::pool_iterate: got zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:53.061030 7f38d8305e00 20 RGWRados::pool_iterate: got zone_names.default
2017-12-08 16:25:53.061038 7f38d8305e00 20 RGWRados::pool_iterate: got zonegroups_names.default
2017-12-08 16:25:53.061068 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1885c0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.061877 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.061888 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.062666 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.062691 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1885c0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.063442 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.063453 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.064065 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.064542 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188ff0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.065347 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.065358 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.066035 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.066056 7f38d8305e00 10 ERROR: name default already in use for obj id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:53.066060 7f38d8305e00 10 zone_params::create_default() returned EEXIST, we raced with another default zone_params creation
2017-12-08 16:25:53.066066 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s
>prefetch_data=0
2017-12-08 16:25:53.066757 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.066769 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.067404 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.067448 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.068031 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.068042 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.068663 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.068695 7f38d8305e00 20 zone_params::create_default() default id ef32715f-ed60-46cf-aa1c-717364ba5f58
2017-12-08 16:25:53.068702 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189280 obj=.rgw.root:zonegroups_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.069397 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.069409 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.070038 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.070062 7f38d8305e00 10 ERROR: name default already in use for obj id 084b2aa6-0daf-46ca-a868-c69dae23ff51
2017-12-08 16:25:53.070064 7f38d8305e00 10 create_default() returned EEXIST, we raced with another zonegroup creation
2017-12-08 16:25:53.070070 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zonegroups_names.default state=0x7f38d9be6040 s
>prefetch_data=0
2017-12-08 16:25:53.070771 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.070783 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.071472 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.071498 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1892c0 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.072495 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.072506 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.073438 7f38d8305e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:53.073477 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c188f20 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.074346 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.074359 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.075033 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.075100 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189660 obj=.rgw.root:zonegroup_info.084b2aa6-0daf-46ca-a868-c69dae23ff51 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.076145 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.076156 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.077090 7f38d8305e00 20 rados->read r=0 bl.length=333
2017-12-08 16:25:53.077119 7f38d8305e00 20 zonegroup default
2017-12-08 16:25:53.077132 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c189970 obj=.rgw.root:period_config.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.078547 7f38d8305e00 10 Cannot find current period zone using local zone
2017-12-08 16:25:53.078554 7f38d8305e00 10 Using default name default
2017-12-08 16:25:53.078560 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1897f0 obj=.rgw.root:zone_names.default state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.079270 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.079294 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.079922 7f38d8305e00 20 rados->read r=0 bl.length=46
2017-12-08 16:25:53.079949 7f38d8305e00 20 get_system_obj_state: rctx=0x7ffe7c1897f0 obj=.rgw.root:zone_info.ef32715f-ed60-46cf-aa1c-717364ba5f58 state=0x7f38d9be6040 s->prefetch_data=0
2017-12-08 16:25:53.080574 7f38d8305e00 20 get_system_obj_state: s->obj_tag was set empty
2017-12-08 16:25:53.080585 7f38d8305e00 20 rados->read ofs=0 len=524288
2017-12-08 16:25:53.081312 7f38d8305e00 20 rados->read r=0 bl.length=688
2017-12-08 16:25:53.081348 7f38d8305e00 20 zone default
2017-12-08 16:25:53.720449 7f38d8305e00 -1 ERROR: failed to initialize watch: (34) Numerical result out of range
2017-12-08 16:25:53.722047 7f38d8305e00 -1 Couldn't init storage provider (RADOS)


Related issues 3 (0 open3 closed)

Related to rgw - Bug #23480: No meaningful error when RGW cannot create pools due to lack of available PGsResolvedCasey Bodley03/28/2018

Actions
Related to rgw - Bug #58692: Consider setting "bulk" autoscale pool flag when automatically creating a data pool for RGWResolvedYehuda Sadeh

Actions
Copied to RADOS - Backport #23349: luminous: Couldn't init storage provider (RADOS)ResolvedNathan CutlerActions
Actions

Also available in: Atom PDF