Actions
Bug #18979
closed[ceph-mon] create-keys:Cannot get or create admin key
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
During ceph-deploy run on master branch, I see the following only on centos 7.3
2017-02-17T18:18:16.333 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get client.admin 2017-02-17T18:18:16.627 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get-or-create client.admin osd allow * mds allow * mon allow * 2017-02-17T18:18:16.931 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get client.bootstrap-mds 2017-02-17T18:18:17.228 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get-or-create client.bootstrap-mds mon allow profile bootstrap-mds 2017-02-17T18:18:17.509 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get client.bootstrap-osd 2017-02-17T18:18:17.781 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get-or-create client.bootstrap-osd mon allow profile bootstrap-osd 2017-02-17T18:18:18.064 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get client.bootstrap-rgw 2017-02-17T18:18:18.356 INFO:teuthology.orchestra.run.vpm157.stderr:[vpm101][INFO ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-vpm101/keyring auth get-or-create client.bootstrap-rgw mon allow profile bootstrap-rgw 2017-02-17T18:18:18.651 INFO:teuthology.orchestra.run.vpm157.stderr:[ceph_deploy.gatherkeys][INFO ] Storing ceph.client.admin.keyring 2017-02-17T18:18:18.651 INFO:teuthology.orchestra.run.vpm157.stderr:[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-mds.keyring 2017-02-17T18:18:18.651 INFO:teuthology.orchestra.run.vpm157.stderr:[ceph_deploy.gatherkeys][INFO ] keyring 'ceph.mon.keyring' already exists 2017-02-17T18:18:18.651 INFO:teuthology.orchestra.run.vpm157.stderr:[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-osd.keyring 2017-02-17T18:18:18.651 INFO:teuthology.orchestra.run.vpm157.stderr:[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-rgw.keyring 2017-02-17T18:18:18.652 INFO:teuthology.orchestra.run.vpm157.stderr:[ceph_deploy.gatherkeys][INFO ] Destroy temp directory /tmp/tmpkwwopyng 2017-02-17T18:18:18.706 INFO:teuthology.orchestra.run.vpm101:Running: 'sudo ceph-create-keys --cluster ceph --id vpm101' 2017-02-17T18:18:18.898 INFO:teuthology.orchestra.run.vpm101.stderr:INFO:ceph-create-keys:Talking to monitor... 2017-02-17T18:18:19.163 INFO:teuthology.orchestra.run.vpm101.stderr:exported keyring for client.admin 2017-02-17T18:18:19.174 INFO:teuthology.orchestra.run.vpm101.stderr:INFO:ceph-create-keys:Talking to monitor... 2017-02-17T18:18:19.463 INFO:teuthology.orchestra.run.vpm101.stderr:INFO:ceph-create-keys:Talking to monitor... 2017-02-17T18:18:19.745 INFO:teuthology.orchestra.run.vpm101.stderr:INFO:ceph-create-keys:Talking to monitor... 2017-02-17T18:18:20.011 INFO:teuthology.orchestra.run.vpm157:Running: 'sudo ceph-create-keys --cluster ceph --id vpm157' 2017-02-17T18:18:20.219 INFO:teuthology.orchestra.run.vpm157.stderr:INFO:ceph-create-keys:Talking to monitor... 2017-02-17T18:18:20.946 INFO:teuthology.orchestra.run.vpm157.stderr:exported keyring for client.admin 2017-02-17T18:18:20.979 INFO:teuthology.orchestra.run.vpm157.stderr:INFO:ceph-create-keys:Cannot get or create admin key 2017-02-17T18:18:21.982 INFO:teuthology.orchestra.run.vpm157.stderr:INFO:ceph-create-keys:Talking to monitor... 2017-02-17T18:18:22.256 INFO:teuthology.orchestra.run.vpm157.stderr:exported keyring for client.admin 2017-02-17T18:18:22.302 INFO:teuthology.orchestra.run.vpm157.stderr:INFO:ceph-create-keys:Cannot get or create admin key 2017-02-17T18:18:23.302 INFO:teuthology.orchestra.run.vpm157.stderr:INFO:ceph-create-keys:Talking to monitor...
Updated by Brad Hubbard about 7 years ago
2017-02-17T18:18:11.237 INFO:teuthology.orchestra.run.vpm031.stderr:[vpm165.front.sepia.ceph.com][ERROR ] "ceph auth get-or-create for keytype admin returned -11
$ errno 11
#define EAGAIN 11 /* Try again /
#define EWOULDBLOCK EAGAIN / Operation would block */
Updated by Kefu Chai about 7 years ago
ceph cli crashed with coredump
(gdb) p initialized
$23 = true
(gdb) bt
#0 0x00007f88767e9a97 in std::unique_ptr<AuthClientHandler, std::default_delete<AuthClientHandler> >::get (this=0x18) at /usr/include/c++/4.8.2/bits/unique_ptr.h:234
#1 std::unique_ptr<AuthClientHandler, std::default_delete<AuthClientHandler> >::operator bool (this=0x18) at /usr/include/c++/4.8.2/bits/unique_ptr.h:245
#2 MonClient::build_authorizer (this=0x7f886c034e88, service_id=16) at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/mon/MonClient.cc:1133
#3 0x00007f887f096b57 in librados::RadosClient::ms_get_authorizer (this=<optimized out>, dest_type=<optimized out>, authorizer=0x7f886a0895f0, force_new=<optimized out>)
at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/librados/RadosClient.cc:63
#4 0x00007f88768b8f60 in Messenger::ms_deliver_get_authorizer (force_new=false, peer_type=16, this=0x7f886c083390)
at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/msg/Messenger.h:722
#5 AsyncMessenger::get_authorizer (force_new=false, peer_type=16, this=0x7f886c083390) at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/msg/async/AsyncMessenger.h:366
#6 AsyncConnection::_process_connection (this=this@entry=0x7f885400fb00) at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/msg/async/AsyncConnection.cc:1024
#7 0x00007f88768bdd40 in AsyncConnection::process (this=0x7f885400fb00) at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/msg/async/AsyncConnection.cc:834
#8 0x00007f88768cfe39 in EventCenter::process_events (this=this@entry=0x7f886c0b15e0, timeout_microseconds=<optimized out>, timeout_microseconds@entry=30000000)
at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/msg/async/Event.cc:406
#9 0x00007f88768d347a in NetworkStack::__lambda4::operator() (__closure=0x7f886c10af10) at /usr/src/debug/ceph-12.0.0-476-gf5ac182/src/msg/async/Stack.cc:46
#10 0x00007f8874a37230 in ?? ()
#11 0x0000000000000000 in ?? ()
"this=0x18" this is the cause of segfault.
Updated by Vasu Kulkarni about 7 years ago
Kefu,
Do you want to own this or this should be assigned to someone else?
Updated by Kefu Chai about 7 years ago
- Is duplicate of Bug #19097: segv in MonClient::build_authorizer(int) added
Actions