Project

General

Profile

Actions
Copy link

Bug #16379

closed

[ERROR ] "ceph auth get-or-create for keytype admin returned -1

Added by Vasu Kulkarni almost 8 years ago. Updated almost 7 years ago.

Status:
Closed
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

on master branch, the test has been failing due to below issue

http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-06-17_05:00:02-smoke-master-testing-basic-openstack/25471/teuthology.log

2016-06-17T05:24:27.834 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.target093185.asok mon_status
2016-06-17T05:24:28.001 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] ********************************************************************************
2016-06-17T05:24:28.002 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] status for monitor: mon.target093185
2016-06-17T05:24:28.002 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] {
2016-06-17T05:24:28.003 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "election_epoch": 3,
2016-06-17T05:24:28.003 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "extra_probe_peers": [],
2016-06-17T05:24:28.003 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "monmap": {
2016-06-17T05:24:28.004 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     "created": "2016-06-17 05:24:25.727120",
2016-06-17T05:24:28.004 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     "epoch": 1,
2016-06-17T05:24:28.005 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     "fsid": "8ca69e84-06af-4bf3-ba14-0f46fe94952c",
2016-06-17T05:24:28.005 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     "modified": "2016-06-17 05:24:25.727120",
2016-06-17T05:24:28.132 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     "mons": [
2016-06-17T05:24:28.132 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]       {
2016-06-17T05:24:28.133 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]         "addr": "158.69.93.185:6789/0",
2016-06-17T05:24:28.133 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]         "name": "target093185",
2016-06-17T05:24:28.133 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]         "rank": 0
2016-06-17T05:24:28.134 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]       }
2016-06-17T05:24:28.134 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     ]
2016-06-17T05:24:28.135 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   },
2016-06-17T05:24:28.135 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "name": "target093185",
2016-06-17T05:24:28.135 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "outside_quorum": [],
2016-06-17T05:24:28.136 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "quorum": [
2016-06-17T05:24:28.136 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]     0
2016-06-17T05:24:28.137 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   ],
2016-06-17T05:24:28.137 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "rank": 0,
2016-06-17T05:24:28.137 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "state": "leader",
2016-06-17T05:24:28.138 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ]   "sync_provider": []
2016-06-17T05:24:28.138 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] }
2016-06-17T05:24:28.139 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] ********************************************************************************
2016-06-17T05:24:28.139 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] monitor: mon.target093185 is running
2016-06-17T05:24:28.140 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.target093185.asok mon_status
2016-06-17T05:24:28.140 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.mon][INFO  ] processing monitor mon.target093185
2016-06-17T05:24:28.421 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] connection detected need for sudo
2016-06-17T05:24:28.849 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] connected to host: target093185
2016-06-17T05:24:28.850 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] detect platform information from remote host
2016-06-17T05:24:28.888 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] detect machine type
2016-06-17T05:24:28.898 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] find the location of an executable
2016-06-17T05:24:28.901 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo /sbin/initctl version
2016-06-17T05:24:28.916 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] find the location of an executable
2016-06-17T05:24:28.920 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.target093185.asok mon_status
2016-06-17T05:24:29.036 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.mon][INFO  ] mon.target093185 monitor has reached quorum!
2016-06-17T05:24:29.037 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.mon][INFO  ] all initial monitors are running and have formed quorum
2016-06-17T05:24:29.037 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.mon][INFO  ] Running gatherkeys...
2016-06-17T05:24:29.038 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.gatherkeys][INFO  ] Storing keys in temp directory /tmp/tmpL5InKW
2016-06-17T05:24:29.460 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] connection detected need for sudo
2016-06-17T05:24:29.866 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] connected to host: target093185
2016-06-17T05:24:29.868 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] detect platform information from remote host
2016-06-17T05:24:29.898 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] detect machine type
2016-06-17T05:24:29.904 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] find the location of an executable
2016-06-17T05:24:29.907 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo /sbin/initctl version
2016-06-17T05:24:29.926 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] get remote short hostname
2016-06-17T05:24:29.927 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][DEBUG ] fetch remote file
2016-06-17T05:24:29.930 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.target093185.asok mon_status
2016-06-17T05:24:30.042 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-target093185/keyring auth get-or-create client.admin osd allow * mds allow * mon allow *
2016-06-17T05:29:30.029 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][WARNING] No data was received after 300 seconds, disconnecting...
2016-06-17T05:29:30.030 INFO:teuthology.orchestra.run.target093185.stderr:[target093185][ERROR ] "ceph auth get-or-create for keytype admin returned -1
2016-06-17T05:29:30.030 INFO:teuthology.orchestra.run.target093185.stderr:Traceback (most recent call last):
2016-06-17T05:29:30.031 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 851, in emit
2016-06-17T05:29:30.033 INFO:teuthology.orchestra.run.target093185.stderr:    msg = self.format(record)
2016-06-17T05:29:30.034 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 724, in format
2016-06-17T05:29:30.034 INFO:teuthology.orchestra.run.target093185.stderr:    return fmt.format(record)
2016-06-17T05:29:30.034 INFO:teuthology.orchestra.run.target093185.stderr:  File "/home/ubuntu/cephtest/ceph-deploy/ceph_deploy/util/log.py", line 56, in format
2016-06-17T05:29:30.035 INFO:teuthology.orchestra.run.target093185.stderr:    return logging.Formatter.format(self, record)
2016-06-17T05:29:30.035 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 464, in format
2016-06-17T05:29:30.144 INFO:teuthology.orchestra.run.target093185.stderr:    record.message = record.getMessage()
2016-06-17T05:29:30.145 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 328, in getMessage
2016-06-17T05:29:30.145 INFO:teuthology.orchestra.run.target093185.stderr:    msg = msg % self.args
2016-06-17T05:29:30.146 INFO:teuthology.orchestra.run.target093185.stderr:TypeError: not all arguments converted during string formatting
2016-06-17T05:29:30.146 INFO:teuthology.orchestra.run.target093185.stderr:Logged from file gatherkeys.py, line 202
2016-06-17T05:29:30.146 INFO:teuthology.orchestra.run.target093185.stderr:Traceback (most recent call last):
2016-06-17T05:29:30.147 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 851, in emit
2016-06-17T05:29:30.147 INFO:teuthology.orchestra.run.target093185.stderr:    msg = self.format(record)
2016-06-17T05:29:30.147 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 724, in format
2016-06-17T05:29:30.148 INFO:teuthology.orchestra.run.target093185.stderr:    return fmt.format(record)
2016-06-17T05:29:30.148 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 464, in format
2016-06-17T05:29:30.148 INFO:teuthology.orchestra.run.target093185.stderr:    record.message = record.getMessage()
2016-06-17T05:29:30.149 INFO:teuthology.orchestra.run.target093185.stderr:  File "/usr/lib/python2.7/logging/__init__.py", line 328, in getMessage
2016-06-17T05:29:30.149 INFO:teuthology.orchestra.run.target093185.stderr:    msg = msg % self.args
2016-06-17T05:29:30.149 INFO:teuthology.orchestra.run.target093185.stderr:TypeError: not all arguments converted during string formatting
2016-06-17T05:29:30.150 INFO:teuthology.orchestra.run.target093185.stderr:Logged from file gatherkeys.py, line 202
2016-06-17T05:29:30.150 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.gatherkeys][ERROR ] Failed to connect to host:target093185
2016-06-17T05:29:30.150 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy.gatherkeys][INFO  ] Destroy temp directory /tmp/tmpL5InKW
2016-06-17T05:29:30.151 INFO:teuthology.orchestra.run.target093185.stderr:[ceph_deploy][ERROR ] RuntimeError: Failed to connect any mon
2016-06-17T05:29:30.151 INFO:teuthology.orchestra.run.target093185.stderr:
2016-06-17T05:29:31.037 INFO:teuthology.orchestra.run.target093185.stderr:Error in sys.exitfunc:
Actions
Copy link
 #1

Updated by Greg Farnum almost 7 years ago

  • Project changed from Ceph to RADOS
  • Status changed from New to Closed

It's been a year without updates and tests are more or less working, so this must be fixed.

Actions
Copy link

Also available in: Atom PDF