Project

General

Profile

Actions

Bug #14665

closed

radosgw-admin -n client.0 user create : permission denied

Added by Loïc Dachary about 8 years ago. Updated about 8 years ago.

Status:
Duplicate
Priority:
High
Assignee:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://pulpito.ceph.com/loic-2016-02-04_00:37:12-upgrade:infernalis-infernalis-backports---basic-vps/6158/

2016-02-04T01:59:47.347 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0
2016-02-04T01:59:47.347 INFO:teuthology.orchestra.run.vpm012:Running: "adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key EUHWGVDIRGMKIRDSHADQ --secret DZaXOLpwIosVlrOw6TRTpHyDoqUBeNyVFOQ5kPKuUjkL2Z74vVJh4Q== --email foo.client.0+test@test.test" 
2016-02-04T01:59:47.601 INFO:teuthology.orchestra.run.vpm012.stderr:radosgw-admin: ./common/Mutex.h:89: void Mutex::_post_lock(): Assertion `nlock == 0' failed.
2016-02-04T01:59:47.602 INFO:teuthology.orchestra.run.vpm012.stderr:*** Caught signal (Aborted) **
2016-02-04T01:59:47.602 INFO:teuthology.orchestra.run.vpm012.stderr: in thread 7f744b9cd880
2016-02-04T01:59:47.602 INFO:teuthology.orchestra.run.vpm012.stderr: ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299)
2016-02-04T01:59:47.602 INFO:teuthology.orchestra.run.vpm012.stderr: 1: (()+0x24e492) [0x7f744bc41492]
2016-02-04T01:59:47.602 INFO:teuthology.orchestra.run.vpm012.stderr: 2: (()+0xf100) [0x7f7448245100]
2016-02-04T01:59:47.603 INFO:teuthology.orchestra.run.vpm012.stderr: 3: (gsignal()+0x37) [0x7f74474825f7]
2016-02-04T01:59:47.603 INFO:teuthology.orchestra.run.vpm012.stderr: 4: (abort()+0x148) [0x7f7447483ce8]
2016-02-04T01:59:47.603 INFO:teuthology.orchestra.run.vpm012.stderr: 5: (()+0x2e566) [0x7f744747b566]
2016-02-04T01:59:47.603 INFO:teuthology.orchestra.run.vpm012.stderr: 6: (()+0x2e612) [0x7f744747b612]
2016-02-04T01:59:47.603 INFO:teuthology.orchestra.run.vpm012.stderr: 7: (()+0x40f56) [0x7f74492a3f56]
2016-02-04T01:59:47.603 INFO:teuthology.orchestra.run.vpm012.stderr: 8: (()+0x10d541) [0x7f7449370541]
2016-02-04T01:59:47.604 INFO:teuthology.orchestra.run.vpm012.stderr: 9: (()+0x16be11) [0x7f74493cee11]
2016-02-04T01:59:47.604 INFO:teuthology.orchestra.run.vpm012.stderr: 10: (()+0x1c5594) [0x7f7449428594]
2016-02-04T01:59:47.604 INFO:teuthology.orchestra.run.vpm012.stderr: 11: (()+0x1b067c) [0x7f744941367c]
2016-02-04T01:59:47.604 INFO:teuthology.orchestra.run.vpm012.stderr: 12: (()+0x74081) [0x7f74492d7081]
2016-02-04T01:59:47.604 INFO:teuthology.orchestra.run.vpm012.stderr: 13: (RGWRados::init_rados()+0x92) [0x7f744bb7bb72]
2016-02-04T01:59:47.605 INFO:teuthology.orchestra.run.vpm012.stderr: 14: (RGWCache<RGWRados>::init_rados()+0x33) [0x7f744bbba063]
2016-02-04T01:59:47.605 INFO:teuthology.orchestra.run.vpm012.stderr: 15: (RGWRados::initialize()+0xa) [0x7f744bba9cca]
2016-02-04T01:59:47.605 INFO:teuthology.orchestra.run.vpm012.stderr: 16: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool)+0x67) [0x7f744bb79b67]
2016-02-04T01:59:47.605 INFO:teuthology.orchestra.run.vpm012.stderr: 17: (main()+0x19ee) [0x7f744bafcbce]
2016-02-04T01:59:47.605 INFO:teuthology.orchestra.run.vpm012.stderr: 18: (__libc_start_main()+0xf5) [0x7f744746eb15]
2016-02-04T01:59:47.605 INFO:teuthology.orchestra.run.vpm012.stderr: 19: (()+0x119c59) [0x7f744bb0cc59]
2016-02-04T01:59:47.606 INFO:teuthology.orchestra.run.vpm012.stderr:2016-02-04 09:59:47.603261 7f744b9cd880 -1 asok(0x7f744e6dcb90) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-client.0.4695.asok': (13) Permission denied
2016-02-04T01:59:47.606 INFO:teuthology.orchestra.run.vpm012.stderr:2016-02-04 09:59:47.604154 7f744b9cd880 -1 *** Caught signal (Aborted) **
2016-02-04T01:59:47.606 INFO:teuthology.orchestra.run.vpm012.stderr: in thread 7f744b9cd880

http://pulpito.ceph.com/loic-2016-02-04_00:37:12-upgrade:infernalis-infernalis-backports---basic-vps/6155/

2016-02-04T01:29:57.231 INFO:teuthology.orchestra.run.vpm142:Running: "adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key SVEBSJQUNIVPYLLWWEER --secret TriLJFayzUzgPFBRrriG8qeuZaGwE4NxUIbnE8yKvW9EroradIaRQg== --email foo.client.0+test@test.test" 
2016-02-04T01:29:57.896 INFO:teuthology.orchestra.run.vpm142.stderr:common/ceph_crypto.cc: In function 'void ceph::crypto::init(CephContext*)' thread 7fbe70950880 time 2016-02-04 09:29:57.889260
2016-02-04T01:29:57.897 INFO:teuthology.orchestra.run.vpm142.stderr:common/ceph_crypto.cc: 73: FAILED assert(crypto_context != __null)
2016-02-04T01:29:57.897 INFO:teuthology.orchestra.run.vpm142.stderr: ceph version 9.2.0-140-ga663786 (a663786655b852e8e5f22e6757a43586602cce8d)
2016-02-04T01:29:57.897 INFO:teuthology.orchestra.run.vpm142.stderr: 1: (()+0x130205) [0x7fbe6e316205]
2016-02-04T01:29:57.897 INFO:teuthology.orchestra.run.vpm142.stderr: 2: (()+0x17cda3) [0x7fbe6e362da3]
2016-02-04T01:29:57.897 INFO:teuthology.orchestra.run.vpm142.stderr: 3: (()+0x149979) [0x7fbe6e32f979]
2016-02-04T01:29:57.898 INFO:teuthology.orchestra.run.vpm142.stderr: 4: (()+0x146b20) [0x7fbe6e32cb20]
2016-02-04T01:29:57.898 INFO:teuthology.orchestra.run.vpm142.stderr: 5: (()+0x74052) [0x7fbe6e25a052]
2016-02-04T01:29:57.898 INFO:teuthology.orchestra.run.vpm142.stderr: 6: (RGWRados::init_rados()+0x92) [0x56fd52]
2016-02-04T01:29:57.898 INFO:teuthology.orchestra.run.vpm142.stderr: 7: (RGWCache<RGWRados>::init_rados()+0x33) [0x5ace63]
2016-02-04T01:29:57.898 INFO:teuthology.orchestra.run.vpm142.stderr: 8: (RGWRados::initialize()+0xa) [0x599dca]
2016-02-04T01:29:57.898 INFO:teuthology.orchestra.run.vpm142.stderr: 9: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool)+0x67) [0x56e9d7]
2016-02-04T01:29:57.899 INFO:teuthology.orchestra.run.vpm142.stderr: 10: (main()+0x1a27) [0x4f4a97]
2016-02-04T01:29:57.899 INFO:teuthology.orchestra.run.vpm142.stderr: 11: (__libc_start_main()+0xf5) [0x7fbe6c1ecb15]
2016-02-04T01:29:57.899 INFO:teuthology.orchestra.run.vpm142.stderr: 12: radosgw-admin() [0x504339]
2016-02-04T01:29:57.899 INFO:teuthology.orchestra.run.vpm142.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2016-02-04T01:29:57.899 INFO:teuthology.orchestra.run.vpm142.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion'
2016-02-04T01:29:57.899 INFO:teuthology.orchestra.run.vpm142.stderr:*** Caught signal (Aborted) **
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: in thread 7fbe70950880
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: ceph version 0.94.5-294-gf3bab8c (f3bab8c7bc6bba3c79329d7106684596634e17a6)
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: 1: radosgw-admin() [0x62ebb2]
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: 2: (()+0xf100) [0x7fbe6d1c8100]
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: 3: (gsignal()+0x37) [0x7fbe6c2005f7]
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: 4: (abort()+0x148) [0x7fbe6c201ce8]
2016-02-04T01:29:57.900 INFO:teuthology.orchestra.run.vpm142.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7fbe6cb049d5]
2016-02-04T01:29:57.901 INFO:teuthology.orchestra.run.vpm142.stderr: 6: (()+0x5e946) [0x7fbe6cb02946]
2016-02-04T01:29:57.901 INFO:teuthology.orchestra.run.vpm142.stderr: 7: (()+0x5e973) [0x7fbe6cb02973]
2016-02-04T01:29:57.901 INFO:teuthology.orchestra.run.vpm142.stderr: 8: (()+0x5eb93) [0x7fbe6cb02b93]
2016-02-04T01:29:57.901 INFO:teuthology.orchestra.run.vpm142.stderr: 9: (()+0x1303fa) [0x7fbe6e3163fa]
2016-02-04T01:29:57.901 INFO:teuthology.orchestra.run.vpm142.stderr: 10: (()+0x17cda3) [0x7fbe6e362da3]
2016-02-04T01:29:57.901 INFO:teuthology.orchestra.run.vpm142.stderr: 11: (()+0x149979) [0x7fbe6e32f979]
2016-02-04T01:29:57.902 INFO:teuthology.orchestra.run.vpm142.stderr: 12: (()+0x146b20) [0x7fbe6e32cb20]
2016-02-04T01:29:57.902 INFO:teuthology.orchestra.run.vpm142.stderr: 13: (()+0x74052) [0x7fbe6e25a052]
2016-02-04T01:29:57.902 INFO:teuthology.orchestra.run.vpm142.stderr: 14: (RGWRados::init_rados()+0x92) [0x56fd52]
2016-02-04T01:29:57.902 INFO:teuthology.orchestra.run.vpm142.stderr: 15: (RGWCache<RGWRados>::init_rados()+0x33) [0x5ace63]
2016-02-04T01:29:57.902 INFO:teuthology.orchestra.run.vpm142.stderr: 16: (RGWRados::initialize()+0xa) [0x599dca]
2016-02-04T01:29:57.902 INFO:teuthology.orchestra.run.vpm142.stderr: 17: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool)+0x67) [0x56e9d7]
2016-02-04T01:29:57.903 INFO:teuthology.orchestra.run.vpm142.stderr: 18: (main()+0x1a27) [0x4f4a97]
2016-02-04T01:29:57.903 INFO:teuthology.orchestra.run.vpm142.stderr: 19: (__libc_start_main()+0xf5) [0x7fbe6c1ecb15]
2016-02-04T01:29:57.903 INFO:teuthology.orchestra.run.vpm142.stderr: 20: radosgw-admin() [0x504339]
2016-02-04T01:29:57.903 INFO:teuthology.orchestra.run.vpm142.stderr:2016-02-04 09:29:57.884696 7fbe70950880 -1 asok(0x44a1700) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-client.0.25111.asok': (13) Permission denied
2016-02-04T01:29:57.903 INFO:teuthology.orchestra.run.vpm142.stderr:2016-02-04 09:29:57.890790 7fbe70950880 -1 *** Caught signal (Aborted) **
2016-02-04T01:29:57.903 INFO:teuthology.orchestra.run.vpm142.stderr: in thread 7fbe70950880

Related issues 1 (0 open1 closed)

Copied from rgw - Bug #12288: radosgw: ./common/Mutex.h:89: void Mutex::_post_lock(): Assertion `nlock == 0' failed.Duplicate07/10/2015

Actions
Actions #1

Updated by Loïc Dachary about 8 years ago

  • Copied from Bug #12288: radosgw: ./common/Mutex.h:89: void Mutex::_post_lock(): Assertion `nlock == 0' failed. added
Actions #2

Updated by Loïc Dachary about 8 years ago

  • Subject changed from radosgw: ./common/Mutex.h:89: void Mutex::_post_lock(): Assertion `nlock == 0' failed. to radosgw-admin -n client.0 user create crashes
  • Description updated (diff)
  • Priority changed from Urgent to Normal
Actions #3

Updated by Anonymous about 8 years ago

From the logfile, radosgw-admin can't bind to the radosgw admin socket (Permission denied error).

On a test system on my end (ceph/master) the asok file is created with ceph:ceph ownership:

srwxr-xr-x 1 ceph ceph 0 Feb 8 12:46 /var/run/ceph/ceph.client.radosgw.sle12-ses3-1.asok=

And running radosgw-admin as root has no trouble binding to the socket. Looks like a permission/ownership issue or some small glitch with the user under which the test is run?

  1. radosgw-admin -n client.radosgw.sle12-ses3-1 user create
    2016-02-08 12:47:04.387787 7fe16a2c36c0 -1 asok(0x7fe174e9bfb0) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph.client.radosgw.sle12-ses3-1.asok': (17) File exists
    could not create user: unable to parse parameters, unable to perform operations on the anonymous user
Actions #4

Updated by Loïc Dachary about 8 years ago

  • Subject changed from radosgw-admin -n client.0 user create crashes to radosgw-admin -n client.0 user create : permission denied
Actions #5

Updated by Loïc Dachary about 8 years ago

  • Status changed from New to 12
  • Priority changed from Normal to High

You're correct, it looks like something related to permissions is not right when testing with infernalis. I searched the differences in ceph-qa-suite with git log --patch --no-merges ceph/infernalis..ceph/master but did not find something relevant (or I missed it). The same command is not "sudo radosgw-admin" in master, therefore the permission must be fixed somewhere else.

Actions #6

Updated by Yehuda Sadeh about 8 years ago

This looks like a racing yum update and radosgw-admin execution.

Actions #7

Updated by Yehuda Sadeh about 8 years ago

  • Status changed from 12 to Duplicate

closing this one, same as 14652

Actions

Also available in: Atom PDF