Actions
Bug #42832
closednautilus: mgr/dashboard: Nautilus: backend API test failure: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest)
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
When triggering the dashboard backend API tests based on Nautilus PRs the following failure occurs:
28733 ? Ssl 0:14 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i a -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28776 ? Ssl 0:10 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i b -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28819 ? Ssl 0:10 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i c -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
29880 ? Ssl 0:03 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 0 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30242 ? Ssl 0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 1 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30604 ? Ssl 0:03 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 2 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30966 ? Ssl 0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 3 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
2019-11-15 09:27:20,535.535 INFO:__main__:Running ['./bin/./ceph-mgr', '-i', 'z']
2019-11-15 09:27:20,628.628 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:26,263.263 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:26,946.946 INFO:tasks.mgr.mgr_test_case:Available after assign ports (new active y/5411)
2019-11-15 09:27:26,947.947 INFO:__main__:Running ['./bin/ceph', 'mgr', 'module', 'ls']
2019-11-15 09:27:27,559.559 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:28,193.193 INFO:__main__:Running ['./bin/ceph', 'mgr', 'metadata']
2019-11-15 09:27:28,766.766 INFO:__main__:Running ['./bin/ceph', 'mgr', 'module', 'enable', 'dashboard', '--force']
2019-11-15 09:27:29,806.806 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:35,435.435 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:36,119.119 INFO:tasks.mgr.mgr_test_case:Restarted after module load (new active y/5455)
2019-11-15 09:27:36,120.120 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:36,769.769 INFO:tasks.mgr.mgr_test_case:Found dashboard at https://ceph-builders:7789/ (daemon y/5455)
2019-11-15 09:27:36,770.770 INFO:__main__:Running ['ps', 'ww', '-u1001']
2019-11-15 09:27:36,780.780 INFO:__main__:No match for mds a: PID TTY STAT TIME COMMAND
6220 ? Ssl 0:01 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/radosgw -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf --log-file=/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/out/radosgw.8000.log --admin-socket=/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/out/radosgw.8000.asok --pid-file=/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/out/radosgw.8000.pid --debug-rgw=20 --debug-ms=1 -n client.rgw --rgw_frontends=beast port=8000
7740 ? Sl 0:02 python ../qa/tasks/vstart_runner.py --ignore-missing-binaries tasks.mgr.test_dashboard tasks.mgr.dashboard.test_auth tasks.mgr.dashboard.test_cephfs tasks.mgr.dashboard.test_cluster_configuration tasks.mgr.dashboard.test_erasure_code_profile tasks.mgr.dashboard.test_ganesha tasks.mgr.dashboard.test_health tasks.mgr.dashboard.test_host tasks.mgr.dashboard.test_logs tasks.mgr.dashboard.test_mgr_module tasks.mgr.dashboard.test_monitor tasks.mgr.dashboard.test_osd tasks.mgr.dashboard.test_perf_counters tasks.mgr.dashboard.test_pool tasks.mgr.dashboard.test_rbd_mirroring tasks.mgr.dashboard.test_rbd tasks.mgr.dashboard.test_requests tasks.mgr.dashboard.test_rgw tasks.mgr.dashboard.test_role tasks.mgr.dashboard.test_settings tasks.mgr.dashboard.test_summary tasks.mgr.dashboard.test_user tasks.mgr.test_module_selftest
13877 ? S 0:01 sshd: jenkins-build@notty
13958 ? Ss 0:00 bash -c cd "/home/jenkins-build/build" && java -jar remoting.jar -workDir /home/jenkins-build/build
13968 ? Sl 0:22 java -jar remoting.jar -workDir /home/jenkins-build/build
16686 ? Ssl 0:02 ./bin/./ceph-mgr -i y
16688 ? Ssl 0:01 ./bin/./ceph-mgr -i x
16691 ? Ssl 0:01 ./bin/./ceph-mgr -i z
17054 ? R 0:00 ps ww -u1001
28134 ? S 0:00 /bin/sh -xe /tmp/jenkins845185389412488004.sh
28136 ? S 0:00 timeout 7200 ./run-backend-api-tests.sh
28137 ? S 0:00 bash ./run-backend-api-tests.sh
28733 ? Ssl 0:15 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i a -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28776 ? Ssl 0:11 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i b -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28819 ? Ssl 0:11 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i c -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
29880 ? Ssl 0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 0 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30242 ? Ssl 0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 1 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30604 ? Ssl 0:03 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 2 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30966 ? Ssl 0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 3 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
2019-11-15 09:27:36,780.780 ERROR:__main__:tried to stop a non-running daemon
2019-11-15 09:27:36,780.780 INFO:__main__:Running ['./bin/ceph', 'mds', 'fail', 'a']
2019-11-15 09:27:38,334.334 INFO:__main__:Running ['./bin/ceph', 'osd', 'dump', '--format=json-pretty']
2019-11-15 09:27:38,927.927 INFO:__main__:Running ['./bin/ceph', 'fs', 'dump', '--format=json']
2019-11-15 09:27:39,486.486 INFO:__main__:Running ['./bin/ceph', 'fs', 'dump', '--format=json']
2019-11-15 09:27:39,999.999 INFO:__main__:Discovered MDS IDs: ['a']
2019-11-15 09:27:39,999.999 INFO:__main__:Running ['./bin/ceph', '--format=json-pretty', 'osd', 'lspools']
2019-11-15 09:27:40,611.611 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs'
2019-11-15 09:27:40,612.612 INFO:__main__:Running ['./bin/ceph', 'daemon', 'mon.a', 'config', 'get', 'mon_pg_warn_min_per_osd']
ERROR: ld.so: object 'ASAN_LIBRARY-NOTFOUND' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'ASAN_LIBRARY-NOTFOUND' from LD_PRELOAD cannot be preloaded: ignored.
Can't get admin socket path: unable to get conf option admin_socket for mon.a: ERROR: ld.so: object 'ASAN_LIBRARY-NOTFOUND' from LD_PRELOAD cannot be preloaded: ignored.
2019-11-15 09:27:40,783.783 INFO:__main__:ERROR
2019-11-15 09:27:40,784.784 INFO:__main__:
2019-11-15 09:27:40,785.785 INFO:__main__:======================================================================
2019-11-15 09:27:40,785.785 INFO:__main__:ERROR: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest)
2019-11-15 09:27:40,786.786 INFO:__main__:----------------------------------------------------------------------
2019-11-15 09:27:40,786.786 INFO:__main__:Traceback (most recent call last):
2019-11-15 09:27:40,786.786 INFO:__main__: File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/mgr/dashboard/helper.py", line 127, in setUpClass
2019-11-15 09:27:40,786.786 INFO:__main__: cls.fs = cls.mds_cluster.newfs(create=True)
2019-11-15 09:27:40,786.786 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 705, in newfs
2019-11-15 09:27:40,787.787 INFO:__main__: return LocalFilesystem(self._ctx, name=name, create=create)
2019-11-15 09:27:40,787.787 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 755, in __init__
2019-11-15 09:27:40,787.787 INFO:__main__: self.create()
2019-11-15 09:27:40,787.787 INFO:__main__: File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 516, in create
2019-11-15 09:27:40,787.787 INFO:__main__: pgs_per_fs_pool = self.get_pgs_per_fs_pool()
2019-11-15 09:27:40,787.787 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 776, in get_pgs_per_fs_pool
2019-11-15 09:27:40,788.788 INFO:__main__: return 3 * int(self.get_config('mon_pg_warn_min_per_osd'))
2019-11-15 09:27:40,788.788 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 644, in get_config
2019-11-15 09:27:40,788.788 INFO:__main__: return self.json_asok(['config', 'get', key], service_type, service_id)[key]
2019-11-15 09:27:40,788.788 INFO:__main__: File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 178, in json_asok
2019-11-15 09:27:40,788.788 INFO:__main__: proc = self.mon_manager.admin_socket(service_type, service_id, command, timeout=timeout)
2019-11-15 09:27:40,788.788 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 618, in admin_socket
2019-11-15 09:27:40,789.789 INFO:__main__: timeout=timeout
2019-11-15 09:27:40,789.789 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 301, in run
2019-11-15 09:27:40,789.789 INFO:__main__: proc.wait()
2019-11-15 09:27:40,789.789 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 179, in wait
2019-11-15 09:27:40,789.789 INFO:__main__: raise CommandFailedError(self.args, self.exitstatus)
2019-11-15 09:27:40,789.789 INFO:__main__:CommandFailedError: Command failed with status 22: ['./bin/ceph', 'daemon', 'mon.a', 'config', 'get', 'mon_pg_warn_min_per_osd']
2019-11-15 09:27:40,790.790 INFO:__main__:
2019-11-15 09:27:40,790.790 INFO:__main__:----------------------------------------------------------------------
2019-11-15 09:27:40,790.790 INFO:__main__:Ran 12 tests in 210.298s
2019-11-15 09:27:40,790.790 INFO:__main__:
2019-11-15 09:27:40,790.790 INFO:__main__:FAILED (errors=1)
2019-11-15 09:27:40,791.791 INFO:__main__:
2019-11-15 09:27:40,791.791 INFO:__main__:======================================================================
2019-11-15 09:27:40,791.791 INFO:__main__:ERROR: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest)
2019-11-15 09:27:40,791.791 INFO:__main__:----------------------------------------------------------------------
2019-11-15 09:27:40,791.791 INFO:__main__:Traceback (most recent call last):
2019-11-15 09:27:40,792.792 INFO:__main__: File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/mgr/dashboard/helper.py", line 127, in setUpClass
2019-11-15 09:27:40,792.792 INFO:__main__: cls.fs = cls.mds_cluster.newfs(create=True)
2019-11-15 09:27:40,792.792 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 705, in newfs
2019-11-15 09:27:40,792.792 INFO:__main__: return LocalFilesystem(self._ctx, name=name, create=create)
2019-11-15 09:27:40,792.792 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 755, in __init__
2019-11-15 09:27:40,792.792 INFO:__main__: self.create()
2019-11-15 09:27:40,793.793 INFO:__main__: File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 516, in create
2019-11-15 09:27:40,793.793 INFO:__main__: pgs_per_fs_pool = self.get_pgs_per_fs_pool()
2019-11-15 09:27:40,793.793 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 776, in get_pgs_per_fs_pool
2019-11-15 09:27:40,793.793 INFO:__main__: return 3 * int(self.get_config('mon_pg_warn_min_per_osd'))
2019-11-15 09:27:40,793.793 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 644, in get_config
2019-11-15 09:27:40,793.793 INFO:__main__: return self.json_asok(['config', 'get', key], service_type, service_id)[key]
2019-11-15 09:27:40,794.794 INFO:__main__: File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 178, in json_asok
2019-11-15 09:27:40,794.794 INFO:__main__: proc = self.mon_manager.admin_socket(service_type, service_id, command, timeout=timeout)
2019-11-15 09:27:40,794.794 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 618, in admin_socket
2019-11-15 09:27:40,794.794 INFO:__main__: timeout=timeout
2019-11-15 09:27:40,794.794 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 301, in run
2019-11-15 09:27:40,794.794 INFO:__main__: proc.wait()
2019-11-15 09:27:40,795.795 INFO:__main__: File "../qa/tasks/vstart_runner.py", line 179, in wait
2019-11-15 09:27:40,795.795 INFO:__main__: raise CommandFailedError(self.args, self.exitstatus)
2019-11-15 09:27:40,795.795 INFO:__main__:CommandFailedError: Command failed with status 22: ['./bin/ceph', 'daemon', 'mon.a', 'config', 'get', 'mon_pg_warn_min_per_osd']
2019-11-15 09:27:40,795.795 INFO:__main__:
Using guessed paths /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/lib/ ['/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa', '/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/lib/cython_modules/lib.2', '/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/src/pybind']
Displaying last 60000 lines of: /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/src/pybind/mgr/dashboard/../../../../build/out/mgr.x.log
source: https://jenkins.ceph.com/job/ceph-dashboard-pr-backend/470/
Updated by Alfonso MartÃnez over 4 years ago
- Related to Bug #40035: smoke.sh failing in jenkins "make check" test randomly added
Updated by Kefu Chai over 4 years ago
- Subject changed from mgr/dashboard: Nautilus: backend API test failure: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest) to nautilus: mgr/dashboard: Nautilus: backend API test failure: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest)
- Status changed from New to Fix Under Review
- Assignee set to Kefu Chai
- Pull request ID set to 31676
Updated by Alfonso MartÃnez over 4 years ago
- Status changed from Fix Under Review to Resolved
Updated by Ernesto Puerta about 3 years ago
- Project changed from mgr to Dashboard
- Category changed from 151 to Testing & QA
Actions