Ceph » mgr » Dashboard

When triggering the dashboard backend API tests based on Nautilus PRs the following failure occurs:

28733 ?        Ssl    0:14 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i a -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28776 ?        Ssl    0:10 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i b -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28819 ?        Ssl    0:10 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i c -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
29880 ?        Ssl    0:03 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 0 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30242 ?        Ssl    0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 1 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30604 ?        Ssl    0:03 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 2 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30966 ?        Ssl    0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 3 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
2019-11-15 09:27:20,535.535 INFO:__main__:Running ['./bin/./ceph-mgr', '-i', 'z']
2019-11-15 09:27:20,628.628 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:26,263.263 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:26,946.946 INFO:tasks.mgr.mgr_test_case:Available after assign ports (new active y/5411)
2019-11-15 09:27:26,947.947 INFO:__main__:Running ['./bin/ceph', 'mgr', 'module', 'ls']
2019-11-15 09:27:27,559.559 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:28,193.193 INFO:__main__:Running ['./bin/ceph', 'mgr', 'metadata']
2019-11-15 09:27:28,766.766 INFO:__main__:Running ['./bin/ceph', 'mgr', 'module', 'enable', 'dashboard', '--force']
2019-11-15 09:27:29,806.806 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:35,435.435 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:36,119.119 INFO:tasks.mgr.mgr_test_case:Restarted after module load (new active y/5455)
2019-11-15 09:27:36,120.120 INFO:__main__:Running ['./bin/ceph', 'status', '--format=json-pretty']
2019-11-15 09:27:36,769.769 INFO:tasks.mgr.mgr_test_case:Found dashboard at https://ceph-builders:7789/ (daemon y/5455)
2019-11-15 09:27:36,770.770 INFO:__main__:Running ['ps', 'ww', '-u1001']
2019-11-15 09:27:36,780.780 INFO:__main__:No match for mds a: PID TTY      STAT   TIME COMMAND
 6220 ?        Ssl    0:01 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/radosgw -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf --log-file=/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/out/radosgw.8000.log --admin-socket=/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/out/radosgw.8000.asok --pid-file=/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/out/radosgw.8000.pid --debug-rgw=20 --debug-ms=1 -n client.rgw --rgw_frontends=beast port=8000
 7740 ?        Sl     0:02 python ../qa/tasks/vstart_runner.py --ignore-missing-binaries tasks.mgr.test_dashboard tasks.mgr.dashboard.test_auth tasks.mgr.dashboard.test_cephfs tasks.mgr.dashboard.test_cluster_configuration tasks.mgr.dashboard.test_erasure_code_profile tasks.mgr.dashboard.test_ganesha tasks.mgr.dashboard.test_health tasks.mgr.dashboard.test_host tasks.mgr.dashboard.test_logs tasks.mgr.dashboard.test_mgr_module tasks.mgr.dashboard.test_monitor tasks.mgr.dashboard.test_osd tasks.mgr.dashboard.test_perf_counters tasks.mgr.dashboard.test_pool tasks.mgr.dashboard.test_rbd_mirroring tasks.mgr.dashboard.test_rbd tasks.mgr.dashboard.test_requests tasks.mgr.dashboard.test_rgw tasks.mgr.dashboard.test_role tasks.mgr.dashboard.test_settings tasks.mgr.dashboard.test_summary tasks.mgr.dashboard.test_user tasks.mgr.test_module_selftest
13877 ?        S      0:01 sshd: jenkins-build@notty
13958 ?        Ss     0:00 bash -c cd "/home/jenkins-build/build" && java  -jar remoting.jar -workDir /home/jenkins-build/build
13968 ?        Sl     0:22 java -jar remoting.jar -workDir /home/jenkins-build/build
16686 ?        Ssl    0:02 ./bin/./ceph-mgr -i y
16688 ?        Ssl    0:01 ./bin/./ceph-mgr -i x
16691 ?        Ssl    0:01 ./bin/./ceph-mgr -i z
17054 ?        R      0:00 ps ww -u1001
28134 ?        S      0:00 /bin/sh -xe /tmp/jenkins845185389412488004.sh
28136 ?        S      0:00 timeout 7200 ./run-backend-api-tests.sh
28137 ?        S      0:00 bash ./run-backend-api-tests.sh
28733 ?        Ssl    0:15 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i a -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28776 ?        Ssl    0:11 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i b -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
28819 ?        Ssl    0:11 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i c -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
29880 ?        Ssl    0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 0 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30242 ?        Ssl    0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 1 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30604 ?        Ssl    0:03 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 2 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
30966 ?        Ssl    0:04 /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-osd -i 3 -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf
2019-11-15 09:27:36,780.780 ERROR:__main__:tried to stop a non-running daemon
2019-11-15 09:27:36,780.780 INFO:__main__:Running ['./bin/ceph', 'mds', 'fail', 'a']
2019-11-15 09:27:38,334.334 INFO:__main__:Running ['./bin/ceph', 'osd', 'dump', '--format=json-pretty']
2019-11-15 09:27:38,927.927 INFO:__main__:Running ['./bin/ceph', 'fs', 'dump', '--format=json']
2019-11-15 09:27:39,486.486 INFO:__main__:Running ['./bin/ceph', 'fs', 'dump', '--format=json']
2019-11-15 09:27:39,999.999 INFO:__main__:Discovered MDS IDs: ['a']
2019-11-15 09:27:39,999.999 INFO:__main__:Running ['./bin/ceph', '--format=json-pretty', 'osd', 'lspools']
2019-11-15 09:27:40,611.611 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs'
2019-11-15 09:27:40,612.612 INFO:__main__:Running ['./bin/ceph', 'daemon', 'mon.a', 'config', 'get', 'mon_pg_warn_min_per_osd']
ERROR: ld.so: object 'ASAN_LIBRARY-NOTFOUND' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'ASAN_LIBRARY-NOTFOUND' from LD_PRELOAD cannot be preloaded: ignored.
Can't get admin socket path: unable to get conf option admin_socket for mon.a: ERROR: ld.so: object 'ASAN_LIBRARY-NOTFOUND' from LD_PRELOAD cannot be preloaded: ignored.

2019-11-15 09:27:40,783.783 INFO:__main__:ERROR
2019-11-15 09:27:40,784.784 INFO:__main__:
2019-11-15 09:27:40,785.785 INFO:__main__:======================================================================
2019-11-15 09:27:40,785.785 INFO:__main__:ERROR: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest)
2019-11-15 09:27:40,786.786 INFO:__main__:----------------------------------------------------------------------
2019-11-15 09:27:40,786.786 INFO:__main__:Traceback (most recent call last):
2019-11-15 09:27:40,786.786 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/mgr/dashboard/helper.py", line 127, in setUpClass
2019-11-15 09:27:40,786.786 INFO:__main__:    cls.fs = cls.mds_cluster.newfs(create=True)
2019-11-15 09:27:40,786.786 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 705, in newfs
2019-11-15 09:27:40,787.787 INFO:__main__:    return LocalFilesystem(self._ctx, name=name, create=create)
2019-11-15 09:27:40,787.787 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 755, in __init__
2019-11-15 09:27:40,787.787 INFO:__main__:    self.create()
2019-11-15 09:27:40,787.787 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 516, in create
2019-11-15 09:27:40,787.787 INFO:__main__:    pgs_per_fs_pool = self.get_pgs_per_fs_pool()
2019-11-15 09:27:40,787.787 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 776, in get_pgs_per_fs_pool
2019-11-15 09:27:40,788.788 INFO:__main__:    return 3 * int(self.get_config('mon_pg_warn_min_per_osd'))
2019-11-15 09:27:40,788.788 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 644, in get_config
2019-11-15 09:27:40,788.788 INFO:__main__:    return self.json_asok(['config', 'get', key], service_type, service_id)[key]
2019-11-15 09:27:40,788.788 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 178, in json_asok
2019-11-15 09:27:40,788.788 INFO:__main__:    proc = self.mon_manager.admin_socket(service_type, service_id, command, timeout=timeout)
2019-11-15 09:27:40,788.788 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 618, in admin_socket
2019-11-15 09:27:40,789.789 INFO:__main__:    timeout=timeout
2019-11-15 09:27:40,789.789 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 301, in run
2019-11-15 09:27:40,789.789 INFO:__main__:    proc.wait()
2019-11-15 09:27:40,789.789 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 179, in wait
2019-11-15 09:27:40,789.789 INFO:__main__:    raise CommandFailedError(self.args, self.exitstatus)
2019-11-15 09:27:40,789.789 INFO:__main__:CommandFailedError: Command failed with status 22: ['./bin/ceph', 'daemon', 'mon.a', 'config', 'get', 'mon_pg_warn_min_per_osd']
2019-11-15 09:27:40,790.790 INFO:__main__:
2019-11-15 09:27:40,790.790 INFO:__main__:----------------------------------------------------------------------
2019-11-15 09:27:40,790.790 INFO:__main__:Ran 12 tests in 210.298s
2019-11-15 09:27:40,790.790 INFO:__main__:
2019-11-15 09:27:40,790.790 INFO:__main__:FAILED (errors=1)
2019-11-15 09:27:40,791.791 INFO:__main__:
2019-11-15 09:27:40,791.791 INFO:__main__:======================================================================
2019-11-15 09:27:40,791.791 INFO:__main__:ERROR: setUpClass (tasks.mgr.dashboard.test_cephfs.CephfsTest)
2019-11-15 09:27:40,791.791 INFO:__main__:----------------------------------------------------------------------
2019-11-15 09:27:40,791.791 INFO:__main__:Traceback (most recent call last):
2019-11-15 09:27:40,792.792 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/mgr/dashboard/helper.py", line 127, in setUpClass
2019-11-15 09:27:40,792.792 INFO:__main__:    cls.fs = cls.mds_cluster.newfs(create=True)
2019-11-15 09:27:40,792.792 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 705, in newfs
2019-11-15 09:27:40,792.792 INFO:__main__:    return LocalFilesystem(self._ctx, name=name, create=create)
2019-11-15 09:27:40,792.792 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 755, in __init__
2019-11-15 09:27:40,792.792 INFO:__main__:    self.create()
2019-11-15 09:27:40,793.793 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 516, in create
2019-11-15 09:27:40,793.793 INFO:__main__:    pgs_per_fs_pool = self.get_pgs_per_fs_pool()
2019-11-15 09:27:40,793.793 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 776, in get_pgs_per_fs_pool
2019-11-15 09:27:40,793.793 INFO:__main__:    return 3 * int(self.get_config('mon_pg_warn_min_per_osd'))
2019-11-15 09:27:40,793.793 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 644, in get_config
2019-11-15 09:27:40,793.793 INFO:__main__:    return self.json_asok(['config', 'get', key], service_type, service_id)[key]
2019-11-15 09:27:40,794.794 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa/tasks/cephfs/filesystem.py", line 178, in json_asok
2019-11-15 09:27:40,794.794 INFO:__main__:    proc = self.mon_manager.admin_socket(service_type, service_id, command, timeout=timeout)
2019-11-15 09:27:40,794.794 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 618, in admin_socket
2019-11-15 09:27:40,794.794 INFO:__main__:    timeout=timeout
2019-11-15 09:27:40,794.794 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 301, in run
2019-11-15 09:27:40,794.794 INFO:__main__:    proc.wait()
2019-11-15 09:27:40,795.795 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 179, in wait
2019-11-15 09:27:40,795.795 INFO:__main__:    raise CommandFailedError(self.args, self.exitstatus)
2019-11-15 09:27:40,795.795 INFO:__main__:CommandFailedError: Command failed with status 22: ['./bin/ceph', 'daemon', 'mon.a', 'config', 'get', 'mon_pg_warn_min_per_osd']
2019-11-15 09:27:40,795.795 INFO:__main__:
Using guessed paths /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/lib/ ['/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa', '/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/lib/cython_modules/lib.2', '/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/src/pybind']

Displaying last 60000 lines of: /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/src/pybind/mgr/dashboard/../../../../build/out/mgr.x.log

source: https://jenkins.ceph.com/job/ceph-dashboard-pr-backend/470/