Bug #64383
closedUnable to access magna002 mount point using UI (Web browser)
Added by Mohit Bisht 3 months ago. Updated 3 months ago.
0%
Description
We are unable to access magna002 mount point using browser
Example: http://magna002.ceph.redhat.com/cephci-jenkins/latest-rhceph-container-info/
Files
| Screenshot from 2024-02-12 09-57-05.png (31.1 KB) Screenshot from 2024-02-12 09-57-05.png | Mohit Bisht, 02/12/2024 04:29 AM | ||
| Screenshot from 2024-02-16 14-40-13.png (31.8 KB) Screenshot from 2024-02-16 14-40-13.png | Mohit Bisht, 02/16/2024 09:10 AM |
Updated by Tintu Mathew 3 months ago
teuthology reimages are also failing
Initiating reimage of nodes
+ /home/jenkins-build/.tthlg/bin/teuthology-reimage --os-type rhel --os-version 9.3 mero001 mero003 mero004 mero005 mero007 mero009 mero011 mero013 mero014 mero015 mero016 mero017 mero018 mero019 mero020
/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
from cryptography.hazmat.backends import default_backend
2024-02-13 06:44:12,751.751 INFO:teuthology.lock.ops:Updating [mero001]: reset os type and version on server
2024-02-13 06:44:12,752.752 INFO:teuthology.lock.ops:Updating mero001.ceph.redhat.com on lock server
2024-02-13 06:44:12,754.754 INFO:teuthology.lock.ops:Updating [mero003]: reset os type and version on server
2024-02-13 06:44:12,754.754 INFO:teuthology.lock.ops:Updating mero003.ceph.redhat.com on lock server
2024-02-13 06:44:12,756.756 INFO:teuthology.lock.ops:Updating [mero004]: reset os type and version on server
2024-02-13 06:44:12,756.756 INFO:teuthology.lock.ops:Updating mero004.ceph.redhat.com on lock server
2024-02-13 06:44:12,758.758 INFO:teuthology.lock.ops:Updating [mero005]: reset os type and version on server
2024-02-13 06:44:12,758.758 INFO:teuthology.lock.ops:Updating mero005.ceph.redhat.com on lock server
2024-02-13 06:44:12,760.760 INFO:teuthology.lock.ops:Updating [mero007]: reset os type and version on server
2024-02-13 06:44:12,761.761 INFO:teuthology.lock.ops:Updating mero007.ceph.redhat.com on lock server
2024-02-13 06:44:12,762.762 INFO:teuthology.lock.ops:Updating [mero009]: reset os type and version on server
2024-02-13 06:44:12,763.763 INFO:teuthology.lock.ops:Updating mero009.ceph.redhat.com on lock server
2024-02-13 06:44:12,765.765 INFO:teuthology.lock.ops:Updating [mero011]: reset os type and version on server
2024-02-13 06:44:12,765.765 INFO:teuthology.lock.ops:Updating mero011.ceph.redhat.com on lock server
2024-02-13 06:44:12,767.767 INFO:teuthology.lock.ops:Updating [mero013]: reset os type and version on server
2024-02-13 06:44:12,767.767 INFO:teuthology.lock.ops:Updating mero013.ceph.redhat.com on lock server
2024-02-13 06:44:12,769.769 INFO:teuthology.lock.ops:Updating [mero014]: reset os type and version on server
2024-02-13 06:44:12,769.769 INFO:teuthology.lock.ops:Updating mero014.ceph.redhat.com on lock server
2024-02-13 06:44:12,771.771 INFO:teuthology.lock.ops:Updating [mero015]: reset os type and version on server
2024-02-13 06:44:12,771.771 INFO:teuthology.lock.ops:Updating mero015.ceph.redhat.com on lock server
2024-02-13 06:44:12,774.774 INFO:teuthology.lock.ops:Updating [mero016]: reset os type and version on server
2024-02-13 06:44:12,774.774 INFO:teuthology.lock.ops:Updating mero016.ceph.redhat.com on lock server
2024-02-13 06:44:12,776.776 INFO:teuthology.lock.ops:Updating [mero017]: reset os type and version on server
2024-02-13 06:44:12,777.777 INFO:teuthology.lock.ops:Updating mero017.ceph.redhat.com on lock server
2024-02-13 06:44:12,779.779 INFO:teuthology.lock.ops:Updating [mero018]: reset os type and version on server
2024-02-13 06:44:12,779.779 INFO:teuthology.lock.ops:Updating mero018.ceph.redhat.com on lock server
2024-02-13 06:44:12,781.781 INFO:teuthology.lock.ops:Updating [mero019]: reset os type and version on server
2024-02-13 06:44:12,781.781 INFO:teuthology.lock.ops:Updating mero019.ceph.redhat.com on lock server
2024-02-13 06:44:12,783.783 INFO:teuthology.lock.ops:Updating [mero020]: reset os type and version on server
2024-02-13 06:44:12,783.783 INFO:teuthology.lock.ops:Updating mero020.ceph.redhat.com on lock server
2024-02-13 06:44:12,881.881 ERROR:teuthology.provision.fog.mero001:404: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL was not found on this server.</p>
<hr>
<address>Apache/2.4.52 (Ubuntu) Server at 10.8.128.2 Port 80</address>
</body></html>
Traceback (most recent call last):
File "/home/jenkins-build/.tthlg/bin/teuthology-reimage", line 8, in <module>
sys.exit(main())
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/scripts/reimage.py", line 25, in main
return teuthology.reimage.main(args)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/reimage.py", line 57, in main
p.spawn(reimage_node, ctx, shortname(node['name']), node['machine_type'])
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 84, in exit
for result in self:
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 98, in next
resurrect_traceback(result)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info1
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/reimage.py", line 50, in reimage_node
reimage(ctx, machine_name, machine_type)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/__init__.py", line 39, in reimage
return obj.create()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 76, in create
host_data = self.get_host_data()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 134, in get_host_data
data=json.dumps(dict(name=self.shortname)),
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 123, in do_request
resp.raise_for_status()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/requests/models.py", line 960, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://10.8.128.2/fog/host
Updated by Boris Ranto 3 months ago
This should be fixed now. Apache was failing to serve multiple directory listings so here is what I did:
- I updated the configuration to serve /var/www/root
- in there, I symlinked ocsci-jenkins and cephci-jenkins directories there
This way, I'm simulating multiple directory listings through the symlinks.
Updated by Tintu Mathew 3 months ago
We are still facing issues with teuthology reimage
Initiating reimage of nodes
+ /home/jenkins-build/.tthlg/bin/teuthology-reimage --os-type rhel --os-version 9.3 mero001 mero003 mero004 mero005 mero007 mero009 mero011 mero013 mero014 mero015 mero016 mero017 mero018 mero019 mero020
/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
from cryptography.hazmat.backends import default_backend
2024-02-14 05:56:28,805.805 INFO:teuthology.lock.ops:Updating [mero001]: reset os type and version on server
2024-02-14 05:56:28,805.805 INFO:teuthology.lock.ops:Updating mero001.ceph.redhat.com on lock server
2024-02-14 05:56:28,807.807 INFO:teuthology.lock.ops:Updating [mero003]: reset os type and version on server
2024-02-14 05:56:28,807.807 INFO:teuthology.lock.ops:Updating mero003.ceph.redhat.com on lock server
2024-02-14 05:56:28,809.809 INFO:teuthology.lock.ops:Updating [mero004]: reset os type and version on server
2024-02-14 05:56:28,810.810 INFO:teuthology.lock.ops:Updating mero004.ceph.redhat.com on lock server
2024-02-14 05:56:28,812.812 INFO:teuthology.lock.ops:Updating [mero005]: reset os type and version on server
2024-02-14 05:56:28,812.812 INFO:teuthology.lock.ops:Updating mero005.ceph.redhat.com on lock server
2024-02-14 05:56:28,814.814 INFO:teuthology.lock.ops:Updating [mero007]: reset os type and version on server
2024-02-14 05:56:28,814.814 INFO:teuthology.lock.ops:Updating mero007.ceph.redhat.com on lock server
2024-02-14 05:56:28,816.816 INFO:teuthology.lock.ops:Updating [mero009]: reset os type and version on server
2024-02-14 05:56:28,816.816 INFO:teuthology.lock.ops:Updating mero009.ceph.redhat.com on lock server
2024-02-14 05:56:28,818.818 INFO:teuthology.lock.ops:Updating [mero011]: reset os type and version on server
2024-02-14 05:56:28,818.818 INFO:teuthology.lock.ops:Updating mero011.ceph.redhat.com on lock server
2024-02-14 05:56:28,820.820 INFO:teuthology.lock.ops:Updating [mero013]: reset os type and version on server
2024-02-14 05:56:28,820.820 INFO:teuthology.lock.ops:Updating mero013.ceph.redhat.com on lock server
2024-02-14 05:56:28,822.822 INFO:teuthology.lock.ops:Updating [mero014]: reset os type and version on server
2024-02-14 05:56:28,822.822 INFO:teuthology.lock.ops:Updating mero014.ceph.redhat.com on lock server
2024-02-14 05:56:28,824.824 INFO:teuthology.lock.ops:Updating [mero015]: reset os type and version on server
2024-02-14 05:56:28,824.824 INFO:teuthology.lock.ops:Updating mero015.ceph.redhat.com on lock server
2024-02-14 05:56:28,827.827 INFO:teuthology.lock.ops:Updating [mero016]: reset os type and version on server
2024-02-14 05:56:28,827.827 INFO:teuthology.lock.ops:Updating mero016.ceph.redhat.com on lock server
2024-02-14 05:56:28,830.830 INFO:teuthology.lock.ops:Updating [mero017]: reset os type and version on server
2024-02-14 05:56:28,830.830 INFO:teuthology.lock.ops:Updating mero017.ceph.redhat.com on lock server
2024-02-14 05:56:28,832.832 INFO:teuthology.lock.ops:Updating [mero018]: reset os type and version on server
2024-02-14 05:56:28,832.832 INFO:teuthology.lock.ops:Updating mero018.ceph.redhat.com on lock server
2024-02-14 05:56:28,834.834 INFO:teuthology.lock.ops:Updating [mero019]: reset os type and version on server
2024-02-14 05:56:28,834.834 INFO:teuthology.lock.ops:Updating mero019.ceph.redhat.com on lock server
2024-02-14 05:56:28,836.836 INFO:teuthology.lock.ops:Updating [mero020]: reset os type and version on server
2024-02-14 05:56:28,836.836 INFO:teuthology.lock.ops:Updating mero020.ceph.redhat.com on lock server
2024-02-14 05:56:28,914.914 ERROR:teuthology.provision.fog.mero001:404: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL was not found on this server.</p>
<hr>
<address>Apache/2.4.52 (Ubuntu) Server at 10.8.128.2 Port 80</address>
</body></html>
Traceback (most recent call last):
File "/home/jenkins-build/.tthlg/bin/teuthology-reimage", line 8, in <module>
sys.exit(main())
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/scripts/reimage.py", line 25, in main
return teuthology.reimage.main(args)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/reimage.py", line 57, in main
p.spawn(reimage_node, ctx, shortname(node['name']), node['machine_type'])
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 84, in exit
for result in self:
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 98, in next
resurrect_traceback(result)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info1
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/reimage.py", line 50, in reimage_node
reimage(ctx, machine_name, machine_type)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/__init__.py", line 39, in reimage
return obj.create()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 76, in create
host_data = self.get_host_data()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 134, in get_host_data
data=json.dumps(dict(name=self.shortname)),
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 123, in do_request
resp.raise_for_status()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/requests/models.py", line 960, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://10.8.128.2/fog/host
Updated by Tintu Mathew 3 months ago
we are observing new failure while reimaging using teuthology
+ echo 'Initiating reimage of nodes'
Initiating reimage of nodes
+ /home/jenkins-build/.tthlg/bin/teuthology-reimage --os-type rhel --os-version 9.3 mero001 mero003 mero004 mero005 mero007 mero009 mero011 mero013 mero014 mero015 mero016 mero017 mero018 mero019 mero020
/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
from cryptography.hazmat.backends import default_backend
2024-02-14 06:46:17,236.236 INFO:teuthology.lock.ops:Updating [mero001]: reset os type and version on server
2024-02-14 06:46:17,237.237 INFO:teuthology.lock.ops:Updating mero001.ceph.redhat.com on lock server
2024-02-14 06:46:17,239.239 INFO:teuthology.lock.ops:Updating [mero003]: reset os type and version on server
2024-02-14 06:46:17,239.239 INFO:teuthology.lock.ops:Updating mero003.ceph.redhat.com on lock server
2024-02-14 06:46:17,241.241 INFO:teuthology.lock.ops:Updating [mero004]: reset os type and version on server
2024-02-14 06:46:17,241.241 INFO:teuthology.lock.ops:Updating mero004.ceph.redhat.com on lock server
2024-02-14 06:46:17,243.243 INFO:teuthology.lock.ops:Updating [mero005]: reset os type and version on server
2024-02-14 06:46:17,243.243 INFO:teuthology.lock.ops:Updating mero005.ceph.redhat.com on lock server
2024-02-14 06:46:17,245.245 INFO:teuthology.lock.ops:Updating [mero007]: reset os type and version on server
2024-02-14 06:46:17,245.245 INFO:teuthology.lock.ops:Updating mero007.ceph.redhat.com on lock server
2024-02-14 06:46:17,247.247 INFO:teuthology.lock.ops:Updating [mero009]: reset os type and version on server
2024-02-14 06:46:17,248.248 INFO:teuthology.lock.ops:Updating mero009.ceph.redhat.com on lock server
2024-02-14 06:46:17,249.249 INFO:teuthology.lock.ops:Updating [mero011]: reset os type and version on server
2024-02-14 06:46:17,250.250 INFO:teuthology.lock.ops:Updating mero011.ceph.redhat.com on lock server
2024-02-14 06:46:17,252.252 INFO:teuthology.lock.ops:Updating [mero013]: reset os type and version on server
2024-02-14 06:46:17,252.252 INFO:teuthology.lock.ops:Updating mero013.ceph.redhat.com on lock server
2024-02-14 06:46:17,254.254 INFO:teuthology.lock.ops:Updating [mero014]: reset os type and version on server
2024-02-14 06:46:17,254.254 INFO:teuthology.lock.ops:Updating mero014.ceph.redhat.com on lock server
2024-02-14 06:46:17,255.255 INFO:teuthology.lock.ops:Updating [mero015]: reset os type and version on server
2024-02-14 06:46:17,256.256 INFO:teuthology.lock.ops:Updating mero015.ceph.redhat.com on lock server
2024-02-14 06:46:17,258.258 INFO:teuthology.lock.ops:Updating [mero016]: reset os type and version on server
2024-02-14 06:46:17,259.259 INFO:teuthology.lock.ops:Updating mero016.ceph.redhat.com on lock server
2024-02-14 06:46:17,260.260 INFO:teuthology.lock.ops:Updating [mero017]: reset os type and version on server
2024-02-14 06:46:17,261.261 INFO:teuthology.lock.ops:Updating mero017.ceph.redhat.com on lock server
2024-02-14 06:46:17,262.262 INFO:teuthology.lock.ops:Updating [mero018]: reset os type and version on server
2024-02-14 06:46:17,263.263 INFO:teuthology.lock.ops:Updating mero018.ceph.redhat.com on lock server
2024-02-14 06:46:17,265.265 INFO:teuthology.lock.ops:Updating [mero019]: reset os type and version on server
2024-02-14 06:46:17,265.265 INFO:teuthology.lock.ops:Updating mero019.ceph.redhat.com on lock server
2024-02-14 06:46:17,267.267 INFO:teuthology.lock.ops:Updating [mero020]: reset os type and version on server
2024-02-14 06:46:17,267.267 INFO:teuthology.lock.ops:Updating mero020.ceph.redhat.com on lock server
Traceback (most recent call last):
File "/home/jenkins-build/.tthlg/bin/teuthology-reimage", line 8, in <module>
sys.exit(main())
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/scripts/reimage.py", line 25, in main
return teuthology.reimage.main(args)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/reimage.py", line 57, in main
p.spawn(reimage_node, ctx, shortname(node['name']), node['machine_type'])
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 84, in exit
for result in self:
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 98, in next
resurrect_traceback(result)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info1
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/reimage.py", line 50, in reimage_node
reimage(ctx, machine_name, machine_type)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/__init__.py", line 39, in reimage
return obj.create()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 76, in create
host_data = self.get_host_data()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/teuthology/provision/fog.py", line 136, in get_host_data
obj = resp.json()
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/requests/models.py", line 900, in json
self.content.decode(encoding), **kwargs
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/simplejson/__init__.py", line 525, in loads
return _default_decoder.decode(s)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/simplejson/decoder.py", line 370, in decode
obj, end = self.raw_decode(s)
File "/home/jenkins-build/.tthlg/lib64/python3.6/site-packages/simplejson/decoder.py", line 400, in raw_decode
return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Updated by Mohit Bisht 3 months ago
Hi,
QE team facing issue again.
Issue: Unable to access magna002 mount point using UI (Web browser)
Thanks,
Mohit Bisht
Updated by adam kraitman 3 months ago
Hey Mohit, all mount points should be accessible now
Updated by adam kraitman 3 months ago
- Status changed from New to Resolved
Changed Apache sites-enabled config to have one vhost for requests to /ceph - "magna002.ceph.redhat.com" and one vhost for fog requests on "10.8.128.2"