Project

General

Profile

Actions

Bug #45797

closed

Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/management/index.php?node=schema

Added by Kefu Chai almost 4 years ago. Updated almost 4 years ago.

Status:
Can't reproduce
Priority:
Normal
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2020-05-31T20:40:56.561 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 1, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-05-31_16:39:51-rgw-wip-kefu-testing-2020-05-27-2242-distro-basic-smithi/5107284'}
2020-05-31T20:40:56.583 DEBUG:teuthology.lock.ops:locked ubuntu@smithi071.front.sepia.ceph.com
2020-05-31T20:40:56.608 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fef251faa58>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fef23fc5d08>, signals=[15])
2020-05-31T20:40:56.759 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 94, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/lock_machines.py", line 78, in lock_machines
    os_version, arch)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/lock/ops.py", line 145, in lock_many
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 87, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 101, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 37, in resurrect_traceback
    reraise(*exc_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/six.py", line 703, in reraise
    raise value
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 24, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/provision/fog.py", line 76, in create
    host_data = self.get_host_data()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/provision/fog.py", line 134, in get_host_data
    data=json.dumps(dict(name=self.shortname)),
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/provision/fog.py", line 123, in do_request
    resp.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/management/index.php?node=schema
2020-05-31T20:40:56.780 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=f09127f4f7fa4bbfbcb379c81f4b0334

http://pulpito.ceph.com/kchai-2020-05-31_16:39:51-rgw-wip-kefu-testing-2020-05-27-2242-distro-basic-smithi/

Actions #1

Updated by Kefu Chai almost 4 years ago

++ curl -f -s -k -H 'fog-api-token: ****' -H 'fog-user-token: ****' http://fog.front.sepia.ceph.com/fog/task/active -d '{"typeID": "2"}' -X GET
++ jq -r .count
+ capturetasks=4
+ (( ++currentretries ))
+ funRetry 32 180
+ '[' 32 -gt 180 ']'
+ '[' 4 -gt 0 ']'
++ date
+ echo 'Sun May 31 13:00:41 UTC 2020 -- 4 FOG capture tasks still queued.  Sleeping 10sec'
Sun May 31 13:00:41 UTC 2020 -- 4 FOG capture tasks still queued.  Sleeping 10sec
...

see https://jenkins.ceph.com/job/sepia-fog-images/480/console
Actions #2

Updated by Kefu Chai almost 4 years ago

  • Status changed from New to Can't reproduce
Actions

Also available in: Atom PDF