Project

General

Profile

Actions

Bug #46877

open

mon_clock_skew_check: expected MON_CLOCK_SKEW but got none

Added by Brad Hubbard over 3 years ago. Updated 3 months ago.

Status:
New
Priority:
Low
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
reef,quincy,pacific
Backport:
Regression:
No
Severity:
4 - irritation
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://sentry.ceph.com/sepia/teuthology/issues/2921/ only seen rarely so setting sev/prio accordingly

/a/yuriw-2020-08-06_00:31:28-rados-wip-yuri8-testing-octopus-distro-basic-smithi/5291067

2020-08-06T11:01:24.064 INFO:tasks.mon_clock_skew_check.ceph_manager:quorum is size 21
2020-08-06T11:01:24.064 INFO:tasks.mon_clock_skew_check:sleeping for 30.0 seconds
2020-08-06T11:01:54.066 INFO:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json
2020-08-06T11:01:54.402 INFO:teuthology.orchestra.run.smithi123.stdout:
2020-08-06T11:01:54.413 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]}
2020-08-06T11:01:54.414 INFO:tasks.mon_clock_skew_check.ceph_manager:health:

{"status":"HEALTH_OK","checks":{},"mutes":[]}
2020-08-06T11:01:54.414 INFO:tasks.mon_clock_skew_check:got health {'status': 'HEALTH_OK', 'checks': {}, 'mutes': []}
2020-08-06T11:01:54.414 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 90, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 69, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri8-testing-octopus/qa/tasks/mon_clock_skew_check.py", line 69, in task
    raise RuntimeError('expected MON_CLOCK_SKEW but got none')
RuntimeError: expected MON_CLOCK_SKEW but got none
2020-08-06T11:01:54.446 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=eca6b8178ae840afb988d98d6c2e3c00
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 90, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 69, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri8-testing-octopus/qa/tasks/mon_clock_skew_check.py", line 69, in task
    raise RuntimeError('expected MON_CLOCK_SKEW but got none')
RuntimeError: expected MON_CLOCK_SKEW but got none
Actions #1

Updated by Deepika Upadhyay over 3 years ago

this time job got dead after this warning:

/a/yuriw-2020-08-20_19:48:15-rados-wip-yuri-testing-2020-08-17-1723-octopus-distro-basic-smithi/5362974/teuthology.log

removed other update as seems like it was unrelated.

Actions #2

Updated by Neha Ojha over 3 years ago

Deepika Upadhyay wrote:

this time job got dead after this warning:

/a/yuriw-2020-08-20_19:48:15-rados-wip-yuri-testing-2020-08-17-1723-octopus-distro-basic-smithi/5362974/teuthology.log

[...]

This test passed and is not related.

Actions #3

Updated by Laura Flores almost 2 years ago

Spotted in Quincy:

/a/yuriw-2022-06-02_20:24:42-rados-wip-yuri5-testing-2022-06-02-0825-quincy-distro-default-smithi/6860864

2022-06-02T22:13:01.630 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]}
2022-06-02T22:13:01.652 INFO:tasks.mon_clock_skew_check.ceph_manager:health:

{"status":"HEALTH_OK","checks":{},"mutes":[]}

2022-06-02T22:13:01.653 INFO:tasks.mon_clock_skew_check:got health {'status': 'HEALTH_OK', 'checks': {}, 'mutes': []}
2022-06-02T22:13:01.653 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_53fc7fef6ccaf21fabe4a23a38668920f3ae41b8/teuthology/run_tasks.py", line 103, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_53fc7fef6ccaf21fabe4a23a38668920f3ae41b8/teuthology/run_tasks.py", line 82, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_bb02d3546aae11b750263d70e142fc119c01d7e1/qa/tasks/mon_clock_skew_check.py", line 69, in task
    raise RuntimeError('expected MON_CLOCK_SKEW but got none')
RuntimeError: expected MON_CLOCK_SKEW but got none
2022-06-02T22:13:02.005 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b815811cd152404083a7216f7036d6d6
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_53fc7fef6ccaf21fabe4a23a38668920f3ae41b8/teuthology/run_tasks.py", line 103, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_53fc7fef6ccaf21fabe4a23a38668920f3ae41b8/teuthology/run_tasks.py", line 82, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_bb02d3546aae11b750263d70e142fc119c01d7e1/qa/tasks/mon_clock_skew_check.py", line 69, in task
    raise RuntimeError('expected MON_CLOCK_SKEW but got none')
RuntimeError: expected MON_CLOCK_SKEW but got none

Actions #4

Updated by Laura Flores almost 2 years ago

  • Tags set to quincy,pacific,octopus
Actions #5

Updated by Laura Flores 11 months ago

  • Translation missing: en.field_tag_list set to test-failure

/a/yuriw-2023-05-18_14:38:49-rados-wip-yuri-testing-2023-05-10-0917-distro-default-smithi/7277648

Actions #6

Updated by Laura Flores 11 months ago

  • Subject changed from mon_clock_skew_check: expected MON_CLOCK_SKEW but got none : Seen on octopus to mon_clock_skew_check: expected MON_CLOCK_SKEW but got none
Actions #7

Updated by Laura Flores 10 months ago

  • Tags changed from quincy,pacific,octopus to reef,quincy,pacific

/a/yuriw-2023-06-13_18:33:48-rados-wip-yuri10-testing-2023-06-02-1406-distro-default-smithi/7303014

Actions #8

Updated by Laura Flores 6 months ago

/a/yuriw-2023-10-31_14:43:48-rados-wip-yuri4-testing-2023-10-30-1117-distro-default-smithi/7442288

Actions #9

Updated by Laura Flores 3 months ago

/a/lflores-2024-01-10_23:43:40-rados-wip-yuri11-testing-2024-01-10-1124-pacific-distro-default-smithi/7513289

Actions

Also available in: Atom PDF