Project

General

Profile

Bug #54606

check-counter task runs till max job timeout

Added by Venky Shankar 9 months ago. Updated 8 months ago.

Status:
Triaged
Priority:
Normal
Assignee:
Category:
Testing
Target version:
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
quincy, pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Seen here - http://pulpito.front.sepia.ceph.com/yuriw-2022-03-14_18:57:01-fs-wip-yuri2-testing-2022-03-14-0946-quincy-distro-default-smithi/6736853/

blogbench runs till completion:

2022-03-15T02:59:50.541 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0...
2022-03-15T02:59:50.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2022-03-15T02:59:50.823 DEBUG:teuthology.parallel:result is None
2022-03-15T02:59:50.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0
2022-03-15T02:59:50.879 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0
2022-03-15T02:59:50.880 DEBUG:teuthology.run_tasks:Unwinding manager check-counter
2022-03-15T02:59:50.893 DEBUG:tasks.check_counter:Getting stats from a

However, check-counters task repeatedly fails as:

2022-03-15T02:59:54.185 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 15 02:59:53 smithi149 ceph-mon[33944]: pgmap v631: 97 pgs: 97 active+clean; 631 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 474 op/s
2022-03-15T02:59:54.724 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a
2022-03-15T02:59:54.725 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a
2022-03-15T02:59:54.725 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a
2022-03-15T02:59:54.725 DEBUG:tasks.check_counter:Getting stats from d

Till it hits max job timeout. See: qa/suites/fs/workload/tasks/workunit/suites/blogbench.yaml

History

#2 Updated by Venky Shankar 8 months ago

  • Status changed from New to Triaged
  • Assignee set to Ramana Raja

Also available in: Atom PDF