Project

General

Profile

Actions

Bug #11309

closed

load_pgs very slow when use filestore_min_sync_interval = 60 in btrfs

Added by eyun xu about 9 years ago. Updated almost 9 years ago.

Status:
Rejected
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
1 - critical
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

hi, one some node of my ceph 0.80.7 cluster is using btrfs , others use xfs. and we used following config
filestore_min_sync_interval = 60

here is the issue:
when i restart the osd with btrfs, they all start up(get in+up state) very slowly, once i used debug log,
i found that it is blocked by load_pgs, and in this function, it logs: sync_entry waiting for another 59.999083 to reach min interval 60.000000

seems it waste lots of time for wait sync procedure. when i delete filestore_min_sync_interval config, then osd start very fast.

but when i try to restart the osd with xfs fs, this issue is not exists, and the load_pgs runs very fast? no sync_entry waiting happens?

attch the osd logs?

2015-04-02 09:10:16.780791 7f2e80b52700 10 filestore(/var/lib/ceph/osd/ceph-4) _finish_op 0x2a1bca0 seq 5057087 osr(default 0x2aa0b98)/0x2aa0b98
2015-04-02 09:10:16.780831 7f2e8c2857a0 10 filestore(/var/lib/ceph/osd/ceph-4) sync_and_flush
2015-04-02 09:10:16.780854 7f2e8c2857a0 10 2015-04-02 09:10:16.780854 7f2e8c2857a0 10 filestore(/var/lib/ceph/osd/ceph-4) _flush_op_queue draining op tp
2015-04-02 09:10:16.780857 7f2e8c2857a0 10 2015-04-02 09:10:16.780857 7f2e8c2857a0 10 filestore(/var/lib/ceph/osd/ceph-4) _flush_op_queue waiting for apply finisher

2015-04-02 09:10:16.780867 7f2e8c2857a0 10 filestore(/var/lib/ceph/osd/ceph-4) start_sync filestore(/var/lib/ceph/osd/ceph-4) start_sync
2015-04-02 09:10:16.780870 7f2e8c2857a0 10 filestore(/var/lib/ceph/osd/ceph-4) sync waiting filestore(/var/lib/ceph/osd/ceph-4) sync waiting
2015-04-02 09:10:16.780873 7f2e83b58700 20 filestore(/var/lib/ceph/osd/ceph-4) sync_entry woke after 0.000917filestore(/var/lib/ceph/osd/ceph-4) sync_entry woke after 0.000917
2015-04-02 09:10:16.780885 7f2e83b58700 20 filestore(/var/lib/ceph/osd/ceph-4) sync_entry waiting for another 59.999083 to reach min interval 60.000000filestore(/var/lib/ceph/osd/ceph-4) sync_entry waiting for another 59.999083 to reach min interval 60.000000

Actions #1

Updated by Samuel Just almost 9 years ago

  • Status changed from New to Rejected
  • Regression set to No

This seems like what the config is supposed to do?

Actions

Also available in: Atom PDF