Project

General

Profile

Actions

Bug #12892

closed

Image'snapshot too much cause the "Deep Scrub" function running too long, eventually led to the Osd down

Added by huanwen ren over 8 years ago. Updated over 8 years ago.

Status:
Rejected
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Our environment has some snapshots of the Image created too much, when carries on the Deep the Scrub will lead to take pg lock time is too long, eventually regularly report the state of the OSD timer timeout, OSD is MON buy for the DOWN state
gdb info

????? ceph??ceph245
gdb) s objects.back()
Cannot evaluate function -- may be inlined
(gdb) p objects.back()
Cannot evaluate function -- may be inlined
(gdb) s objects.back().get_filestore_key()
Cannot evaluate function -- may be inlined
(gdb) p objects
$7 = std::vector of length 25, capacity 50 = {{oid = {name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {
      val = 99376}, hash = 4141438085, max = false, static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99379}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99381}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99382}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99385}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99386}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99388}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99390}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99392}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99395}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99397}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99398}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99401}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99403}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99405}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99407}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99409}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99411}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99413}, hash = 4141438085, max = false, 
---Type <return> to continue, or q <return> to quit---
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99415}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99417}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99419}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99421}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99423}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}, {oid = {
      name = "rb.0.1cdc6d.238e1f29.", '0' <repeats 12 times>}, snap = {val = 99425}, hash = 4141438085, max = false, 
    static POOL_IS_TEMP = -1, pool = 34, nspace = "", key = ""}}
(gdb) n
172       filestore_hobject_key_t get_filestore_key() const {


Files

????1.txt (12.2 KB) ????1.txt huanwen ren, 09/01/2015 08:06 AM
????2.txt (10.4 KB) ????2.txt huanwen ren, 09/01/2015 08:06 AM
chunky_scrub?? (302 KB) chunky_scrub?? huanwen ren, 09/10/2015 03:36 AM
Actions

Also available in: Atom PDF