Project

General

Profile

Bug #56269

crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self)

Added by Telemetry Bot 5 months ago. Updated 3 months ago.

Status:
Pending Backport
Priority:
Normal
Category:
Correctness/Safety
Target version:
% Done:

0%

Source:
Telemetry
Tags:
backport_processed
Backport:
quincy, pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
mgr/snap_schedule
Labels (FS):
Pull request ID:
Crash signature (v1):

c4b2998f8b7c943d31ec76278dbcbc7c6ee85e80d9e96c9697bf8ef51aea4b9f


Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d2aeadfccf541e27a05866ac65652cd2ca04293bb63cf0b7e4c159257dc055aa

Sanitized backtrace:

    File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self)
    File "mgr/snap_schedule/fs/schedule_client.py", in __init__: with self.get_schedule_db(fs_name) as conn_mgr:
    File "mgr/snap_schedule/fs/schedule_client.py", in get_schedule_db: ioctx.remove(SNAP_DB_OBJECT_NAME)

Crash dump sample:
{
    "backtrace": [
        "  File \"/usr/share/ceph/mgr/snap_schedule/module.py\", line 38, in __init__\n    self.client = SnapSchedClient(self)",
        "  File \"/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py\", line 158, in __init__\n    with self.get_schedule_db(fs_name) as conn_mgr:",
        "  File \"/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py\", line 193, in get_schedule_db\n    ioctx.remove(SNAP_DB_OBJECT_NAME)",
        "<redacted>" 
    ],
    "ceph_version": "17.2.0",
    "crash_id": "2022-06-18T07:54:30.682437Z_de471f27-f51b-4655-817e-b9e250ed1545",
    "entity_name": "mgr.51050824261145c3fceafa55b794199c33a50c8a",
    "mgr_module": "snap_schedule",
    "mgr_module_caller": "ActivePyModule::load",
    "mgr_python_exception": "AttributeError",
    "os_id": "centos",
    "os_name": "CentOS Stream",
    "os_version": "8",
    "os_version_id": "8",
    "process_name": "ceph-mgr",
    "stack_sig": "42de5a4630008c83d158771261bdccb745a300861115128d2923df389daba735",
    "timestamp": "2022-06-18T07:54:30.682437Z",
    "utsname_machine": "x86_64",
    "utsname_release": "4.18.0-372.9.1.el8.x86_64",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP Tue May 10 08:57:35 EDT 2022" 
}


Related issues

Related to CephFS - Bug #56270: crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self) New
Copied to CephFS - Backport #56541: quincy: crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self) In Progress
Copied to CephFS - Backport #56542: pacific: crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self) New

History

#1 Updated by Telemetry Bot 5 months ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v17.2.0 added

#2 Updated by Andreas Teuchert 5 months ago

The full backtrace is:

    "backtrace": [
        "  File \"/usr/share/ceph/mgr/snap_schedule/module.py\", line 38, in __init__\n    self.client = SnapSchedClient(self)",
        "  File \"/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py\", line 158, in __init__\n    with self.get_schedule_db(fs_name) as conn_mgr:",
        "  File \"/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py\", line 193, in get_schedule_db\n    ioctx.remove(SNAP_DB_OBJECT_NAME)",
        "AttributeError: 'rados.Ioctx' object has no attribute 'remove'" 
    ],

This seems to cause the snap_schedule mgr module to become unavailable after an upgrade from 16.2.9 to 17.2.1. See also https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/75TAPJGAHXCIC2SJ6V425FG6ZERLBURG/.

#3 Updated by Venky Shankar 5 months ago

  • Project changed from mgr to CephFS
  • Category set to Correctness/Safety
  • Assignee set to Milind Changire
  • Target version set to v18.0.0
  • Backport set to quincy
  • Component(FS) mgr/snap_schedule added

Milind, please take a look.

#4 Updated by Andreas Teuchert 5 months ago

I created a PR that should fix this bug: https://github.com/ceph/ceph/pull/47006.

#5 Updated by Patrick Donnelly 5 months ago

  • Status changed from New to Fix Under Review
  • Assignee deleted (Milind Changire)
  • Pull request ID set to 47006

#6 Updated by Patrick Donnelly 5 months ago

  • Related to Bug #56270: crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self) added

#7 Updated by Venky Shankar 5 months ago

Andreas Teuchert wrote:

I created a PR that should fix this bug: https://github.com/ceph/ceph/pull/47006.

Thanks, Andreas. Changes look fine. I've requested Milind to run it through tests.

#8 Updated by Venky Shankar 5 months ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from quincy to quincy, pacific

#9 Updated by Backport Bot 5 months ago

  • Copied to Backport #56541: quincy: crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self) added

#10 Updated by Backport Bot 5 months ago

  • Copied to Backport #56542: pacific: crash: File "mgr/snap_schedule/module.py", in __init__: self.client = SnapSchedClient(self) added

#11 Updated by Andreas Teuchert 5 months ago

I don't think a backport to pacific makes sense. The relevant code is only in quincy, so pacific is not affected by the issue.

#12 Updated by Backport Bot 4 months ago

  • Tags set to backport_processed

#13 Updated by Venky Shankar 3 months ago

  • Assignee set to Milind Changire

Milind, please take this one.

#14 Updated by Venky Shankar 3 months ago

Venky Shankar wrote:

Milind, please take this one.

Sorry - I meant to update the backport tracker.

Also available in: Atom PDF