Project

General

Profile

Actions

Bug #36598

closed

osd: "bluestore(/var/lib/ceph/osd/ceph-6) ENOENT on clone suggests osd bug"

Added by Patrick Donnelly over 5 years ago. Updated about 5 years ago.

Status:
Can't reproduce
Priority:
Urgent
Assignee:
Category:
EC Pools
Target version:
% Done:

0%

Source:
Q/A
Tags:
Backport:
mimic,luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
kcephfs
Component(RADOS):
BlueStore, EC plugins
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2018-10-25T03:34:24.015 INFO:tasks.ceph.osd.6.smithi099.stderr:2018-10-25 03:34:24.000 7f95478ac700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _txc_add_transaction error (2) No such file or directory not handled on operation 30 (op 0, counting from 0)
2018-10-25T03:34:24.015 INFO:tasks.ceph.osd.6.smithi099.stderr:2018-10-25 03:34:24.000 7f95478ac700 -1 bluestore(/var/lib/ceph/osd/ceph-6) ENOENT on clone suggests osd bug
2018-10-25T03:34:24.030 INFO:tasks.ceph.osd.5.smithi099.stderr:2018-10-25 03:34:24.004 7fc58c112700 -1 received  signal: Hangup from /usr/bin/python /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5  (PID: 34238) UID: 0
2018-10-25T03:34:24.030 INFO:tasks.ceph.osd.6.smithi099.stderr:unexpected error ceph version 14.0.0-4530-g534b644 (534b644a84ac84c34f2f4f8ebebb7eba4d116ba4) nautilus (dev)
2018-10-25T03:34:24.030 INFO:tasks.ceph.osd.6.smithi099.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0x82) [0x5639441d5b64]
2018-10-25T03:34:24.030 INFO:tasks.ceph.osd.6.smithi099.stderr: 2: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0xbed) [0x563944798cbd]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 3: (BlueStore::queue_transactions(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x54c) [0x56394479e06c]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 4: (ObjectStore::queue_transaction(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, ObjectStore::Transaction&&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x82) [0x563944372f02]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 5: (OSD::dispatch_context_transaction(PG::RecoveryCtx&, PG*, ThreadPool::TPHandle*)+0x58) [0x5639442cc148]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 6: (OSD::dequeue_peering_evt(OSDShard*, PG*, std::shared_ptr<PGPeeringEvent>, ThreadPool::TPHandle&)+0x1f2) [0x563944322d22]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 7: (PGPeeringItem::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)+0x50) [0x56394458b100]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 8: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xaec) [0x5639443179ac]
2018-10-25T03:34:24.031 INFO:tasks.ceph.osd.6.smithi099.stderr: 9: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x3e6) [0x563944936fa6]
2018-10-25T03:34:24.032 INFO:tasks.ceph.osd.6.smithi099.stderr: 10: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x563944941480]
2018-10-25T03:34:24.032 INFO:tasks.ceph.osd.6.smithi099.stderr: 11: (()+0x7dd5) [0x7f9567e7fdd5]
2018-10-25T03:34:24.032 INFO:tasks.ceph.osd.6.smithi099.stderr: 12: (clone()+0x6d) [0x7f9566d48b3d]

From: /ceph/teuthology-archive/pdonnell-2018-10-24_23:44:07-kcephfs-wip-pdonnell-testing-20181024.213729-distro-basic-smithi/3180863/teuthology.log

Cores and logs are available.


Related issues 2 (0 open2 closed)

Related to bluestore - Bug #36108: Assertion due to ENOENT result on clonerange2Duplicate09/21/2018

Actions
Related to RADOS - Bug #36739: ENOENT in collection_move_rename on EC backfill targetResolvedNeha Ojha11/08/2018

Actions
Actions #1

Updated by Neha Ojha over 5 years ago

  • Related to Bug #36108: Assertion due to ENOENT result on clonerange2 added
Actions #2

Updated by Greg Farnum over 5 years ago

Sage thinks this might also be #36739.

Actions #3

Updated by Sage Weil over 5 years ago

  • Related to Bug #36739: ENOENT in collection_move_rename on EC backfill target added
Actions #4

Updated by Neha Ojha about 5 years ago

  • Assignee set to Neha Ojha
Actions #5

Updated by Neha Ojha about 5 years ago

  • Status changed from New to Can't reproduce

This has not shown up recently, so maybe this got resolved as a result of http://tracker.ceph.com/issues/36739 being solved. Marking "Can't reproduce" for now.

Actions

Also available in: Atom PDF