Project

General

Profile

Actions

Bug #20169

open

filestore+btrfs occasionally returns ENOSPC

Added by Sage Weil almost 7 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
FileStore
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2017-06-02T12:14:43.073 INFO:teuthology.orchestra.run.smithi130.stderr:2017-06-02 12:14:43.072152 7fa83089f700  0 -- 172.21.15.130:0/4243660710 >> 172.21.15.130:6802/4426 conn(0x7fa814020110 :-1 s=STATE_OPEN pgs=76 cs=1 l=1)._try_send injecting socket failure
2017-06-02T12:14:43.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2017-06-02 12:14:43.417084 7fdd782ef700 -1 filestore(/var/lib/ceph/osd/ceph-0) error creating #0:57e7a330:::benchmark_data_smithi130_24108_object14400:head# (/var/lib/ceph/osd/ceph-0/current/0.2a_head/benchmark\udata\usmithi130\u24108\uobject14400__head
_0CC5E7EA__0) in index: (28) No space left on device
2017-06-02T12:14:43.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2017-06-02 12:14:43.417099 7fdd782ef700 -1 filestore(/var/lib/ceph/osd/ceph-0)  error (28) No space left on device not handled on operation 0x7fdd93808d84 (60051.1.0, or op 0, counting from 0)
2017-06-02T12:14:43.440 INFO:teuthology.orchestra.run.smithi130.stdout:    5      16     14489     14473   11.3059   10.8945   0.0051336  0.00552149
2017-06-02T12:14:43.596 INFO:tasks.ceph.osd.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.0.2-1995-g6bf7363/rpm/el7/BUILD/ceph-12.0.2-1995-g6bf7363/src/os/filestore/FileStore.cc: In functio
n 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, ThreadPool::TPHandle*)' thread 7fdd782ef700 time 2017-06-02 12:14:43.594878
2017-06-02T12:14:43.597 INFO:tasks.ceph.osd.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.0.2-1995-g6bf7363/rpm/el7/BUILD/ceph-12.0.2-1995-g6bf7363/src/os/filestore/FileStore.cc: 3097: FAIL
ED assert(0 == "unexpected error")
2017-06-02T12:14:43.618 INFO:tasks.ceph.osd.0.smithi130.stderr: ceph version  12.0.2-1995-g6bf7363 (6bf7363b3bddac5202fd115ab323602a20c32ff7) luminous (dev)
2017-06-02T12:14:43.618 INFO:tasks.ceph.osd.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7fdd857421d0]
2017-06-02T12:14:43.618 INFO:tasks.ceph.osd.0.smithi130.stderr: 2: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*)+0x801) [0x7fdd85533e41]
2017-06-02T12:14:43.618 INFO:tasks.ceph.osd.0.smithi130.stderr: 3: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*)+0x3b) [0x7fdd8553924b]

this is centos.

probably wontfix, but opening the ticket to document that this is a known failure that happens on smithi.


Related issues 1 (0 open1 closed)

Has duplicate Ceph - Bug #20422: Out of space (btrfs journal write)Duplicate06/26/2017

Actions
Actions

Also available in: Atom PDF