Project

General

Profile

Actions

Bug #6756

closed

journal full hang on startup

Added by Samuel Just over 10 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
OSD
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
dumpling
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2013-11-10 22:51:06.073780 7fd833945780 2 journal open /var/lib/ceph/osd/ceph-4/journal fsid ed7f3df7-52a6-4fc7-a6ca-96a53465bc10 fs_op_seq 130604
...
2013-11-10 22:51:06.170911 7fd833945780 2 journal read_entry 27324416 : seq 130604 920 bytes
2013-11-10 22:51:06.170918 7fd833945780 2 journal No further valid entries found, journal is most likely valid
2013-11-10 22:51:06.170920 7fd833945780 10 journal open reached end of journal.
2013-11-10 22:51:06.170924 7fd833945780 2 journal No further valid entries found, journal is most likely valid
2013-11-10 22:51:06.170925 7fd833945780 3 journal journal_replay: end of journal, done.
...
2013-11-10 22:51:06.174836 7fd833945780 10 osd.4 1198 load_pgs
2013-11-10 22:51:06.174838 7fd833945780 10 filestore(/var/lib/ceph/osd/ceph-4) list_collections
2013-11-10 22:51:06.175038 7fd833945780 10 osd.4 1198 load_pgs 3.35_TEMP clearing temp
2013-11-10 22:51:06.175072 7fd833945780 20 prefixes
2013-11-10 22:51:06.175085 7fd833945780 5 filestore(/var/lib/ceph/osd/ceph-4) queue_transactions new osr(default 0x2aa6b50)/0x2aa6b50
2013-11-10 22:51:06.175096 7fd833945780 10 journal op_submit_start 130605
2013-11-10 22:51:06.175097 7fd833945780 5 filestore(/var/lib/ceph/osd/ceph-4) queue_transactions (writeahead) 130605 0x7fff6bcbe3a0
2013-11-10 22:51:06.175099 7fd833945780 10 journal op_journal_transactions 130605 0x7fff6bcbe3a0
2013-11-10 22:51:06.175103 7fd833945780 5 journal submit_entry seq 130605 len 57 (0x2fa7f90)
2013-11-10 22:51:06.175116 7fd833945780 10 journal op_submit_finish 130605
2013-11-10 22:51:06.175125 7fd829c57700 20 journal write_thread_entry woke up
2013-11-10 22:51:06.175135 7fd829c57700 10 journal room 4095 max_size 104857600 pos 27324416 header.start 27328512 top 4096
2013-11-10 22:51:06.175138 7fd829c57700 1 journal check_for_full at 27324416 : JOURNAL FULL 27324416 >= 4095 (max_size 104857600 start 27328512)
2013-11-10 22:51:06.175143 7fd829c57700 20 journal prepare_multi_write full on first entry, need to wait
2013-11-10 22:51:06.175145 7fd829c57700 20 journal write_thread_entry full, going to sleep (waiting for commit)
2013-11-10 22:51:11.073901 7fd82a458700 20 filestore(/var/lib/ceph/osd/ceph-4) sync_entry woke after 5.000119
2013-11-10 22:51:11.073924 7fd82a458700 10 journal commit_start max_applied_seq 130604, open_ops 0
2013-11-10 22:51:11.073926 7fd82a458700 10 journal commit_start blocked, all open_ops have completed
2013-11-10 22:51:11.073927 7fd82a458700 10 journal commit_start nothing to do
2013-11-10 22:51:11.073928 7fd82a458700 10 journal commit_start

Testing fix on wip-queueing2.


Related issues 2 (0 open2 closed)

Related to Ceph - Bug #8204: "timed out waiting for admin_socket to appear after osd.5 restart" in upgrade:dumpling-x:stress-split-firefly-distro-basic-vpsDuplicate04/24/2014

Actions
Has duplicate Ceph - Bug #9416: ods crash in upgrade:dumpling-dumpling-distro-basic-vps run DuplicateSamuel Just09/10/2014

Actions
Actions

Also available in: Atom PDF