Project

General

Profile

Actions

Bug #15874

open

Upon hammer->jewel upgrade, OSD cannot access journal device until after reboot

Added by Nathan Cutler almost 8 years ago. Updated over 7 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
jewel
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Scenario: hammer cluster being upgraded to jewel. Before upgrade, the permissions/ownership of the journal device are "660/root:disk". On each node, the packages are upgraded, the daemons are stopped, /var/lib/ceph is chowned, and the daemons are started again.

Problem: when the jewel OSDs start, they are running as ceph:ceph and fail to open their journal devices (permission denied).

The problem only lasts until the node is rebooted.

Solution: the only solution that occurs to me is to do a "udevadm trigger" in the postinst scripts. I tested this manually and it works like a charm. In this example, node2 was just upgraded from hammer to jewel and /dev/sdb2 is a journal device:

node2:~ # ls -l /dev/sdb2
brw-rw---- 1 root disk 8, 18 May 12 15:49 /dev/sdb2
node2:~ # udevadm trigger
node2:~ # ls -l /dev/sdb2
brw-rw---- 1 ceph ceph 8, 18 May 12 22:26 /dev/sdb2
Actions

Also available in: Atom PDF