Project

General

Profile

Actions

Support #14294

closed

Infrastructure Host Drive replacements

Added by David Galloway over 8 years ago. Updated over 8 years ago.

Status:
Resolved
Priority:
High
Category:
Test Node
Target version:
-
% Done:

0%

Tags:
Reviewed:
Affected Versions:

Description

senta02 needs sdc replaced
senta02 has had sdd replaced and md1 is in process of recovering. md127 needs recovering still

senta03 needs sdb replaced

Actions #1

Updated by David Galloway over 8 years ago

senta03 has had sdb replaced
md1 is rebuilding

md127 needs sdb1 readded still

Actions #2

Updated by David Galloway over 8 years ago

senta01 had drive 2 replaced and its Areca RAID is rebuilding automatically

Actions #3

Updated by Dan Mick over 8 years ago

senta01 rebuild complete
senta02 has problems with md1, investigating through rescue boot
senta03 rebuild complete

Actions #4

Updated by David Galloway over 8 years ago

senta02's RAID failed and its filesystem was broken beyond salvaging. We lost the following VMs:
  • gitbuilder-hadoop-jar-precise-amd64-inktank
  • gitbuilder-samba-deb-trusty-amd64
  • sentry-db
  • yan-zheng
  • gitbuilder-ceph-tarball-trusty-i386-basic

senta02 was rebuilt today and we were able to get gitbuilder-ceph-tarball-trusty-i386-basic back up. Will work on the others next week.

Actions #5

Updated by David Galloway over 8 years ago

  • Status changed from In Progress to Resolved

All failing drives were replaced.

The gitbuilders are running smoothly and Zack rebuilt sentry-db.

I'll track setting up the Great Firewall circumventor in http://tracker.ceph.com/issues/14290

Actions

Also available in: Atom PDF