Ceph

rados_workunit_loadgen_mostlyread.yaml test failed in the ARM test setup [tala002, tala003, tala004]

INFO:teuthology.task.ceph.mon.a.err:     0> 2013-05-31 18:00:47.022620 b35ff420 -1 mon/Paxos.cc: In function 'void Paxos::handle_begin(MMonPaxos*)' thread b35ff420 time 2013-05-31 18:00:46.990452
INFO:teuthology.task.ceph.mon.a.err:mon/Paxos.cc: 553: FAILED assert(begin->last_committed == last_committed)
INFO:teuthology.task.ceph.mon.a.err:
INFO:teuthology.task.ceph.mon.a.err: ceph version 0.61.2-33-gf87a19d (f87a19d34f9a03493eaca654dd176992676c5812)
INFO:teuthology.task.ceph.mon.a.err: 1: (Paxos::handle_begin(MMonPaxos*)+0x45b) [0xcc578]
INFO:teuthology.task.ceph.mon.a.err: 2: (Paxos::dispatch(PaxosServiceMessage*)+0xeb) [0xcf994]
INFO:teuthology.task.ceph.mon.a.err: 3: (Monitor::_ms_dispatch(Message*)+0x695) [0xb7f8e]
INFO:teuthology.task.ceph.mon.a.err: 4: (Monitor::ms_dispatch(Message*)+0x19) [0xc770e]
INFO:teuthology.task.ceph.mon.a.err: 5: (DispatchQueue::entry()+0x35d) [0x1d71d6]
INFO:teuthology.task.ceph.mon.a.err: 6: (DispatchQueue::DispatchThread::entry()+0x7) [0x193400]
INFO:teuthology.task.ceph.mon.a.err: 7: (Thread::_entry_func(void*)+0x7) [0x194828]
INFO:teuthology.task.ceph.mon.a.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
INFO:teuthology.task.ceph.mon.a.err:

INFO:teuthology.task.ceph.mon.a.err:terminate called after throwing an instance of 'ceph::FailedAssertion'
INFO:teuthology.task.ceph.mon.a.err:*** Caught signal (Aborted) **
INFO:teuthology.task.ceph.mon.a.err: in thread b35ff420
INFO:teuthology.task.ceph.mon.a.err: ceph version 0.61.2-33-gf87a19d (f87a19d34f9a03493eaca654dd176992676c5812)
INFO:teuthology.task.ceph.mon.a.err: 1: ceph-mon() [0x12f806]
INFO:teuthology.task.ceph.mon.a.err: 2: (__default_sa_restorer_v2()+0) [0xb6a169d0]
INFO:teuthology.task.ceph.mon.a.err: 3: (()+0x171e6) [0xb6a081e6]
INFO:teuthology.task.ceph.mon.a.err: 4: (gsignal()+0x29) [0xb6a15db2]
INFO:teuthology.task.ceph.mon.a.err:problem writing to /var/log/ceph/ceph-mon.a.log: (30) Read-only file system
INFO:teuthology.task.ceph.mon.a.err:2013-05-31 18:00:48.840396 b35ff420 -1 *** Caught signal (Aborted) **
INFO:teuthology.task.ceph.mon.a.err: in thread b35ff420
INFO:teuthology.task.ceph.mon.a.err:
INFO:teuthology.task.ceph.mon.a.err: ceph version 0.61.2-33-gf87a19d (f87a19d34f9a03493eaca654dd176992676c5812)
INFO:teuthology.task.ceph.mon.a.err: 1: ceph-mon() [0x12f806]
INFO:teuthology.task.ceph.mon.a.err: 2: (__default_sa_restorer_v2()+0) [0xb6a169d0]
INFO:teuthology.task.ceph.mon.a.err: 3: (()+0x171e6) [0xb6a081e6]
INFO:teuthology.task.ceph.mon.a.err: 4: (gsignal()+0x29) [0xb6a15db2]
INFO:teuthology.task.ceph.mon.a.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
INFO:teuthology.task.ceph.mon.a.err:
INFO:teuthology.task.ceph.mon.a.err:problem writing to /var/log/ceph/ceph-mon.a.log: (30) Read-only file system
INFO:teuthology.task.ceph.mon.a.err:problem writing to /var/log/ceph/ceph-mon.a.log: (30) Read-only file system
INFO:teuthology.task.ceph.mon.a.err:     0> 2013-05-31 18:00:48.840396 b35ff420 -1 *** Caught signal (Aborted) **
INFO:teuthology.task.ceph.mon.a.err: in thread b35ff420
INFO:teuthology.task.ceph.mon.a.err:
INFO:teuthology.task.ceph.mon.a.err: ceph version 0.61.2-33-gf87a19d (f87a19d34f9a03493eaca654dd176992676c5812)
INFO:teuthology.task.ceph.mon.a.err: 1: ceph-mon() [0x12f806]
INFO:teuthology.task.ceph.mon.a.err: 2: (__default_sa_restorer_v2()+0) [0xb6a169d0]
INFO:teuthology.task.ceph.mon.a.err: 3: (()+0x171e6) [0xb6a081e6]
INFO:teuthology.task.ceph.mon.a.err: 4: (gsignal()+0x29) [0xb6a15db2]
INFO:teuthology.task.ceph.mon.a.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this

tamil@ubuntu:~/arm/teuthology$ cat rados1.yaml 
roles:
- [mon.a, mds.a, osd.0, osd.1]
- [mon.b, mon.c, osd.2, osd.3]
- [client.0]

targets:
  ubuntu@tala002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDTZjCkqH+O6LyZI2jmMLAVzUhL4jGKpJ5PQsUMLEB3BCLRWYEFSgbvj8p2EMDIbJapEuxXnUCf+F7s9kLtdcDvfTg8jadq5Z+ymxp042bQHHopbL6rRjO6SoSbQyYKZHQwbqV1Mk/PooOuBwzgv6DpBj7qvhxz93p6FAzvB774dUik7ToVc96t80KADQIa3iNAfGA03L01/mY+vZgrexMy6HZzLjjzXJBsfycZOEzmRfk0OPYaBUjFlKvtUC6BPDIyGt5BKSVYNSyR+t5BN+MMTYbTE9ANVhAQ9YQTQn9CU0yplLFpsZPxF2aA7m3zlHhWkT9rXHJGVOIeFmxT/1n5
  ubuntu@tala003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtZiZ63/3h4bMjKN0yrFVSKQX+XKZxQ8BXCJfsneC7MhgOiE2GzeuZPxKbad0gVrvaSoiKLoqJFJtrj/2v0lLln3BsGU0M2Uyl5sg8pPSbsca1dgEb2ebwir7hfZDnjLh24yqMKDo7M3IpL0A6iNT0cHU5eKVJrOWJP9sjkqG5XutZzTdryeTWO8OQ8ErblFPMIpY6/GqalihzhFdH5QCs5WgnYuApLkW8o04vHLW2fzT6cv5ZoODpZNSJtaeur7YT/ZChMAgWB9MRuWFLgJ4dC6pcFcu72OrDsCamp1eADkOnbLoSbW8tpgTRn3McvWTHtMUDKHseLuHsuz9mrTFd
  ubuntu@tala004.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4XQUem3ze9TfBfsJ3pL8kPm+Y98TEJDQ76rOcdjMR4Rs8mte1Q1B93hT0CI8uRjFcv9uiKaOlweiqKXSx6N/20dsPQ2LN54FtXLB346vsxDmZH0RRzg7KfHja/AilEW3pN3nlLlYkCN/9yWuId3g1sN1L6Shylyc96OL2b++O5fZhZnzbbaHSvyngU73GY/sfRWWA6bB6suXRe/QMbHA/ge/+EvcjJ74nZynenujAchjcVmY6xzpXsXYtSSpYcdgkVh+7P1H0KkfWJwH8aRvsni7TE/6Zp8AtaROelCW1v5vMaLAUjjFtz2nVy2KSViktX3jIpwHDXoFd3eJumXxT

tasks:
#- chef:
- install:
     branch: cuttlefish
- ceph:
- workunit:
    clients:
      all:
        - rados/load-gen-mostlyread.sh

The test set up tala002, tala003 and tala004 is left in the current state.