Project

General

Profile

Actions

Bug #11316

closed

"ceph-fuse not mounted, got fs type 'ext2/ext3" looping in ceph-deploy-hammer-distro-basic-vps run

Added by Yuri Weinstein about 9 years ago. Updated almost 9 years ago.

Status:
Resolved
Priority:
Urgent
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
ceph-deploy
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.front.sepia.ceph.com/teuthology-2015-04-02_10:48:18-ceph-deploy-hammer-distro-basic-vps/
Jobs: many, 834782 for example
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2015-04-02_10:48:18-ceph-deploy-hammer-distro-basic-vps/834782/

See tie stamps below:

2015-04-02T11:27:11.937 INFO:teuthology.orchestra.run.vpm071:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2015-04-02T11:27:11.949 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2015-04-02T11:27:12.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.vpm071.stderr:2015-04-02 18:27:12.203796 7f980a75e780 -1 init, newargv = 0x3036200 newargc=11
2015-04-02T11:27:12.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.vpm071.stdout:ceph-fuse[12226]: starting ceph client
2015-04-02T11:27:16.950 INFO:teuthology.orchestra.run.vpm071:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2015-04-02T11:27:16.956 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2015-04-02T11:27:21.956 INFO:teuthology.orchestra.run.vpm071:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2015-04-02T11:27:21.961 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2015-04-02T11:27:26.962 INFO:teuthology.orchestra.run.vpm071:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 

...........

2015-04-02T14:24:12.967 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2015-04-02T14:24:17.967 INFO:teuthology.orchestra.run.vpm071:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2015-04-02T14:24:17.976 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2015-04-02T14:24:22.976 INFO:teuthology.orchestra.run.vpm071:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2015-04-02T14:24:22.985 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
Actions #1

Updated by Yuri Weinstein about 9 years ago

  • ceph-qa-suite ceph-deploy added
Actions #2

Updated by Sage Weil about 9 years ago

i think the fs tests are simply broken; ceph now requires that you do a 'ceph fs new ...' command and the ceph-deploy task doesn't do that.

Actions #3

Updated by Yehuda Sadeh about 9 years ago

  • Project changed from rgw to Ceph
Actions #4

Updated by John Spray about 9 years ago

  • Status changed from New to In Progress
  • Assignee set to John Spray
Actions #5

Updated by John Spray about 9 years ago

  • Status changed from In Progress to Fix Under Review

Putting the call in to initialize the FS is straightforward, but the because the ceph-deploy task doesn't populate a bunch of the normal context state properly there are a bunch of other small changes needed to make it work too.

hammer: https://github.com/ceph/ceph-qa-suite/pull/397
master: https://github.com/ceph/ceph-qa-suite/pull/396

Actions #6

Updated by Greg Farnum about 9 years ago

  • Status changed from Fix Under Review to Pending Backport

Merged to master in commit:4e4395f449c0d9fb7d1dad017da5c89df4de41af

Actions #7

Updated by Yuri Weinstein about 9 years ago

I guess we need this in hammer, giant and next, thx!

Actions #8

Updated by John Spray about 9 years ago

next backport: https://github.com/ceph/ceph-qa-suite/pull/416

The giant backport is not clean, do we really need it, given that this test next worked on giant to begin with?

Actions #9

Updated by Yuri Weinstein about 9 years ago

John, thank you! I don't understand when you said "worked on giant to begin with", I see no ceph-deply runs on giant at all?

We also have an option to run ceph-deploy suite off master instead of for example giant, next etc.

Actions #10

Updated by John Spray about 9 years ago

Oops, when I said "this test next worked on giant to begin with?", I meant "this test never worked on giant to begin with".

Actions #11

Updated by Yuri Weinstein about 9 years ago

True, but we need to make them run on giant, hammer and next

Actions #12

Updated by Sage Weil about 9 years ago

  • Project changed from Ceph to CephFS
Actions #13

Updated by Greg Farnum about 9 years ago

Hammer and next PRs are merged now.

Actions #15

Updated by John Spray about 9 years ago

At a quick look, that failure doesn't look related to the filesystem:

2015-04-21T19:05:15.918 INFO:teuthology.orchestra.run.plana57.stderr:[ceph_deploy][ERROR ] RuntimeError: Failed to execute command: apt-get -q update
Actions #17

Updated by John Spray almost 9 years ago

Looking at http://qa-proxy.ceph.com/teuthology/teuthology-2015-04-21_14:58:37-ceph-deploy:fs-master-distro-basic-vps/857557/teuthology.log:

You're running your own wip_ceph_deploy branch, not master, so it doesn't have my fixes in.

Actions #18

Updated by John Spray almost 9 years ago

  • Assignee changed from John Spray to Yuri Weinstein
Actions #19

Updated by Yuri Weinstein almost 9 years ago

Will try John as soon as #11495 is fixed, thx!

Actions #21

Updated by Yuri Weinstein almost 9 years ago

  • Status changed from Pending Backport to Resolved
  • Regression set to No

ceph-deploy suite was optimized and scheduled to run on hammer and next

Actions

Also available in: Atom PDF