Project

General

Profile

Activity

From 02/09/2016 to 03/09/2016

03/09/2016

02:05 PM Bug #14758 (Resolved): failed TestJournalRepair test on smithi
In this case, mds.b was going into resolve (rank 0), while mds.a was remaining in standby. That's correct (rank 1 is... John Spray
11:53 AM Bug #14758 (New): failed TestJournalRepair test on smithi
John Spray
11:52 AM Bug #14758 (Rejected): failed TestJournalRepair test on smithi
The link in the report was wrong, it was actually:
http://pulpito.ceph.com/teuthology-2016-02-12_14:03:01-fs-jewel--...
John Spray
06:34 AM Bug #14758: failed TestJournalRepair test on smithi
Hmm, we haven't seen this since then, and there have been some smithi runs so it's apparently not just infrastructure... Greg Farnum
11:50 AM Feature #14642: Validate layouts everywhere we load them
Yes, and in testing I also found other places in the MDS that get upset with zeros, so the ticket probably either nee... John Spray
06:46 AM Feature #14642: Validate layouts everywhere we load them
John, I think maybe you said in the user thread that we seem to guard against this on inputs, right? So we've no idea... Greg Farnum
06:50 AM Bug #14255: qa: we are filling smithi disks with ffsb workloads
This is still happening (http://pulpito.ceph.com/teuthology-2016-03-07_18:04:01-fs-master---basic-smithi/45723/, http... Greg Farnum
06:45 AM Bug #14807 (Need More Info): MDS crashes repeatedly after upgrade to Infernalis from Hammer
Greg Farnum
06:44 AM Bug #14735: ceph-fuse does not mount at boot on Debian Jessie
Bumping down priority as it's just the backport. Greg Farnum
06:43 AM Bug #14608 (Need More Info): snaptests.yaml failure: [WRN] open_snap_parents has:" in cluster log
For whatever reason we don't actually have the logs here (any more?), and it doesn't seem to have reproduced elsewher... Greg Farnum
06:43 AM Bug #14996 (Fix Under Review): libcephfs hangs on shutdown if an unclosed opendir handle exists
https://github.com/ceph/ceph/pull/7994 Zheng Yan
06:32 AM Bug #14196: test_object_deletion fails (tasks.cephfs.test_damage.TestDamage)
Bumping down priority as it's just the backport now. Greg Farnum
01:53 AM Bug #15008 (Fix Under Review): fuse expects root inode number to be FUSE_ROOT_ID
https://jenkins.ceph.com/job/ceph-pull-requests/2751/ Zheng Yan

03/08/2016

03:27 PM Bug #15008 (Resolved): fuse expects root inode number to be FUSE_ROOT_ID
it's not true when mounting into subdir Zheng Yan
05:09 AM Bug #9679: Ceph hadoop terasort job failure
I forgot to mention, I tested both: Hadoop 2.7.1 and 2.7.2 with the same outcome.
64 bit Arch linux circa Jan 2015. ...
Dmitry Buzz
05:01 AM Bug #9679: Ceph hadoop terasort job failure
Greg,
My setup was simple: ceph jni bindings were build from ceph repo.
Cehp hadoop2 integration was build from h...
Dmitry Buzz
12:00 AM Bug #9679: Ceph hadoop terasort job failure
Dmitry, can you elucidate more on your environment? Which Hadoop, and what bindings did you use to connect Ceph and H... Greg Farnum
02:15 AM Bug #14805: Hadoop tests failing with EPERM
old libcephfs only has permission check for open. Now, It has full permission checks (open, lookup, setattr ...) Zheng Yan

03/07/2016

11:55 PM Bug #14805: Hadoop tests failing with EPERM
Do you have any idea what about the client permission checking is busting Hadoop? We want to fix it properly (or at l... Greg Farnum
02:25 PM Bug #14996: libcephfs hangs on shutdown if an unclosed opendir handle exists
I think we should unify open file/directory handle Zheng Yan
10:41 AM Bug #14996 (Resolved): libcephfs hangs on shutdown if an unclosed opendir handle exists

This will hang on shutdown:...
John Spray

03/03/2016

02:38 PM Bug #14684 (Resolved): test_scrub_checks fails
Sage Weil
02:08 PM Bug #14970 (Rejected): Post-new-layouts clients crash talking to older MDSs
Ah, I see: we reused the version, makes sense. Thanks! John Spray
02:01 PM Bug #14970: Post-new-layouts clients crash talking to older MDSs
I think this only affects older MDS with feature bit (1<<58) Zheng Yan
01:48 PM Bug #14970 (Rejected): Post-new-layouts clients crash talking to older MDSs
By sheer coincidence I had a vstart cluster created before rebasing on master, and a client compiled after rebasing o... John Spray
02:38 AM Bug #10944: Deadlock, MDS logs "slow request", getattr pAsLsXsFs failed to rdlock
The file by default goes to a file called "cachedump.*", like it says. I think it tends to go in /, but I don't remem... Greg Farnum

03/02/2016

05:28 AM Bug #14805: Hadoop tests failing with EPERM
tests passed
http://pulpito.ceph.com/zyan-2016-03-01_20:05:19-hadoop-jewel-testing-basic-mira/
Zheng Yan

02/29/2016

11:52 AM Bug #14685: dbench hang on native cifs mount
http://qa-proxy.ceph.com/teuthology/teuthology-2016-02-26_19:14:10-samba-jewel---basic-mira/29964/teuthology.log Zheng Yan

02/28/2016

06:09 PM Bug #10944: Deadlock, MDS logs "slow request", getattr pAsLsXsFs failed to rdlock
We're also running into this with the latest versions of ceph and CentOS 7 kernel. Message on the mds is:... Richard Hesse
09:04 AM Backport #14761 (In Progress): infernalis: ceph-fuse does not mount at boot on Debian Jessie
Nathan Cutler

02/26/2016

02:04 PM Backport #14761: infernalis: ceph-fuse does not mount at boot on Debian Jessie
Is there a reason why this was not backported to Infernalis before 9.2.1 release ? Florent B
02:04 PM Bug #14735: ceph-fuse does not mount at boot on Debian Jessie
Is there a reason why this was not backported to Infernalis before 9.2.1 release ? Florent B
07:46 AM Bug #14732 (Duplicate): open returns EACCES when O_TRUNC is specified and write permission is den...
@Yan, marking it as a duplicate of http://tracker.ceph.com/issues/13809 because it's only caused by this incomplete b... Loïc Dachary
07:09 AM Bug #14732 (Fix Under Review): open returns EACCES when O_TRUNC is specified and write permission...
Zheng Yan

02/25/2016

12:54 PM Bug #14732: open returns EACCES when O_TRUNC is specified and write permission is denied (hammer)
Sorry, it's my fault.
I added two extra commits to https://github.com/ceph/ceph/pull/6604
Zheng Yan
04:01 AM Bug #14807: MDS crashes repeatedly after upgrade to Infernalis from Hammer
Christopher Nelson wrote:
> It turns out the main files are too large. Is there any other way I can upload them?
...
Zheng Yan

02/24/2016

06:05 AM Backport #12350 (Resolved): Provided logrotate setup does not handle ceph-fuse correctly
Loïc Dachary
05:22 AM Bug #14732: open returns EACCES when O_TRUNC is specified and write permission is denied (hammer)
More runs with the same failure : http://pulpito.ceph.com/loic-2016-02-22_22:08:47-fs-hammer-backports---basic-multi/ Loïc Dachary

02/23/2016

02:37 PM Bug #14807: MDS crashes repeatedly after upgrade to Infernalis from Hammer
It turns out the main files are too large. Is there any other way I can upload them? Christopher Nelson
02:36 PM Bug #14807: MDS crashes repeatedly after upgrade to Infernalis from Hammer
Apparently my institution blocks outbound scp, so I had to post the files here. Sorry for the delay. Christopher Nelson
09:21 AM Bug #13640 (Resolved): CephFS and page cache handling
Zheng Yan
09:15 AM Bug #14684 (Fix Under Review): test_scrub_checks fails
... Zheng Yan
05:57 AM Backport #14843 (Rejected): infernalis: test_object_deletion fails (tasks.cephfs.test_damage.Test...
Loïc Dachary
03:37 AM Bug #14759: ovh: failed snaptest-git-ceph.sh test
might be duplicate of #10436 Zheng Yan
03:20 AM Bug #14196: test_object_deletion fails (tasks.cephfs.test_damage.TestDamage)
https://github.com/ceph/ceph-qa-suite/pull/829 Zheng Yan
03:12 AM Bug #14798 (Fix Under Review): free fds being exhausted eventually because freed fds are never pu...
Zheng Yan

02/22/2016

01:34 PM Bug #14732: open returns EACCES when O_TRUNC is specified and write permission is denied (hammer)
strange, I can't find O_TRUNC in tests/open/06.t Zheng Yan
12:19 PM Bug #14800 (Fix Under Review): [ceph-fuse] Fh ref might leak at umounting
Zheng Yan
12:11 PM Bug #14805 (Fix Under Review): Hadoop tests failing with EPERM
I have trouble to run the test on local machine, let's try disable client_permissions
https://github.com/ceph/ceph...
Zheng Yan
09:38 AM Bug #14684: test_scrub_checks fails

http://pulpito.ceph.com/teuthology-2016-02-19_14:03:01-fs-jewel---basic-smithi/17838/...
Zheng Yan
09:23 AM Bug #14196 (Pending Backport): test_object_deletion fails (tasks.cephfs.test_damage.TestDamage)
http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-02-19_17:43:52-fs-infernalis---basic-openstack/559/
need ba...
Zheng Yan

02/20/2016

03:42 AM Bug #9679: Ceph hadoop terasort job failure
I'm testing ceph version 10.0.3-1325-g98fba62 on hadoop 3.0.0 and I see the same error in hadoop terasort.
I'm not s...
Dmitry Buzz

02/19/2016

07:40 PM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
corresponding issue #14824 Yuri Weinstein
04:49 PM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Next try commit 951339103d35bc8ee2de880f77aada40d15b592a
passed
http://pulpito.ceph.com/teuthology-2016-02-19_1...
Yuri Weinstein
04:01 PM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Tests on 2817ffcf4e57f92551b86388681fc0fe70c386ec in ReplicatedPG commit failed all in similar way => .... Yuri Weinstein
10:18 AM Bug #14818 (Resolved): Cython librados broke libcephfs/ceph_volume_client
Specifically, the create_with_rados libcephfs function is no longer happy.... John Spray

02/18/2016

10:31 PM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Greg the test passed on that commit.
http://pulpito.ceph.com/teuthology-2016-02-18_13:42:45-fs-wip-test-14716-2---...
Yuri Weinstein
01:11 AM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Well at least it's consistent. Can you also try commit:2c8e57934284dae0ae92d1aa0839a87092ec7c51 against smithi/mira?
...
Greg Farnum
09:43 PM Bug #14807: MDS crashes repeatedly after upgrade to Infernalis from Hammer
I was not aware of any issues prior to the upgrade. I am posting the files now, and I'll let you know the tag when it... Christopher Nelson
08:57 PM Bug #14807: MDS crashes repeatedly after upgrade to Infernalis from Hammer
Do you have the MDS log from when this first started happening, and can you please upload it? (ceph-post-file will le... Greg Farnum
03:44 PM Bug #14807 (Can't reproduce): MDS crashes repeatedly after upgrade to Infernalis from Hammer
I have a small cluster (1xMON 1xMDS 2xOSD). It has been very stable for the last year.
However, after the upgrade ...
Christopher Nelson
03:40 PM Bug #14672: MDS crashes with FAILED assert(inode_map.count(in->vino()) == 0) in 9.2.0
I have this same problem, and I did not do a newfs. I simply upgraded from Hammer to Infernalis:... Christopher Nelson
03:35 PM Bug #14641: don't let users specify 0 on stripe count or object size
It was a brand new 9.2 cluster. Haven't yet seen the issue again.. Kenneth Waegeman
02:45 PM Feature #12144 (Resolved): cephfs-data-scan: integrated with sharded pgls
https://github.com/ceph/ceph/pull/7034 Greg Farnum
10:44 AM Bug #14805 (Resolved): Hadoop tests failing with EPERM

Most recent instance:
http://pulpito.ceph.com/teuthology-2016-02-17_18:12:06-hadoop-jewel---basic-mira/
Here's ...
John Spray
05:24 AM Bug #14800: [ceph-fuse] Fh ref might leak at umounting
https://github.com/ceph/ceph/pull/7686 Zhi Zhang
05:22 AM Bug #14800 (Resolved): [ceph-fuse] Fh ref might leak at umounting
Recently we meet ceph-fuse hanging issue and have to kill ceph-fuse process to continue. This issue is caused by forc... Zhi Zhang
03:22 AM Bug #14798: free fds being exhausted eventually because freed fds are never put back
https://github.com/ceph/ceph/pull/7685 Zhi Zhang
03:18 AM Bug #14798: free fds being exhausted eventually because freed fds are never put back
The open and create operation in libcephfs will get a free fd from the free_fd_set. This free fd will be erased from ... Zhi Zhang
03:12 AM Bug #14798 (Resolved): free fds being exhausted eventually because freed fds are never put back
Zhi Zhang

02/17/2016

11:09 PM Bug #14684: test_scrub_checks fails
And again: http://pulpito.ceph.com/gregf-2016-02-15_18:08:49-fs-greg-fs-testing-215-1---basic-smithi/10771/
It doe...
Greg Farnum

02/16/2016

09:54 PM Bug #14714: three jobs in samba suite failing for hammer v0.94.6 QE validation
same tests on v0.94.4 failed same way !?
Although they did passed during QE validation http://tracker.ceph.com/issue...
Yuri Weinstein
05:31 PM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Tried on diff machines all failed in similar fashion:
http://pulpito.ceph.com/teuthology-2016-02-15_16:52:37-fs-hamm...
Yuri Weinstein
04:44 AM Bug #14754 (Duplicate): test_barrier (tasks.cephfs.test_full.TestClusterFull) fails on osdmap epo...
I hope this was #14750 manifesting differently? Greg Farnum
04:43 AM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
#14750 Greg Farnum
04:42 AM Bug #14698 (Duplicate): Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
Greg Farnum
04:43 AM Bug #14258 (Duplicate): qa: failed test_full_fsync
#14750 Greg Farnum
04:35 AM Bug #14697 (Resolved): mds: assert in SafeTimer while suiciding
Greg Farnum
03:49 AM Bug #14684: test_scrub_checks fails
gregf-2016-02-15_13:33:12-fs-greg-fs-testing-215-sure---basic-smithi/10011/
original; and here we have it on maste...
Greg Farnum

02/15/2016

04:46 AM Backport #14761 (Rejected): infernalis: ceph-fuse does not mount at boot on Debian Jessie
https://github.com/ceph/ceph/pull/7834 Loïc Dachary

02/14/2016

08:22 PM Bug #14684: test_scrub_checks fails
http://pulpito.ceph.com/teuthology-2016-02-05_14:03:02-fs-jewel---basic-smithi/8806/
Same as the original case
Greg Farnum
07:54 PM Bug #14684: test_scrub_checks fails
http://pulpito.ceph.com/teuthology-2016-02-12_14:03:01-fs-jewel---basic-smithi/8245/... Greg Farnum
08:04 PM Bug #14759 (Closed): ovh: failed snaptest-git-ceph.sh test
http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-02-06_18:04:02-fs-master---basic-openstack/17910/... Greg Farnum
07:51 PM Bug #14758 (Resolved): failed TestJournalRepair test on smithi
http://pulpito.ceph.com/teuthology-2016-02-12_14:03:01-fs-jewel---basic-smithi/8218/... Greg Farnum

02/13/2016

07:08 AM Bug #14714: three jobs in samba suite failing for hammer v0.94.6 QE validation
Hmm, we've got 3 failures in teuthology-2016-02-07_21:14:02-samba-infernalis---basic-openstack as well, but they're d... Greg Farnum
06:10 AM Bug #14754 (Duplicate): test_barrier (tasks.cephfs.test_full.TestClusterFull) fails on osdmap epo...
In an integration branch which might have messed it up, but this is a first appearance:
http://pulpito.ceph.com/greg...
Greg Farnum

02/12/2016

07:28 PM Bug #14684: test_scrub_checks fails
http://pulpito.ceph.com/teuthology-2016-02-10_14:03:02-fs-jewel---basic-smithi/4160/... Greg Farnum
07:00 PM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
John Spray wrote:
> The output is
> [...]
>
> (it's hard to see because it comes out at the point the command ac...
Greg Farnum
01:35 PM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
aaaand here's why:... John Spray
01:30 PM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
The weirdness here is that the error is coming from os.write() rather than os.fsync().
The test expects that the c...
John Spray
01:24 PM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
The output is... John Spray
06:43 AM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
I'm confused — the log doesn't seem to include any of the output from the remote python script. Which makes me think ... Greg Farnum
02:11 PM Bug #14735 (Pending Backport): ceph-fuse does not mount at boot on Debian Jessie
Nathan Cutler
01:40 PM Bug #14735: ceph-fuse does not mount at boot on Debian Jessie
Nathan Cutler wrote:
> Should this be backported to Infernalis?
Yes, please.
Florent B
01:31 PM Bug #14735: ceph-fuse does not mount at boot on Debian Jessie
Should this be backported to Infernalis? Nathan Cutler
06:58 AM Bug #14714 (Won't Fix): three jobs in samba suite failing for hammer v0.94.6 QE validation
I'm not sure exactly what's going on here, but I'm pretty convinced it's a configuration issue not worth our time to ... Greg Farnum
12:17 AM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Nope, that's not it directly, we only propagate one at a time thanks to Journaler::handle_write_error().
This is a...
Greg Farnum

02/11/2016

11:48 PM Bug #14716: "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
This one's odd. The problem in #14697 is different; it's actually calling timer.shutdown() twice there. Here, that is... Greg Farnum
11:39 PM Bug #14697: mds: assert in SafeTimer while suiciding
Greg Farnum
11:38 PM Bug #14697: mds: assert in SafeTimer while suiciding
> 2016-02-08T02:00:34.587 INFO:tasks.ceph.mds.a-s.mira064.stderr:Thread::join(): pthread_join failed with error 22
...
Greg Farnum
10:07 PM Bug #14735 (Resolved): ceph-fuse does not mount at boot on Debian Jessie
Greg Farnum
01:58 PM Bug #14735: ceph-fuse does not mount at boot on Debian Jessie
Fixed by https://github.com/ceph/ceph/pull/7607 Florent B
08:58 AM Bug #14735 (Resolved): ceph-fuse does not mount at boot on Debian Jessie
I have a problem with ceph-fuse on Debian Jessie.
I have this in my fstab :
@id=my_user,daemonize=false,mon_hos...
Florent B
10:06 PM Bug #14365 (Resolved): unsafe handle_config_change() methods
Fixed in https://github.com/ceph/ceph/pull/7312 and https://github.com/ceph/ceph/pull/7581 (both required). Greg Farnum
04:37 AM Bug #14384 (Resolved): fsx failed to compile
Loïc Dachary
04:37 AM Bug #13777 (Resolved): Ceph file system is not freeing space
Loïc Dachary
04:37 AM Bug #13714 (Resolved): Segmentation fault accessing file using fuse mount
Loïc Dachary
04:14 AM Bug #14732 (Duplicate): open returns EACCES when O_TRUNC is specified and write permission is den...
See http://tracker.ceph.com/issues/14692#note-2 for a few runs with this issue... Loïc Dachary

02/10/2016

06:08 AM Backport #13889 (Resolved): infernalis: Segmentation fault accessing file using fuse mount
Loïc Dachary
06:07 AM Backport #13931 (Resolved): infernalis: kclient: intermittent log warnings "client.XXXX isn't res...
Loïc Dachary
06:07 AM Backport #14067 (Resolved): infernalis : Ceph file system is not freeing space
Loïc Dachary
06:06 AM Backport #14490 (Resolved): infernalis: fsx failed to compile
Loïc Dachary

02/09/2016

11:58 PM Bug #14716 (Won't Fix): "Thread.cc: 143: FAILED assert(status == 0)" in fs-hammer---basic-smithi
Jobs:
http://qa-proxy.ceph.com/teuthology/teuthology-2016-02-09_08:45:22-fs-hammer---basic-smithi/1624/teuthology....
Yuri Weinstein
09:41 PM Bug #14714 (Won't Fix): three jobs in samba suite failing for hammer v0.94.6 QE validation
Runs:
mira
http://pulpito.ceph.com/teuthology-2016-02-09_13:11:14-samba-hammer---basic-mira/
smithi
http://p...
Yuri Weinstein
06:44 PM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
http://pulpito.ceph.com/gregf-2016-02-08_22:02:06-fs-greg-fs-testing-27-1---basic-mira/1009/
Also this failure see...
Greg Farnum
03:06 PM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
Dunno — it's QuotaFull rather than ClusterFull so I created a new ticket. Greg Farnum
11:17 AM Bug #14698: Test failure: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull)
Different to http://tracker.ceph.com/issues/14258 ? John Spray
08:16 AM Backport #13932 (New): hammer: kclient: intermittent log warnings "client.XXXX isn't responding t...
Loïc Dachary
08:02 AM Backport #13932 (In Progress): hammer: kclient: intermittent log warnings "client.XXXX isn't resp...
Loïc Dachary
07:59 AM Backport #13932: hammer: kclient: intermittent log warnings "client.XXXX isn't responding to mcli...
I think the PR to backport is https://github.com/ceph/ceph/pull/6432 - it was merged on November 30. Nathan Cutler
06:04 AM Backport #13932: hammer: kclient: intermittent log warnings "client.XXXX isn't responding to mcli...
Zheng, was there something wrong with that PR or something? Greg Farnum
06:01 AM Backport #13932 (New): hammer: kclient: intermittent log warnings "client.XXXX isn't responding t...
The proposed PR has been closed, assuming no work is otherwise being done. Loïc Dachary
05:59 AM Backport #14668: hammer: Wrong ceph get mdsmap assertion
It is unfortunately too late, v0.94.6 is already frozen and being tested. Loïc Dachary
01:12 AM Bug #13980: all nfs v3 mounts fail in ovh lab
and in http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-02-07_20:10:01-knfs-hammer-testing-basic-openstack/ Yuri Weinstein
 

Also available in: Atom