Activity
From 09/28/2014 to 10/27/2014
10/27/2014
- 06:17 PM Feature #4138 (Fix Under Review): MDS: forward scrub: add functionality to verify disk data is co...
- This bit at least has been isolated and put into a PR:
https://github.com/ceph/ceph/pull/2814 - 04:23 PM Bug #9870 (Resolved): kernel: not handling cap_flush_ack messages properly
- 10:28 AM Bug #9904 (Resolved): Don't crash MDS on clients sending messages with bad seq
- Currently in Server::handle_client_session, we do this:...
- 10:14 AM Feature #9903 (Resolved): Recover lost dirfrag via data pool
[While the MDS cluster is offline and journal has been flushed if necessary]
Given that a particular dirfrag obj...- 09:36 AM Bug #9900 (Duplicate): Failure in multiple_rsync (directories wrongly appear changed)
http://pulpito.ceph.com/teuthology-2014-10-24_23:08:01-kcephfs-giant-testing-basic-multi/570840/
http://pulpito.ce...- 06:05 AM Bug #9800: client-limits test is not passing
- https://github.com/ceph/ceph/pull/2809
http://pulpito.front.sepia.ceph.com/john-2014-10-27_13:05:29-fs:recovery-wip-...
10/24/2014
- 11:14 AM Bug #9884: too many files in /usr for multiple_rsync.sh
- Yeah, just cutting it down to a more predictable/smaller directory sounds good to me.
- 10:50 AM Bug #9884: too many files in /usr for multiple_rsync.sh
- one failure http://pulpito.ceph.com/teuthology-2014-10-20_23:04:01-fs-giant-distro-basic-multi/562537/
- 10:49 AM Bug #9884 (Closed): too many files in /usr for multiple_rsync.sh
- for example, plana81 has 60k files in /usr, but plana90 has 90k files in /usr. perhaps multiple_rsync should /usr/src...
- 09:53 AM Feature #3882 (Rejected): Hide snapshot directory name in mount/mtab
- we can now restrict snap access by uid...
- 09:49 AM Feature #9883 (Resolved): journal-tool: smarter scavenge (conditionally update dir objects)
- 09:42 AM Feature #9881 (Resolved): mds: admin command to flush the mds journal
- 09:41 AM Feature #9880 (Resolved): mds: more gracefully handle EIO on missing dir object
10/23/2014
- 01:47 PM Bug #9869 (Pending Backport): Client: not handling cap_flush_ack messages properly
- I tested this manually with a patch that sets the starting tid value to 65535 and looking at the logs. That causes im...
- 12:47 PM Bug #9870: kernel: not handling cap_flush_ack messages properly
10/22/2014
- 05:34 PM Bug #9870 (Resolved): kernel: not handling cap_flush_ack messages properly
- This is the analogue to #9869, which Zheng tells me is also a problem in the kernel. We need to downcast the message ...
- 05:30 PM Bug #9869: Client: not handling cap_flush_ack messages properly
- Waiting for this to build so it can be tested.
- 05:28 PM Bug #9869 (Resolved): Client: not handling cap_flush_ack messages properly
- We saw a log segment that contained this:...
10/21/2014
- 03:22 PM Feature #9557 (Fix Under Review): mds: verify backtrace on fetch_dir
- 10:44 AM Feature #9557 (In Progress): mds: verify backtrace on fetch_dir
- 11:43 AM Bug #8809 (Can't reproduce): uclient: memory leak
- maybe fixed by 2313ce1d024361fd7f4d2cbca789010f0fe0faad
- 10:55 AM Bug #9674: nightly failed multiple_rsync.sh
- commit:477073aba1da880dfd0b8c82f4792788579f28b9 in master and commit:44ce33c12443909b02c7ee451ad45400f55d53c9 in giant
10/20/2014
- 01:23 PM Feature #414 (Resolved): ceph-fuse: implement file locking
- 01:22 PM Bug #8576: teuthology: nfs tests failing on umount
- teuthology commit:4f2957c42d0f76a399cb26c660ede9243c095779 runs those commands as well as the previous ones.
- 01:02 PM Bug #9679 (Closed): Ceph hadoop terasort job failure
- Fixed in cephfs-hadoop repo.
- 11:15 AM Bug #9800: client-limits test is not passing
Same failure:
http://pulpito.front.sepia.ceph.com/teuthology-2014-10-17_23:04:02-fs-giant-distro-basic-multi/555...
10/19/2014
- 07:20 PM Bug #9341 (Pending Backport): MDS: very slow rejoin
- Hmm, we didn't put this in Giant initially because we were trying not to perturb it. Master hasn't been run through t...
- 06:45 PM Bug #9341 (Fix Under Review): MDS: very slow rejoin
- Please include this fix to 0.87 which is affected just as badly as 0.80.x.
On 0.87 MDS stuck in "rejoin" for hours a...
10/16/2014
- 01:54 PM Bug #9800 (Resolved): client-limits test is not passing
- /a/teuthology-2014-10-13_23:04:01-fs-giant-distro-basic-multi/547170
The client isn't dropping its caps:... - 10:50 AM Feature #4137: MDS: Implement a forward-scrubbing mechanism.
- I realized today that we probably want to optionally scrub directories that were renamed into place following a scrub...
10/15/2014
- 12:39 AM Bug #8576: teuthology: nfs tests failing on umount
- I notice that if I execute 'service nfs stop' first, umounting cephfs always successes. 'service nfs stop' runs two c...
10/14/2014
- 06:15 PM Bug #9674: nightly failed multiple_rsync.sh
- rsync asks us to see previous errors;) yes, I think sudo should work
- 02:36 PM Bug #9674: nightly failed multiple_rsync.sh
- Well, that would make sense. How did you find those in the log?
We should probably just run this as sudo or someth... - 06:30 AM Bug #9674: nightly failed multiple_rsync.sh
- ...
- 06:20 AM Feature #9755: Fence late clients during reconnect timeout
- There can be certain cases where a client can reconnect after being evicted, e.g. if:
* the client didn't hold an...
10/13/2014
- 04:50 PM Feature #414 (Fix Under Review): ceph-fuse: implement file locking
- 12:52 PM Feature #9755: Fence late clients during reconnect timeout
- Hmm, I like the basic thrust of this, but I'm a little concerned as well — we have other tickets to let clients recon...
- 03:39 AM Feature #9755 (Resolved): Fence late clients during reconnect timeout
During reconnect, MDSs terminate the sessions of any clients which fail to reconnect within the window. Because wh...- 03:16 AM Feature #9754 (Resolved): A 'fence and evict' client eviction command
Currently the "session evict" operation on the MDS admin socket will terminate the session, and release any capabil...
10/10/2014
- 04:11 PM Bug #9679: Ceph hadoop terasort job failure
- I do believe that Hadoop kills the clients after they reach a point that the run-time believes everything has been fl...
- 02:02 PM Bug #9679: Ceph hadoop terasort job failure
- Looking at the bad client (11139), the first thing I notice is that the messaging is way backed up. What's the networ...
- 09:13 AM Bug #9679: Ceph hadoop terasort job failure
- Here is the directory listing. All of the files should be the same size....
- 07:18 AM Bug #9692 (Resolved): ACL workunit syntax error
10/09/2014
- 12:07 PM Bug #9679: Ceph hadoop terasort job failure
- empty fs:...
- 08:21 AM Bug #9679: Ceph hadoop terasort job failure
- Thanks Huamin. Yeh, It looks like some writes are being lost, probably due to an unclean shutdown. I'll get some trac...
- 08:06 AM Bug #9679: Ceph hadoop terasort job failure
- For comparison, teragen files on CephFS
./hadoop/bin/hadoop fs -ls /in-dir-3
14/10/09 08:05:05 WARN util.NativeC... - 07:04 AM Bug #9679: Ceph hadoop terasort job failure
- Run the same tests on HDFS 2.4.1, thoguh on a different setup. Terasort finished without any problem.
Cmd:
./hado...
10/08/2014
- 11:08 PM Bug #9679: Ceph hadoop terasort job failure
- missing one of these?...
- 10:46 PM Bug #9679: Ceph hadoop terasort job failure
- My bet at this point is on the generation of the input data set. Teragen creates a file with X 100byte entries. When ...
- 07:28 AM Feature #9437 (Resolved): make 'ceph tell mds.* ...' work, deprecate 'ceph mds tell * ...'
- ...
10/07/2014
- 07:28 PM Bug #9692 (Resolved): ACL workunit syntax error
- http://pulpito.ceph.com/gregf-2014-10-06_19:59:42-kcephfs-wip-9628-testing-basic-multi/531900...
- 07:26 PM Bug #9628 (Resolved): mds: race between ms_handle_accept() and ms_handle_reset()
- Merged to master in commit:1b7fae7b2953649564a9e226b4abedad0ce652cc
- 09:54 AM Bug #9679: Ceph hadoop terasort job failure
- https://issues.apache.org/jira/browse/MAPREDUCE-2018
- 09:53 AM Bug #9679: Ceph hadoop terasort job failure
- https://svn.apache.org/repos/asf/hadoop/common/branches/MAPREDUCE-233/src/examples/org/apache/hadoop/examples/terasor...
- 09:39 AM Bug #9679: Ceph hadoop terasort job failure
- Teragen command:
./hadoop/bin/hadoop jar ./hadoop-2.4.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.4.1.jar t... - 09:22 AM Bug #9679: Ceph hadoop terasort job failure
- Thanks for adding this. What command did you use to generate the input?
- 09:04 AM Bug #9679 (Closed): Ceph hadoop terasort job failure
- Hadoop version: 2.4.1
Ceph version:
ceph --version
ceph version 0.85-986-g031ef05 (031ef0551ebc98d824075558e884... - 07:03 AM Bug #9636 (Duplicate): segfault in CInode::get_caps_allowed_for_client
- 07:02 AM Bug #9562 (Resolved): Lockdep assertion in Filer purge
- Backported to giant:...
- 07:02 AM Bug #8576 (Need More Info): teuthology: nfs tests failing on umount
10/06/2014
- 06:27 PM Bug #9674: nightly failed multiple_rsync.sh
- rsync return codes aren't standard error codes. The man page says that 23 means...
- 05:59 PM Bug #9674: nightly failed multiple_rsync.sh
- #define ENFILE 23 /* File table overflow */
maybe we should adjust ulimit - 02:23 PM Bug #9674 (Resolved): nightly failed multiple_rsync.sh
- http://qa-proxy.ceph.com/teuthology/teuthology-2014-10-03_23:04:01-fs-giant-distro-basic-multi/527949/...
10/03/2014
- 02:50 PM Feature #9659 (Duplicate): MDS: support cache eviction
- It would be really useful when writing certain kinds of tests (eg, for scrubbing) to be able to know that a particula...
- 06:52 AM Bug #9636: segfault in CInode::get_caps_allowed_for_client
- looks like it's the same as #9628
10/02/2014
- 02:15 PM Bug #9514 (Resolved): ceph-fuse pjd test is failing in giant nightlies
- Dumpling commit:5f601f099be98c2b061cc94fb06917e7543f3efe
Firefly commit:9fee8de25ab5c155cd6a3d32a71e45630a5ded15
10/01/2014
- 10:42 AM Bug #9636 (Duplicate): segfault in CInode::get_caps_allowed_for_client
While doing ad-hoc killing of clients stuck on full cluster: unchecked dereference of session connection....- 06:18 AM Feature #7317 (In Progress): mds: behave with fs fills (e.g., allow deletion)
- 06:15 AM Feature #9437 (Fix Under Review): make 'ceph tell mds.* ...' work, deprecate 'ceph mds tell * ...'
09/30/2014
- 10:29 AM Bug #9562 (Pending Backport): Lockdep assertion in Filer purge
- This is popping up in Giant as well, which I believe has the new code that was the proximate cause. :)
- 10:27 AM Bug #9514 (Pending Backport): ceph-fuse pjd test is failing in giant nightlies
- In giant as commit:0ea20a668cf859881c49b33d1b6db4e636eda18a.
Needs to go to firefly as well. - 12:08 AM Bug #9628: mds: race between ms_handle_accept() and ms_handle_reset()
- https://github.com/ceph/ceph/pull/2596
- 12:08 AM Bug #9628 (Resolved): mds: race between ms_handle_accept() and ms_handle_reset()
- ceph version 0.85-1003-g3ae673c (3ae673c764a4fac6e554e05722f0179566ed3fb3)
1: (ceph::BackTrace::BackTrace(int)+0x2...
09/29/2014
- 08:18 PM Bug #9562 (Resolved): Lockdep assertion in Filer purge
- 04:43 PM Bug #9341: MDS: very slow rejoin
- John Spray wrote:
> The userspace change and test for this are merged into master. Is the kernel side all done too?... - 01:07 PM Bug #9341: MDS: very slow rejoin
- The userspace change and test for this are merged into master. Is the kernel side all done too?
- 04:33 PM Bug #9514: ceph-fuse pjd test is failing in giant nightlies
- 03:49 PM Bug #9514: ceph-fuse pjd test is failing in giant nightlies
- So here's a question: why does the client (temporarily) remember its ctime as being 2014-09-26 19:22:06.889397, but n...
- 02:58 PM Bug #9514 (In Progress): ceph-fuse pjd test is failing in giant nightlies
- Hah, we got the failure with logs in /a/sage-2014-09-26_17:51:11-smoke-giant-distro-basic-multi/513914
All of the ... - 01:15 PM Bug #8576: teuthology: nfs tests failing on umount
- Trying the sync on Sage's go-ahead. :)
commit:56223ce98b659fe7b25b55161ef8163495f438fc in teuthology. - 10:45 AM Bug #8576: teuthology: nfs tests failing on umount
- Is there any chance that just running a sync on the node prior to trying to "exportfs -au" might prevent this? I'm he...
Also available in: Atom