Project

General

Profile

Activity

From 04/16/2011 to 05/15/2011

05/15/2011

09:07 AM Feature #1089 (Resolved): obsync: deb/rpm package
Sage Weil

05/14/2011

09:07 PM Revision cd75a9d2 (ceph): osd: lazily close connections to down peers
If we hear from a peer that should be dead, tell them, but mark our
connection so that it will close after that messa...
Sage Weil
09:07 PM Revision a5b5aea4 (ceph): msgr: mark_down_on_empty and mark_disposable
Mark a connection to close when messages are sent, and to close on any
error. We can use this to tell people who sho...
Sage Weil
08:46 PM Revision 5ecc42b5 (ceph): PG: Remove downed osds from peer_missing and peer_info
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
08:42 PM Revision ba753630 (ceph): PG: Only pull the master log from a member of the prior_set
There must be a member of the prior_set such that no other
osd has a more recent last_update. This way, prior_set_af...
Samuel Just
12:26 AM Revision 6af0379e (ceph): rgw: Move rgw_log_level to md_config_t
Need to do this to get librgw to be usable as a standalone library
without unresolved symbols. Also, this makes it co...
Colin Patrick McCabe
12:16 AM Revision 56cab8ca (ceph): Makefile.am: add SimpleMessenger.cc to libcommon
libcommon depends on this file, and there's no other library that it
could go in. It is certainly silly to manually i...
Colin Patrick McCabe
12:10 AM Revision 924c000b (ceph): librgw: only include rgw_acl.cc and librgw.cc
Rather than putting all of RGW into librgw, only put rgw_acl.cc. Have
RGW use librgw instead of re-including the same...
Colin Patrick McCabe

05/13/2011

11:39 PM Revision 298e5c72 (ceph): rgw_acl: move constructors, destructors to .cc
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:28 PM Revision a17db024 (ceph): MDS: don't journal slave ops if we only have caps.
Previously we wanted to journal if we had caps on something. Now
that we're being strict about only journaling stuff ...
Greg Farnum
11:28 PM Revision b8ddecce (ceph): MDS: do journal on rename if we're auth for the inode.
We missed this case: we can be auth for the inode being moved without
being auth for the srcdn (first case) or owning...
Greg Farnum
11:28 PM Revision e8504c0b (ceph): uclient: do not accept max_size changes unless they're from auth mds.
Unlike most of the cap options, max_size is an inode member. This meant
that if we got a shared cap grant from a repl...
Greg Farnum
11:08 PM Revision 9847eb8b (ceph): rgw: put XML-to-bin translation into a librgw
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:08 PM Revision 883d1807 (ceph): librgw: small error handling fix
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:08 PM Revision 1c98da66 (ceph): librgw: use dout for logging
Use dout for logging so that the librgw library user can turn off or
redirect the logs if necessary.
Signed-off-by: ...
Colin Patrick McCabe
11:08 PM Revision 0dea92f6 (ceph): boto_tool.py: use s3-tests config file
boto_tool now grabs the configuration variables it needs from the
s3-tests config file, similar to s3-tests and test-...
Colin Patrick McCabe
11:08 PM Revision 50e41fbe (ceph): boto_tool.py: fix old-style argument-passing
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:08 PM Revision 6f4f702b (ceph): boto_tool.py: add --rmobjects, --rm_rf
Add some options to help destroy buckets.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
11:08 PM Revision 12deaaa4 (ceph): obsync: add DST_CONSISTENCY
The DST_CONSISTENCY variable allows us to specify that the destination
is expected to use read-after-write consistenc...
Colin Patrick McCabe
11:08 PM Revision bf81df27 (ceph): obsync: fix eventual consistency handler
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:19 PM Revision 3d4971b3 (ceph): Merge remote branch 'origin/osd_snap' into stable
Sage Weil
09:07 PM Revision 6e0e5532 (ceph): PG: search_for_missing takes the other osd's missing set
Previously, search_for_missing was erroneously passed the
primary's missing in a few places.
Signed-off-by: Samuel J...
Samuel Just
08:56 PM Revision e0d83fe7 (ceph): PG: search_for_missing takes the other osd's missing set
Previously, search_for_missing was erroneously passed the
primary's missing in a few places.
Signed-off-by: Samuel J...
Samuel Just
08:13 PM Revision 89a821c6 (ceph): radosgw_admin: fix clitest
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:59 PM Revision 8161122b (ceph): fix null deref when callback invoked en route from readdir_r rather tha...
Signed-off-by: Brian Chrisman <brchrisman@gmail.com>
Signed-off-by: Sage Weil <sage@newdream.net>
Brian Chrisman
04:59 PM Revision 72ca96e1 (ceph): add basic test case for readdir_r
Signed-off-by: Brian Chrisman <brchrisman@gmail.com>
Signed-off-by: Sage Weil <sage@newdream.net>
Brian Chrisman
04:31 PM Bug #1088 (Closed): osd: assert(is_up) failed when sending queries
This happened when I was stress testing the peering code with 10 osds running off one disk, streaming writes, and mar... Josh Durgin
01:51 PM Linux kernel client Bug #1086 (Resolved): rbd: iozone failure
Sage Weil
01:51 PM Linux kernel client Bug #1086: rbd: iozone failure
fixed by commit:1fec70932d867416ffe620dd17005f168cc84eb5 Sage Weil
09:10 AM Linux kernel client Bug #1086: rbd: iozone failure
i just noticed this comment didn't post yesterday, no wonder yehuda didn't know what i was talking about :)
here:
...
Sage Weil
06:29 AM Linux kernel client Bug #1086: rbd: iozone failure
The problem is that our use of blk_end_request is wrong, as it assumes ordering on the requests completion. In most r... Yehuda Sadeh
10:23 AM CephFS Bug #1087: userspace Client readdir_r failing
Oh, I got it.
I don't really remember how the readdir works at this point, but if you follow the calls for libceph's...
Greg Farnum
10:16 AM CephFS Bug #1087: userspace Client readdir_r failing
Just thought about this some more... what I need to reconcile is any differences between ceph_ll_add_dirent and _read... Brian Chrisman
10:03 AM CephFS Bug #1087: userspace Client readdir_r failing
Yeah.. sorry about the context... this is in libceph testing.
ceph_readdir_r was already implemented when I looked a...
Brian Chrisman
09:33 AM CephFS Bug #1087: userspace Client readdir_r failing
Well, looking at this real quick I see:
29) lookup on readdir_r_test (succeeds, 0)
30) lookup on readdir_r_test/opene...
Greg Farnum
07:24 AM CephFS Bug #1087 (Resolved): userspace Client readdir_r failing
I chased this down a bit of a ways but there's a lot to look through.
This log is output from testceph with client d...
Brian Chrisman

05/12/2011

10:43 PM Revision 84644dc5 (ceph): uclient: compare _revoked_ caps when deciding whether to release.
cap->issued is already set to new_caps, so that branch was never taken!
Signed-off-by: Greg Farnum <gregory.farnum@d...
Greg Farnum
10:36 PM Revision 932f4eb0 (ceph): uclient: clear out cap->wanted when caps get revoked.
This ensures that we will send a response to the MDS letting it know
that we've revoked our caps.
Signed-off-by: Gre...
Greg Farnum
09:34 PM Revision 5e2b57d0 (ceph): uclient: be more careful about sending caps.
This should prevent us from "losing" caps off the dirty list. See
#1063. If we have dirty caps we don't want to short...
Greg Farnum
06:01 PM Revision 91a268ed (ceph): radosgw_admin: dump log by object
instead of only by date+bucket.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
04:13 PM CephFS Bug #1063 (Can't reproduce): dbench breaks if MDS and client times aren't synced
I won't be surprised if this comes back again, but I can't reproduce it and there've been several fixes for client ca... Greg Farnum
03:50 PM Revision 30491e8f (ceph): updated test to cover "." directory stat
Signed-off-by: Brian Chrisman <brchrisman@gmail.com>
Signed-off-by: Sage Weil <sage@newdream.net>
Brian Chrisman
03:50 PM Revision 4456b6c3 (ceph): Add analogous special case for "." directory alongside ".." in _lookup
Signed-off-by: Brian Chrisman <brchrisman@gmail.com>
Signed-off-by: Sage Weil <sage@newdream.net>
Brian Chrisman
11:12 AM Linux kernel client Bug #1086: rbd: iozone failure
My comment.
I have the starting file size 4G (-n4g) because on this server 4G memory. Into smaller files on the se...
Fyodor Ustinov
10:06 AM Linux kernel client Bug #1086: rbd: iozone failure
strangely, the file looks correct (before and after a remount):... Sage Weil
10:00 AM Linux kernel client Bug #1086 (Resolved): rbd: iozone failure
I was able to reproduce Fyodor's problem on rbd (latest kernel) and ext2:... Sage Weil
09:43 AM rgw Bug #1083 (Won't Fix): rgw: log by user, user+bucket
nevermind. we can just list the log objects directly from the .log pool. Sage Weil
09:11 AM Linux kernel client Bug #557 (Can't reproduce): BUG_ON(!session->s_num_cap_releases);
Sage Weil
09:10 AM Linux kernel client Bug #465 (Resolved): need to refresh osdmap when full flag is set
added bit to subscribe to next osdmap if current osdmap has full bit set. Sage Weil
08:55 AM Linux kernel client Bug #1071: rbd: mkfs.ext4 doesn't complete (but mke2fs -j does)
Blarg, I can't reproduce this consistently. That bisect is probably bogus. Sage Weil
08:54 AM Linux kernel client Bug #909 (Can't reproduce): ceph-client+ceph v0.25.1,iozone test, "libceph: tid 115358 timed out...
Sage Weil
04:21 AM Revision 935f7dc1 (ceph): mds: drop unneed default arg
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:39 AM Bug #1085 (Won't Fix): bug in cclass
... Fyodor Ustinov
12:57 AM Revision 2655a2b5 (ceph): Merge branch 'osd_pgls'
Sage Weil
12:56 AM Revision a6417c6a (ceph): objecter: set pgls start_epoch field
For each pg, start out with start_epoch = 0 in the first request. For
subsequent requests, set it to the first reply...
Sage Weil
12:55 AM Revision 8a1644ef (ceph): osd: add pgls start_epoch field
If the pgls.start_epoch is set, the cookie is only considered valid if the
osd pg interval has not changed since then...
Sage Weil
12:51 AM Revision 222126e8 (ceph): rgw: in S3 PUT, don't crash on Content-Length == 0
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:47 AM Revision 5c382d35 (ceph): objecter: fix calc_op_budget bit mask checks
Use the helpers; we need to mask out several bits and compare.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:45 AM Revision b6cccc74 (ceph): Objecter: switch handle_osd_map op resending around
We need to order the resend by tid. We could do that in a
set with a special-purpose comparison function, but just
sw...
Greg Farnum
12:27 AM Revision 1d29cc7c (ceph): rgw: in S3 PUT, don't crash on Content-Length == 0
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe

05/11/2011

11:52 PM Revision 5e4f6bae (ceph): Objecter: implement operator<.
This will maintain ordering of Ops when they're in eg STL sets.
Previously Objecter::handle_osd_map would indiscrimin...
Greg Farnum
11:27 PM Revision c155a2b7 (ceph): osd: prepend missing objects to pgls results
This will prepend any missing objects to the set of objects returned by
a sequence of PGLS operations. Because recov...
Sage Weil
09:52 PM CephFS Bug #1084: blogbench won't finish: waiting for Fr cap forever
i initially thought something like this would work
diff --git a/src/mds/Locker.cc b/src/mds/Locker.cc
index 3c7...
Sage Weil
08:03 PM CephFS Bug #1084 (Resolved): blogbench won't finish: waiting for Fr cap forever
Run blogbench with kclient: blogbench -d /mnt/ceph/henry/b5/
Blogbench won't finish and keeps waiting for Fr caps of...
Henry Chang
09:00 PM Revision d9896b3c (ceph): obsync: handle eventual consistency issues
Handle eventual consistency issues so that obsync will be usable on more
S3 stores.
Signed-off-by: Colin McCabe <col...
Colin Patrick McCabe
08:58 PM Revision 7083777c (ceph): osd: remove weird commit_op_seq fast-forward
This doesn't serve any purpose that we can discern.
In fact, it might cause problems because it'd allow the journal ...
Sage Weil
08:58 PM Revision 82f9a923 (ceph): osd: key Missing::rmissing on version (not eversion)
This switches the key to the uint64_t (version_t) only, which is still
unique given a particular timeline (which is a...
Sage Weil
08:54 PM Revision f1af92fb (ceph): PG: choose_log_location, fix error when scanning up set
++up.begin() does not skip the primary. Primary might not be up[0].
Signed-off-by: Samuel Just <samuel.just@dreamhos...
Samuel Just
08:39 PM Revision 326d01b2 (ceph): osd: support rollback to cluster snapshot
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:27 PM Revision 2dc891f6 (ceph): Clock: add new clock_offset config option, and use it in g_clock.now()
This way we can test clock drifts without needing to actually
drift the clocks.
Signed-off-by: Greg Farnum <gregory....
Greg Farnum
08:11 PM Revision 7aed34c2 (ceph): clock: remove cruft.
There were some odd pieces that are artifacts of a very old and
different use. Remove them to simplify the interface ...
Greg Farnum
08:11 PM Revision 88641b88 (ceph): osd: trigger a store snapshot when the osdmap says to
Move the OSDMap decoding up a bit so that we can either snapshot or flush.
We can't do it after we take map_lock or e...
Sage Weil
08:10 PM Revision 6db09bac (ceph): filestore: add a snapshot command to create a snapshot of the entire store
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:10 PM Revision 918eeaf0 (ceph): mon: add 'osd cluster_snap foo' command
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:10 PM Revision 2ced4e24 (ceph): osdmap: add cluster_snapshot field
Add a cluster_snapshot marker in the map that is valid for a single epoch
to do a coordinated snapshot of the entire ...
Sage Weil
07:12 PM rgw Bug #1081 (Resolved): rgw: 500 error with x-amz-acl instead of explicit xml
yay fixed! patch is in next branch (for v0.28). Sage Weil
05:59 PM rgw Bug #1081: rgw: 500 error with x-amz-acl instead of explicit xml
should be fixed by 1d29cc7c7627683ba0ae2aa064abab4ea942b4e8.
Just need to test.
Colin McCabe
04:37 PM rgw Bug #1081: rgw: 500 error with x-amz-acl instead of explicit xml
Setting canned ACLs works for me in the tests I am running.
I am running more s3-tests, so maybe that will unearth...
Colin McCabe
03:43 PM rgw Bug #1081: rgw: 500 error with x-amz-acl instead of explicit xml
Here's a tcpdump snippet from s3-tests that works, compare against this to find the cause. (But 500 => there's an rgw... Anonymous
03:41 PM rgw Bug #1081: rgw: 500 error with x-amz-acl instead of explicit xml
When running $Conn->put_bucket_acl('berlertestobsync1', '', { 'x-amz-acl' => 'public-read' }); where $Conn is an S3::... Matthew Wodrich
03:41 PM rgw Bug #1081: rgw: 500 error with x-amz-acl instead of explicit xml
here's the full Response object (it contains the request object, so you can see what produced it)
$VAR1 = bless( {...
Steven Berler
03:22 PM rgw Bug #1081 (Resolved): rgw: 500 error with x-amz-acl instead of explicit xml
if something like
'_headers' => bless( {
                                                               'user-agent...
Sage Weil
06:56 PM Revision d3aa0c1e (ceph): PG: Replicas send Notifies in response to queries
Replicas only send Infos during activate.
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Samuel Just
06:42 PM Revision 151bf29d (ceph): Merge branch 'next'
Sage Weil
06:37 PM Revision 8d201d4b (ceph): librbd: tolerate ENOENT when trying to delete an object.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
06:37 PM Revision 484e6e6f (ceph): rados_sync: tolerate ENOENT when deleting an object.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
06:37 PM Revision 140886c8 (ceph): mdcache: check return values when purging an inode.
Previously we weren't looking, and if there's a problem
we probably shouldn't be moving on.
Signed-off-by: Greg Farnu...
Greg Farnum
06:07 PM rgw Bug #1083: rgw: log by user, user+bucket
actually, we can scratch problem 2.. each log entry apparently has the bucket owner at the time of the request. Sage Weil
04:19 PM rgw Bug #1083 (Won't Fix): rgw: log by user, user+bucket
problem 1:
- user creates bucket at beginning if day
- pumps full of data
- removes bucket at end of day
- we...
Sage Weil
06:06 PM Bug #1030 (Resolved): osd: list pool/bucket contents excludes missing objects
Sage Weil
06:04 PM Revision 1429d776 (ceph): test-obsync.sh: fix obsync unit tests
Fix the obsync unit tests to take into account the new ACL changes.
ACLs must be either translated or ignored when co...
Colin Patrick McCabe
05:28 PM Revision 0f42099a (ceph): expand testceph to check xattrs
Signed-off-by: Brian Chrisman <brchrisman@gmail.com> Brian Chrisman
05:28 PM Revision b0e0c361 (ceph): client: support security. namespace
Signed-off-by: Brian Chrisman <brchrisman@gmail.com> Brian Chrisman
05:28 PM Revision 3521771c (ceph): support for xattrs in libceph
Signed-off-by: Brian Chrisman <brchrisman@gmail.com> Brian Chrisman
03:47 PM Feature #1082 (Rejected): obsync: swift support
Sage Weil
01:48 PM Bug #1079: pgs stuck peering or degraded
The ones stuck in degraded were likely caused by the bug fixed in f1af92fb3d3bdab5a74ef40744028001d1943203. Samuel Just
01:33 PM Feature #1080 (Resolved): osd: cluster snapshot
create a snapshot of all osds so we can rollback the state of the entire osd cluster
warping back the monitor will...
Sage Weil
01:24 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
Scratch that, I did manage to reproduce locally. It just took a bit longer. Greg Farnum
01:07 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
On the other hand, adding a clock skew option and setting the MDS into the future doesn't let me reproduce the broken... Greg Farnum
10:10 AM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
Well, job 576 completed successfully after TV time-synced the cluster. Looks like bad mtimes are somehow causing the ... Greg Farnum
11:01 AM Bug #1078 (Resolved): rados remove fails silently on non-existent objects
Okay, I checked through these. A lot of callers don't pay any attention to the return code from remove but I looked a... Greg Farnum
10:13 AM CephFS Bug #930 (Resolved): libceph not exporting getattr
commit:3521771cb6bdb8eb0cbec7dc27a9999ddb494ad0 Sage Weil
04:35 AM Revision 3a8f36f5 (ceph): journaler: tolerate ENOENT when prezeroing
ENOENT is okay and expected.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
04:32 AM Revision d2243e82 (ceph): osd: unlink of nonexistent object should return -ENOENT
fixes bug #1078. Yehuda Sadeh
04:31 AM Revision f114cf18 (ceph): monclient: fix crash on shutdown
cur_con may be null on shutdown.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:46 AM Revision 6f340456 (ceph): Revert "osd: unlink of nonexistent object should return -ENOENT"
This reverts commit a7f87965f5c49fa878dadd458f87b7974252ab6e.
This commit breaks at least how Filer does zeroing. We...
Greg Farnum

05/10/2011

11:58 PM Revision 59995908 (ceph): Merge branch 'wip-merge-radostool-with-radossync'
Colin Patrick McCabe
11:54 PM Revision de640d85 (ceph): monclient: maintain explicit session connection; ignore stray messages
Maintain an explicit Connection handle to send messages and mark_down old
monitor connections. Ignore any incoming m...
Sage Weil
11:45 PM Revision 3425a8e5 (ceph): rados tool: integrate rados_sync with rados tool
* integrate rados_sync with rados_tool
* Improve rados tool usage a bit
* Rename test_rados_sync.sh to test_rados_too...
Colin Patrick McCabe
11:25 PM Revision 15756550 (ceph): rados tool: change initial argument parsing a bit
Use the ceph_argparse functions. Prepare to integrate with rados_sync.
Signed-off-by: Colin McCabe <colin.mccabe@dre...
Colin Patrick McCabe
10:23 PM Revision 203edaca (ceph): librados: don't crash if we call connect twice
Fixes: #1034
Reported-by: Wido den Hollander <wido@widodh.nl>
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:49 PM Bug #1078: rados remove fails silently on non-existent objects
probably needs
diff --git a/src/osdc/Journaler.cc b/src/osdc/Journaler.cc
index 9322ad2..6fbe3f8 100644
--- a/sr...
Sage Weil
05:11 PM Bug #1078 (In Progress): rados remove fails silently on non-existent objects
Yeah, it definitely hits other things. The MDS no longer starts up due to error codes coming back on prezeroing.
I...
Greg Farnum
02:23 PM Bug #1078 (Resolved): rados remove fails silently on non-existent objects
Fixed by commit:a7f87965f5c49fa878dadd458f87b7974252ab6e. Yehuda Sadeh
01:11 PM Bug #1078: rados remove fails silently on non-existent objects
This will fix it, however, I'm not sure either whether it was done on purpose or was just an oversight and/or how it'... Yehuda Sadeh
11:56 AM Bug #1078 (Resolved): rados remove fails silently on non-existent objects
Trying to remove a non-existent object produces no error. If this is intentional, it needs to be documented in the li... Colin McCabe
09:33 PM Revision d67dba76 (ceph): Merge remote branch 'origin/stable'
Sage Weil
09:20 PM Revision a7f87965 (ceph): osd: unlink of nonexistent object should return -ENOENT
fixes bug #1078. Yehuda Sadeh
06:16 PM Revision 331c01e8 (ceph): rados_sync: implement --delete-after, fix bugs
Implement --delete-after for both export and import.
Fix DIR* leaks.
Signed-off-by: Colin McCabe <colin.mccabe@drea...
Colin Patrick McCabe
06:16 PM Revision 6e55b237 (ceph): rados_sync: support --force
Support --force, which re-copies all objects all the time.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:16 PM Revision 001c18c1 (ceph): test_rados_sync: test --force
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:16 PM Revision 357910c5 (ceph): Allow dashes in ceph_argparse, etc.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:40 PM Bug #1079: pgs stuck peering or degraded
It looks like the degraded ones are staying that way because they need backlogs, but we didn't populate peer_backlog_... Josh Durgin
04:49 PM Bug #1079 (Closed): pgs stuck peering or degraded
Using the same setup as in #1073, but with 10 osds, the cluster recovered most pgs, but a few were stuck degraded, an... Josh Durgin
04:50 PM Bug #1077 (Resolved): integrate rados_sync with rados tool
implemented in 3425a8e5031a4f0c9c0eb85e8a329b02d05b9420 Colin McCabe
11:43 AM Bug #1077 (Resolved): integrate rados_sync with rados tool
As we discussed. Colin McCabe
04:36 PM Bug #1033 (Resolved): osd: CephxClientHandler::handle_response
commit:de640d85fa3e0e5e5a31704eab5a8714a1ffe867 Sage Weil
03:40 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
Okay, hopefully we can rerun this with a time-synced cluster soon and see if that's what is causing the breakage.
...
Greg Farnum
03:22 PM Revision d006c6f2 (ceph): osd: initialize oi.oloc if on-disk value is bogus
If the on-disk locator is undefined (upgrade of an old cluster?) initialize
the oloc fields based on the PG::Info.
R...
Sage Weil
03:04 PM Bug #1034 (Resolved): librados: Calling connect twice causes a segfault
Sage Weil
12:15 PM Revision f00edf73 (ceph): rgw: switch bucket creation operations
First we create the pool, then we create the bucket object. This
should have the effect of making the bucket creation...
Yehuda Sadeh
11:19 AM Bug #1074 (Resolved): rados_sync: implement --delete
implemented by 331c01e847c471980c31980a618c3bce3face50e Colin McCabe
10:47 AM Feature #1068 (Resolved): rados: incremental import/export
Sage Weil
10:47 AM Feature #1069 (Resolved): rados: support attrs in import/export
Sage Weil
10:04 AM Bug #1076 (Resolved): avoid sparse read for small reads
It doesn't make sense to make sparse read for reads that are smaller than the block size. This should either be in li... Yehuda Sadeh
09:43 AM Bug #1021 (Can't reproduce): osd: _process_pg_info FAILED assert(pg->log.tail <= pg->info.last_co...
Let's see if this comes up post-refactor. Sage Weil
09:43 AM Bug #1028 (Resolved): segfault in OSDMap::object_locator_to_pg
Sage Weil
04:53 AM Bug #1028: segfault in OSDMap::object_locator_to_pg
ok, it seems fixed. Now back to #1022 ar Fred
12:33 AM Bug #1028: segfault in OSDMap::object_locator_to_pg
Thank you for the patch, compiling right now.
This is indeed an old FS that got created approximately a year ago, ...
ar Fred
06:01 AM rgw Bug #1059 (Resolved): RGW consistency issues
Fixed now, commit:f00edf73284fc0f6e32973d16f58eb81f7b96bf8. However, this might have impact on performance. Yehuda Sadeh

05/09/2011

11:01 PM Revision 0ac419e0 (ceph): osd: drop bad warning
The stats won't match reality if there are any missing or if there are any
snapped objects.
Signed-off-by: Sage Weil...
Sage Weil
11:01 PM Revision 8e1e45c0 (ceph): osd: reset last_complete on mark_all_unfound_as_lost if no more missing
If we marked _all_ missing as lost, reset last_complete, since missing is
now empty!
Signed-off-by: Sage Weil <sage....
Sage Weil
11:01 PM Revision 70d8c994 (ceph): osd: simplify build_might_have_unfound
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:01 PM Revision 8a781f11 (ceph): osd: fix osd$foo typos
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:01 PM Revision 7a6b9b97 (ceph): osd: fix pollution of peer_info
The ++ postfix has no effect here! We really want +1.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
11:01 PM Revision 7ada5cd6 (ceph): osd: wait for up_thru updates
Before the primary can go active we need to wait for the up_thru in the
osdmap to reflect that we were alive during t...
Sage Weil
11:01 PM Revision 6d70592d (ceph): osd: log debug output for Crashed state
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:01 PM Revision 8cb861c3 (ceph): osd: rename Pending -> WaitActingChange
We only use the Pending state while waiting for the acting set to change.
Rename the state and log it appropriately s...
Sage Weil
10:18 PM Revision d9ea95f2 (ceph): rados tool: remove import/export
rados_sync replaces rados import / rados export
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
04:46 PM RADOS Feature #1075 (Resolved): crushtool: warn if uniform item weights vary
uniform bucket weights are ignored (and presumed uniform, hence "uniform"). Sage Weil
04:29 PM Bug #1073 (Resolved): osd: failed assert: info.last_complete == info.last_update
fixed by commit:7ada5cd685fcf3cae4e1c5d2dd81ea1817cceee7 Sage Weil
09:51 AM Bug #998 (In Progress): qemu/librbd race conditon
Christian Brunner had a similar error, but in aio_write during a yum upgrade. We should do more testing on this. Josh Durgin
09:05 AM Bug #1028: segfault in OSDMap::object_locator_to_pg
This problem is that the locator stored in the object_info_t on disk is wrong. Can you say anything about when the o... Sage Weil
05:28 AM rgw Bug #1035 (Resolved): incorrect rgw log data
This is already fixed, commit:a09eb0c33f6b05714bd4f780f79c70cb4529f840. Yehuda Sadeh

05/08/2011

11:30 PM Bug #1028: segfault in OSDMap::object_locator_to_pg
Cherry-picked 85292b367b0e6e6d8963de32ad198482500c887f into the stable branch, here are the logs... I kept the core f... ar Fred

05/07/2011

07:56 PM Revision 1cb611a0 (ceph): .gitignore: rados_sync
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
02:15 PM Bug #1073: osd: failed assert: info.last_complete == info.last_update
we only wait for up_thru updates if some_down:
if (prior.some_down) {
need_up_thru = true;
for (vect...
Sage Weil
01:51 PM Bug #1073: osd: failed assert: info.last_complete == info.last_update
this is wrong:
2011-05-06 17:33:48.284200 7f1466b56710 osd4 31 pg[0.12( v 21'17 (21'15,21'17] n=17 ec=2 les=11 31/...
Sage Weil
01:39 PM Bug #1073: osd: failed assert: info.last_complete == info.last_update
something is definitely going wrong here.. i see
2011-05-06 17:34:24.391722 7fe3aae59710 osd9 43 pg[0.12( v 21'17...
Sage Weil
05:10 AM Revision ea0a1395 (ceph): osd: fix compilation for some g++ versions
wasn't compiling on lenny, g++ ver 4.3.2. Might be that
it's also due to differebt boost version.
Yehuda Sadeh
04:59 AM Revision 25bfb987 (ceph): osd: reassert our assert definition after including boostchart
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:59 AM Revision f9ed9885 (ceph): assert: make our assert clobber any others too
Two can play this game, /usr/include/assert.h!
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
04:42 AM Revision 7db49499 (ceph): rgw: opening bucket io ctx stats bucket info if failed
this should trigger request of a new osdmap if we were racing
with bucket creation.
Yehuda Sadeh
04:42 AM Revision 588fe672 (ceph): rgw: minor cleanup
Yehuda Sadeh
12:43 AM Revision 290668c0 (ceph): Merge branch 'wip-rados-sync'
Colin Patrick McCabe
12:42 AM Revision fbe0bd1b (ceph): test_rados_sync: check that second sync does nada
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:33 AM Revision 210c38d2 (ceph): rados_sync: more fixes
* separate BackedUpObject::from_path and BackedUpObject::from_file.
* librados functions return negative values on e...
Colin Patrick McCabe

05/06/2011

11:50 PM Revision 85292b36 (ceph): osd: warn when obc locator doesn't match ops
This will hopefully help us track down #1028.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
11:41 PM Revision 5a726efc (ceph): rados_sync: fix memory leak, other misc fixes
* Store BackedUpObject in auto_ptr to avoid memory leaks
* better comment for BackedUpObject::get_fs_path()
* xattr...
Colin Patrick McCabe
11:26 PM Revision 5f7df9af (ceph): osdmap: refactor mapping; don't assert on missing pool
We were asserting on a pg with a missing pool fed to pg_to_acting_osds
because raw_to_temp_osds called raw_pg_to_pg. ...
Sage Weil
11:13 PM Revision a61484e6 (ceph): test_rados_sync: test xattr preservation
test xattr preservation across import/export
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
11:03 PM Revision 6b870bbd (ceph): test_rados_sync: add import/export test
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:01 PM Revision b169379c (ceph): rados_sync: complain if import src is inaccessible
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:55 PM Revision 010ffced (ceph): rados_sync: fix --create for import
Fix import's pool creation faculty.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
10:55 PM Revision e3212711 (ceph): add test_rados_sync.sh
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:24 PM Revision e00a8244 (ceph): client: map file stripes to acting osds
Old result was just wrong if any osds were down.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
10:18 PM Revision f2c94459 (ceph): rados_sync: fix import a bit
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:11 PM Revision 8a56a74d (ceph): rados_sync: nicer error formatting
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:07 PM Bug #817 (Won't Fix): Implement custom propose logic for OSDMap/PGMap
Sage Weil
10:07 PM Cleanup #755 (Resolved): Compartmentalize rados.cc
Sage Weil
10:05 PM Bug #1028 (In Progress): segfault in OSDMap::object_locator_to_pg
Sage Weil
04:48 PM Bug #1028: segfault in OSDMap::object_locator_to_pg
added some debug checks in the code to track this one down, commit:85292b367b0e6e6d8963de32ad198482500c887f Sage Weil
09:57 PM Revision e9550b57 (ceph): common: be a little less scary in our startup warning
- be less scary
- be helpful and tell them where to go
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:47 PM Revision f98475da (ceph): rados_sync: misc bugfixes
Avoid using a temporary c_str pointer when it goes out of scope.
Complain if XATTR_FULLNAME is empty, as well as mis...
Colin Patrick McCabe
09:37 PM Revision 6b6617ef (ceph): rados_sync: nicer printouts
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:31 PM Revision a4936a5e (ceph): man: mkcephfs: small fixes
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:28 PM Revision 73facc19 (ceph): rados_sync: do_export: fix diff'ing
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:22 PM Revision 6c9698b4 (ceph): rados_sync: more improvements to xattr_test
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:21 PM Revision d74ecc26 (ceph): mkcephfs.man: update man page
Not beautiful, but at least it's accurate.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:13 PM Revision 415db79d (ceph): rados_sync: Add xattr_test
Add xattr_test to test if the underlying filesystem supports xattrs
Fix BackedUpObject::get_fs_path a bit.
Signed-o...
Colin Patrick McCabe
08:43 PM Revision fb84e6b2 (ceph): Merge branch 'stable'
Sage Weil
08:42 PM Revision 48d94f6e (ceph): osd: used fixed size types for fiemap/mapext/sparseread encoding
The client expects <uint64_t,uint64_t>, so this breaks on any 32-bit osd.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
08:15 PM Revision 739ab87d (ceph): cfuse: don't -d
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:15 PM Revision f757f134 (ceph): mds: don't journal src when not auth on rename
If we aren't auth for the srcdn, don't put it in the journal, or else we'll
barf on journal replay.
This fixes a cra...
Sage Weil
08:15 PM Revision 4fbd6c23 (ceph): mds: assert auth on journal_cow_dentry
We have no business doing cow (or journaling) non-auth dentries.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
07:25 PM Revision 621af5e3 (ceph): PG: choose_acting needs the value of the osd, not its index
This caused two osds to keep flipping the acting set between [2] and
[0,2] when osd.0 was far behind and needed a bac...
Josh Durgin
07:10 PM Bug #1074 (Resolved): rados_sync: implement --delete
Implement a --delete flag that will get rid of objects in the dest that aren't in the source.
Should be pretty sim...
Colin McCabe
07:06 PM Revision 2315a64e (ceph): Create rados_sync tool to back up rados pools
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:10 PM Revision 0edbc75a (ceph): stop.sh: Avoid bashisms.
I have a habit of running "sh -x stop.sh" whenever it seems
to fail, and that runs it with dash, not bash. Since it
d...
Tommi Virtanen
06:07 PM Revision 6ee6261c (ceph): stop.sh: Whitespace.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
05:42 PM Bug #1073 (Resolved): osd: failed assert: info.last_complete == info.last_update
I got this crash on several osds:... Josh Durgin
04:26 PM Revision 6c366c06 (ceph): osd: fix include in cosd.cc too
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:26 PM Revision 88875fba (ceph): osd: rearrange #includes to get our assert
Make sure we include boostchart headers before our common/assert.h so that
ours clobbers theirs. Otherwise the gener...
Sage Weil
04:10 PM Bug #1072 (Won't Fix): cfuse mount fails when monitors have incorrect time synchronization
I've run into this a few times, but this time was the most obvious.
client debugging:
2011-05-06 21:40:11.448803 7f...
Brian Chrisman
03:07 PM Linux kernel client Bug #1071: rbd: mkfs.ext4 doesn't complete (but mke2fs -j does)
bisected this down to
fatty:ceph-client 03:09 PM $ git bisect bad
77f38e0eeac290827f41fd2215ab82546b8f73b8 is t...
Sage Weil
09:51 AM Linux kernel client Bug #1071 (Resolved): rbd: mkfs.ext4 doesn't complete (but mke2fs -j does)
root@uml:~# mke2fs /dev/rbd0
mke2fs 1.41.12 (17-May-2010)
Filesystem label=
OS type: Linux
Block size=4096 (log=...
Sage Weil
02:14 PM CephFS Bug #1063 (In Progress): dbench breaks if MDS and client times aren't synced
Ran this with client debugging enabled (job 573). Not certain this is the problem, but it looks like the problem is t... Greg Farnum
02:04 PM Bug #1066 (Resolved): update mkcephfs man page
Sage Weil
01:45 PM rgw Bug #1059: RGW consistency issues
IIRC we settled on:
- if pool is not in the osdmap, check for the bucket object. if that also doesn't exist, retu...
Sage Weil
12:36 PM rgw Bug #1059: RGW consistency issues
Other than one test that failed due to misconfiguration, the rest failed due to the async bucket creation. We should ... Yehuda Sadeh
10:58 AM CephFS Bug #1041 (In Progress): standby-replay fails on multi-mds fsstress journals
The problem is that the journal (for mds0) refers to mds1's stray directory. It's replaying a rename operation, where... Greg Farnum
09:40 AM rbd Bug #1070 (Rejected): krbd: ^C doesn't work
root@uml:~# dd if=/dev/zero of=/dev/rbd0 bs=1M count=100
^C
^C^C^C
100+0 records in
100+0 records out
10...
Sage Weil
04:42 AM CephFS Bug #1047: mds: crash on anchor table query
I alredy many times create cluster "from scratch", but log still available.
Full mds log from start after previous...
Fyodor Ustinov

05/05/2011

11:36 PM Revision 2ab3062b (ceph): PG: strays don't peer (only the primary does)
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:35 PM Revision 76febd2d (ceph): PG: clear peering flag when we transition from Peering to Reset
This is safe because the only other transitions are to Pending (still
peering) and Active, which clears the state its...
Josh Durgin
11:27 PM Revision d6ebf600 (ceph): mon: fix multi-osd 'ceph in|out N..' operations
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:24 PM Revision 3ee41ab8 (ceph): ceph_argparse: ignore dashes after equals sign
When parsing argv, ignore dashes after equals signs. This is so that
things like --log-file=/tmp/foo-file will work c...
Colin Patrick McCabe
11:17 PM Revision 57bc9b3f (ceph): Merge branch 'wip_pg_refactor'
Sage Weil
11:17 PM Revision 3b92d408 (ceph): Merge branch 'stable'
Sage Weil
11:12 PM Revision dc9be200 (ceph): osdmap: fix temp osd pg mapping
If you feed in a raw pg (full precision) you should get the same mapping
out as when you plug in the effective/reduce...
Sage Weil
10:24 PM Revision 58ea8358 (ceph): Merge branch 'stable'
Conflicts:
src/mds/Resetter.cc
Sage Weil
10:15 PM Revision 5c520fef (ceph): mon: do not stop mds0 unless all other nodes have also stopped
If we are the root node or the tableserver, we have to shut down last.
(And even then, if we have client sessions, we...
Sage Weil
09:36 PM Revision 6ac55729 (ceph): PG: handle MOSDPGLog messages in Active state.
We previously didn't, but we definitely need to as we can go
active while waiting on strays to send in logs to recove...
Greg Farnum
09:07 PM Revision 79b1a101 (ceph): ceph_crypto: Fix ceph::crypto::init mutex for NSS.
Even after ceph::crypto::shutdown, the library looked
already initialized; this broke the ForkDeathTest.MD5
in "make ...
Tommi Virtanen
08:42 PM Revision 44900d4c (ceph): v0.27.1
Sage Weil
08:38 PM Revision 27a48c1c (ceph): ceph::crypto::init: add PTHREAD_MUTEX_INITIALIZER
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
08:35 PM Revision 7d12d180 (ceph): mds: fix --reset-journal
Don't fork. (Already fixed in master branch by the start_with_nonce
refactor, so this is just for 0.27.1.)
Signed-o...
Sage Weil
08:27 PM Revision 86064491 (ceph): test-obsync.py: allow better nonce,better printout
Support deterministic nonces. Better debug printouts.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
08:27 PM Revision 28ccdf42 (ceph): obsync: remove misguided strip_owner
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
08:07 PM Revision 2ca61c92 (ceph): osdmap: small cleanup
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:07 PM Revision 8460cffa (ceph): libceph: initialize keyring after conf is parsed
Init the keyring in ceph_mount, after the user has a change to load a conf
file or parse command line args.
Signed-o...
Sage Weil
08:07 PM Revision e6dfcfda (ceph): fix some shadowing arguments
Small subset of what -Wshadow turns up.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
07:44 PM Revision 921d4b3d (ceph): crypto: fix non-reentrancy of ceph::crypto::init
This could be called multiple times from common_preinit.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:39 PM Revision 429bf1fe (ceph): test-obsync: use s3-tests configuration file
Use the same configuration file format as s3-tests. This should make it
easier for people to run obsync tests!
Signe...
Colin Patrick McCabe
06:20 PM Revision b8055b45 (ceph): osd: fix GetInfo down check
The PgPriorSet::down set can have lots of stuff it in without it affecting
peering completion. We just need to look ...
Sage Weil
05:55 PM Revision db4026d2 (ceph): osd: some comment, debug output cleanup
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:54 PM Revision a284e205 (ceph): osd: reg_last_scrub on pg load
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:22 PM Revision 2b1c61e4 (ceph): obsync: remove omit_owner for acls
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:19 PM Revision 6d8ddbc9 (ceph): obsync: Fix ACL parsing yet again
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:19 PM Revision b39bb462 (ceph): boto_tool: add getacl, setacl
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:19 PM Revision 24f641f8 (ceph): obsync: be more verbose about set_xml_acl errors
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:19 PM Revision 8964359c (ceph): obsync: implement --force option
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:09 PM Revision 5d77c543 (ceph): osd: GetLog, GetMissing cleanups, fixes
Added missing continue in GetMissing ctor.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
05:03 PM Revision fe988b11 (ceph): osd: only transition to Pending from GetInfo cons
No need to do so in get_infos(). The need_up_thru requirement will only
get better as last_epoch_started floor moves...
Sage Weil
04:39 PM Cleanup #1009 (Resolved): osd: push pg message handling code into ReplicatedPG
Sage Weil
04:38 PM CephFS Bug #1041: standby-replay fails on multi-mds fsstress journals
I've got a log in kai:~gregf/logs/fsstress/standby-replay Greg Farnum
04:37 PM Bug #910 (Resolved): Multi-MDS Ceph does not pass fsstress
Haven't seen any new issues! Greg Farnum
04:36 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
I'm unable to reproduce this on my own machine, and after looking through the mds logs from autotest everything looks... Greg Farnum
02:41 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
Job 560 has spent 1.5 hours in cleanup now, aborting.
14:40:26 DEBUG| [stdout] 2 19 0.00 MB/sec cle...
Anonymous
12:55 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
My bad, the cleanup phase starts at 600 seconds, so kclient only had a few seconds of cleanup.
The cfuse re-run is...
Anonymous
12:50 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
Job 555 broke, here's a re-run: http://autotest.ceph.newdream.net/afe/#tab_id=view_job&object_id=556
And that conf...
Anonymous
09:14 AM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
Note that the test I ran was on cfuse (most likely because I had kclient trouble, and wanted to isolate that out).
...
Anonymous
04:30 PM Revision d2865501 (ceph): osd: consistent naming
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:54 PM Revision 04e343c9 (ceph): osd: handle notify+info explicitly in GetInfo state
This fixes a few things:
- do not proceed past GetInfo if there are down osds. ever.
- if we get a new info that m...
Sage Weil
03:28 PM CephFS Bug #1047: mds: crash on anchor table query
BTW, if you know what directory the hard link(s) in this directory reference (it'll be the first time the linked file... Sage Weil
03:27 PM CephFS Bug #1047: mds: crash on anchor table query
It's the crash above, I take it?
Can you include a full mds log that ends with an 'ls' and crash?
It sounds lik...
Sage Weil
03:24 PM Bug #1048 (Resolved): MDS never finishes "stopping"
commit:5c520fefce50c29fbf05a174a37346d8f728c3ef
i suspect if we have no sessions there might be problems, but that...
Sage Weil
03:18 PM Revision ade1fcb7 (ceph): osd: statechart whitespace
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:14 PM Revision 565de261 (ceph): osd: initialize pg state event counters
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:12 PM Revision c24859f1 (ceph): osd: fix GetInfo querying
Don't query for info we already have, or have already requested. Remove
unneeded helper so that this is simpler and ...
Sage Weil
03:11 PM Revision 1fbefb32 (ceph): osd: handle event notify/info/log from Initial
We shouldn't post a creation event and jump into peering/stray based on
pg creation when we are about to process more...
Sage Weil
02:31 PM Feature #1069 (Resolved): rados: support attrs in import/export
store these as xattrs on the files... user.rados.* i guess! Sage Weil
02:30 PM Feature #1068 (Resolved): rados: incremental import/export
Skip objects when size/mtime and attrs match on source and destination. Or sync always. (Make it an option.)
We ...
Sage Weil
02:01 PM Bug #1058 (Resolved): pg_refactor: OSD crash when marking several out
Haven't seen a recurrence of this. Greg Farnum
02:01 PM Bug #1062 (Resolved): pg_refactor: active primary is getting MPGLog
Fixed my bug with commit:6ac5572946337e8e74b5014fc299e0ee10c70d9f and I think Sage already got his, too. Greg Farnum
01:35 PM CephFS Bug #1064: all mds's dies one by one after restart
Sage Weil
01:22 PM CephFS Bug #1064: all mds's dies one by one after restart
Hi Sergey,
Can you attach the full mds log for journal replay? (probably need to gzip, it'll be big!)
Also, ca...
Sage Weil
03:52 AM CephFS Bug #1064 (Can't reproduce): all mds's dies one by one after restart
At first all cfuse client hungs while trying access files on mounted ceph. I restart all nodes with ceph -a stop && c... Sergey Yudin
01:18 PM CephFS Bug #1065 (Resolved): mds: can't authenticate with --reset-journal
commit:7d12d1807fde72d6d87c732a0bda6b33bb4d8f7c Sage Weil
09:38 AM CephFS Bug #1065 (Resolved): mds: can't authenticate with --reset-journal
08:54:46 AM) Tsipa: trollface: when i'm running cmds -i 0 -c /etc/ceph/ceph.conf --reset-journal 0 i get messages lik... Sage Weil
01:16 PM Feature #1067 (Resolved): mkcephfs: magically group osds on same host into subtrees in the genera...
In theory we can look at the host field in the ceph.conf to generate a sane crushmap by default. As things stand, an... Sage Weil
11:11 AM Bug #1066 (Resolved): update mkcephfs man page
Sage Weil
10:36 AM rgw Bug #1059: RGW consistency issues
Here is my run of s3-tests. Looks like these tests failed:
test_s3.test_bucket_list_empty
test_s3.test_bucket_cre...
Colin McCabe
10:22 AM Bug #1057 (Resolved): obsync: implement --force
implemented by commit:8964359c9d0a56e72b64c81a2ceda1ec3c29c5be Colin McCabe
12:25 AM Revision d6347392 (ceph): rgw: don't output optional DisplayName if not set
Don't output optional DisplayName if not set. Be a little more explicit
about zeroing other optional fields during xm...
Colin Patrick McCabe

05/04/2011

11:44 PM Revision b5cb4c5e (ceph): osd: debug handle_*
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:19 PM Revision a544bda7 (ceph): rgw: don't assume XML is valid
XML parsing functions in RGW now return a bool, indicating whether they
were able to get the fields they needed to ou...
Colin Patrick McCabe
11:17 PM Revision 4d10126b (ceph): OSD: fill in rctx properly for pg->handle_create in get_or_create_pg
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
11:10 PM Revision 4d661999 (ceph): osd: rename states to reflect nesting; fix enter/exit msgs
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:10 PM Revision 9ebcd365 (ceph): osd: fix min_time in state stats
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:58 PM Revision d2c245c4 (ceph): osd: first pass at pg peering stats
The numbers are a bit off it seems. Also lots of potential for cleanup
here. But it (basically) works!
Signed-off-...
Sage Weil
09:36 PM CephFS Bug #1063: dbench breaks if MDS and client times aren't synced
this is probably a kclient thing.. testing against latest for-linus Sage Weil
04:56 PM CephFS Bug #1063 (Can't reproduce): dbench breaks if MDS and client times aren't synced
http://autotest.ceph.newdream.net/afe/#tab_id=view_job&object_id=554
one mds, one osd, cfuse
dbench never compl...
Anonymous
09:30 PM Revision 228e857e (ceph): OSD: assert contents exist when erasing from last_scrub_map.
Insert PG into last_scrub_map on creation so that this doesn't
break right away.
Signed-off-by: Greg Farnum <gregory...
Greg Farnum
09:12 PM Revision a347d180 (ceph): osd: use const char * state names
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
08:52 PM Revision ca7a3724 (ceph): PG: proc_replica_info, oinfo not info
The method param info shadowed PG::info. Samuel Just
08:05 PM Revision db8f96c9 (ceph): osd: move directly to Reset state on pg load
Add Initial -> Reset transition on pg load. This avoids doing any
activation-type stuff (like sending messages) befo...
Sage Weil
07:23 PM Revision d622a6fb (ceph): OSD: start PG state machine when loading pre-existing PGs
This caused a crash when restarting a killed OSD because the Initial
state was receiving the ActMap event.
Signed-of...
Josh Durgin
07:03 PM rgw Bug #1059: RGW consistency issues
Can you specify which tests are failing? I haven't seen this happening, but I was probably running it against a diffe... Yehuda Sadeh
04:40 PM rgw Bug #1059: RGW consistency issues
I think this issue is causing a lot of the s3-tests failures I'm seeing. Colin McCabe
03:27 PM rgw Bug #1059 (Resolved): RGW consistency issues
RGW is supposed to implement read-after-write consistency, but it often does not.... Colin McCabe
06:36 PM Revision c3fe4e3d (ceph): PG: ReplicaActive must repond to requests from discover_all_missing
If the peer does not yet have the pg during GetMissing, there won't be
a peer_missing entry for that peer. In that c...
Samuel Just
05:50 PM Revision c9859c2f (ceph): uclient: only try to update caps on the auth MDS.
Previously we would send updates on things like the max_size we
wanted to the first MDS in our list, which was bad if...
Greg Farnum
05:50 PM Revision d417fb0b (ceph): uclient: fill in InodeCap::wanted member on send_cap.
Previously it was never used, which I think led to spamming the MDS
with cap messages!
Hopefully this won't reveal a...
Greg Farnum
05:30 PM Bug #1053: rgw XML parsing exploits and flaws
that should read:
commit:a544bda7577321c4d6ecf7664a9363180984da56 and commit:d6347392634678b93f510f98d3d42407d05a956c
Colin McCabe
05:29 PM Bug #1053 (Resolved): rgw XML parsing exploits and flaws
I was afraid that there were more mistakes like #1055 in the code, but it looks like the other XML parsing stuff isn'... Colin McCabe
10:49 AM Bug #1053 (Resolved): rgw XML parsing exploits and flaws
RGW must never segfault on bad network input. It should handle optional XML fields. Colin McCabe
05:28 PM Revision 9c192e58 (ceph): PG: collapse crashed transitions to happen on any unexpected event
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
05:27 PM Revision 8d301d29 (ceph): PG: use a state_name member instead of overriding get_state_name
Also add debugging to each state constructor. Since dout uses
the recovery machine context, anything using it in the ...
Josh Durgin
04:57 PM Tasks #1055 (Resolved): RGW segfaults if the Owner field is not set in an ACL (subtask)
fixed by a544bda7577321c4d6ecf7664a9363180984da56 Colin McCabe
10:53 AM Tasks #1055 (Resolved): RGW segfaults if the Owner field is not set in an ACL (subtask)
The following code explains the situation quite well, I think:... Colin McCabe
04:52 PM Bug #1062: pg_refactor: active primary is getting MPGLog
I have a slightly different crash, but i think it's the same problem. see this:... Sage Weil
04:17 PM Bug #1062 (Resolved): pg_refactor: active primary is getting MPGLog
Logs are in kai:~gregf/logs/pg_refactor/active_gets_pglog
Same steps to reproduce as #1058.
Causes a crash in t...
Greg Farnum
04:17 PM Bug #1058: pg_refactor: OSD crash when marking several out
So the problem is that OSD::get_or_create_pg calls pg->handle_create using an rctx that is empty except for an empty ... Greg Farnum
02:09 PM Bug #1058 (Resolved): pg_refactor: OSD crash when marking several out
To reproduce:
1) Start up with 4 OSDs (using vstart)
2) mark two of the OSDs out
3) Wait a bit
4) Notice that the...
Greg Farnum
11:48 AM Bug #1057 (Resolved): obsync: implement --force
Implement --force, which causes all copies to happen, even if the source and destination appear to be in sync. Colin McCabe
11:46 AM Bug #1056 (Won't Fix): obsync: add warning when source owner is not the same as dest owner (after...
when -v is used, we should spit out a little message when we change the Owner during a source->dest copy Colin McCabe
10:54 AM Bug #1054 (Duplicate): RGW segfaults if the Owner field is not set in an ACL
re-created this as a subtask of 1053 (which I always wanted it to be)
Apparently you can't subtask-ize things afte...
Colin McCabe
10:51 AM Bug #1054 (Duplicate): RGW segfaults if the Owner field is not set in an ACL
The following code explains the situation quite well, I think:... Colin McCabe
10:16 AM CephFS Tasks #1039 (Resolved): cfuse: requests max_size from non-auth MDS
Looks good. Pushed to master in commit:c9859c2fc8005566ad6159a3d66e2ba10f82a986. Greg Farnum
05:48 AM Bug #1018: error on building ceph on red hat 5.5
I have had the same problem using 0,27 version.
The problem seems to be in libedit.
i have user libedit from RPMfor...
m6 m6
12:58 AM Revision 879d6b03 (ceph): Revert "osd: simplify check for unconsumed events"
This reverts commit ab34a3ce3e757a54816bd9b884c3f900361d4930.
It turns out that unconsumed_event supersedes checking...
Samuel Just
12:19 AM Revision 31f6a8cf (ceph): PG: Primary should also discard the ActMap event
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
12:03 AM Revision ab34a3ce (ceph): osd: simplify check for unconsumed events
No need for the Crashed pseudo state.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
12:02 AM Revision dda3261e (ceph): PG: ActMap should be dicarded if no outer state handles it
Samuel Just

05/03/2011

11:38 PM Revision efcab968 (ceph): osd: fix event names
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:38 PM Revision 71abe265 (ceph): osd: make debug output include state name
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:28 PM Revision 28fdffcc (ceph): PG.h: transition to crashed on unhandled message
Samuel Just
11:13 PM Revision fdc67915 (ceph): obsync: improve ACL handling again
LocalAcl: store ACLs in memory. They're very small, and the tempfile
stuff was just getting cumbersome.
LocalAcl.equ...
Colin Patrick McCabe
10:52 PM Bug #1040: obsync: preserve content-type, misc metadata
note to self: The "miscellaneous metadata" is found in the X-amz-meta headers. Colin McCabe
10:51 PM Bug #1052 (Resolved): obsync: add rados backend tests to test-obsync.py
I need to add tests for the rados backend to the test-obsync.py script. Colin McCabe
10:50 PM Bug #1051 (Resolved): obsync: create a librgw to parse binary ACLs generated by RGW
obsync: create a librgw to parse binary ACLs generated by RGW
This is already partially done in the wip-obsync-rad...
Colin McCabe
10:46 PM Bug #1050 (Won't Fix): obsync: implement --filter to allow certain objects in the source to be sk...
Colin McCabe
10:33 PM Revision 0802cfde (ceph): obsync: fix some bugs
* Allow parsing of AclPolicy elements that don't have owner_id fields.
* Put all XML attributes in the correct names...
Colin Patrick McCabe
10:31 PM Revision c71583d0 (ceph): osd: feed new pg mapping into state machine
instead of recalculating it. Also pass the last map into warm_restart,
while we're at it. Drop the Reset state cons...
Sage Weil
10:29 PM Revision d0dd5497 (ceph): osdmap: fix some constedness
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:38 PM Revision 39dc0846 (ceph): osd: turn off recovery oid sets
This is slow, eats memory, and dumps huge amounts of crap to the debug
logs when enabled. Leave it off unless we are...
Sage Weil
09:37 PM CephFS Bug #594 (Resolved): mds: frag split/merge vs replay
closing this out. the bugs i'm hitting now are rstat related or general issues not specific to frags and resolve/rej... Sage Weil
09:28 PM Revision 1a204a60 (ceph): Merge branch 'master' into wip_pg_refactor
Sage Weil
09:27 PM Revision b659fd02 (ceph): osd: only specify start version for Qeury::LOG
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:26 PM Revision 892e58d0 (ceph): PG: handle info in proc_replica_log just like we did in _process_pg_info
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
09:26 PM Revision c96f3e9b (ceph): PG: fix proc_master_log output
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
09:26 PM Revision 9c70fdfb (ceph): PG: send notifies when a stray or an active replica gets an ActMap
This was present before refactoring.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
09:26 PM Revision 258fe7c0 (ceph): PG: don't become clean in purge_strays
Our state is already clean here.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
09:26 PM Revision eac23e17 (ceph): PG: remove peer_info_requested member
This is internal to the GetInfo state now.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
09:23 PM Revision f175d27a (ceph): obsync: check if ACLs match
If all other aspects of two objects match, we should make sure the ACLs
match before deciding that there's nothing fo...
Colin Patrick McCabe
09:06 PM Revision 780ec44b (ceph): osd: use enum instead of const static int members
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:06 PM Revision a5f352cc (ceph): osd: leave recovery hooks in PG
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:08 PM Revision 90ee7cf9 (ceph): osd: fix pg log entry types to not always be delete
This was broken by the osd_trans work merged in 01f3526b62. We need to
use the obs reference to new_obs. This cause...
Sage Weil
07:37 PM Revision 85131220 (ceph): mon: add 'ceph osd rm N...' command
So we can mark an old osd as deleted and have it not appear in the osdmap
dump, summary count.
Signed-off-by: Sage W...
Sage Weil
07:36 PM Revision c0c20299 (ceph): Merge remote branch 'origin/stable'
Conflicts:
src/mon/OSDMonitor.cc
Sage Weil
07:34 PM Revision f680eca7 (ceph): osdmap: allow incremental to represent osd deletion
Convert new_down to new_state, with values xored onto the old state. We
preserve compatibility with old incrementals...
Sage Weil
07:28 PM Revision 890dc2ae (ceph): objecter: remove useless mark_down code
We already check sessions a bit further down, and this code only worked
when we got incrementals, not full maps. Tak...
Sage Weil
06:07 PM Revision f39f5c81 (ceph): test-obsync: test ACL translation, run unit tests
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:58 PM Revision 472d7bee (ceph): obsync: remove --owner, elide owner from ACL XML
Just omit the owner field from the ACL XML. It is optional anyway.
Don't supply an --owner switch. The owner will al...
Colin Patrick McCabe
05:20 PM Revision a6383e94 (ceph): obsync: better usage
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:19 PM Revision 789b9672 (ceph): OSD.cc: handle_pg_create fix initial last_epoch_started value
last_epoch_started == same_acting_since should not be true before the pg
goes active for the first time.
Samuel Just
05:19 PM Revision fe30d90a (ceph): TestSnaps.cc: default to testing with the data pool
Samuel Just
05:19 PM Revision 1b0dfcf5 (ceph): PG: Add gen_prefix method for generating the pg error prefix
This should make it easier to add dout macros for non-pg methods Samuel Just
05:19 PM Revision 1477c068 (ceph): PG: Refactor build_prior into a PgPriorSet constructor.
Samuel Just
05:19 PM Revision 21d8e72a (ceph): PG: Extract query map generation from recover_master_log
PgPriorSet::gen_query_map now generates the initial info query map. Josh Durgin
05:19 PM Revision f06269de (ceph): PG: choose_log_location
Choosing the master log holder and deciding whether to generate a
backlog are now handled by choose_log_location.
Josh Durgin
05:19 PM Revision 09f6d22d (ceph): OSD,PG: Move pg reset code from OSD::advance_map to PG
OSD::advance_map previously handled resetting the PG for peering. Now,
PG::acting_up_affected returns true if peerin...
Samuel Just
05:19 PM Revision 48eb343b (ceph): OSD,PG: Peering refactor
Previously, peering was handled by a defacto state machine in do_peer
and related methods. Peering state will now be...
Samuel Just
05:06 PM Revision a8a16c71 (ceph): obsync: only require --owner if --xuser is set
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
02:25 PM Bug #1049 (Resolved): obsync: synchronize ACLs
resolved by commit:f175d27a48b8bfdf83aeebd589211677b5db4073 Colin McCabe
02:14 PM Bug #1049 (Resolved): obsync: synchronize ACLs
If ACLs differ between the source and destination buckets, we should make sure they're synchronized. Colin McCabe
12:52 PM Bug #1045 (Resolved): master doesn't pass testsnaps while changing replication
This should be fixed by commit:90ee7cf91157413f8c6bff341d258772fef6ab9a Sage Weil
11:09 AM Bug #1038 (Resolved): obsync: support --xuser
Added to test-obsync.py Colin McCabe
10:59 AM CephFS Tasks #1039: cfuse: requests max_size from non-auth MDS
Testing out a fix now based on only updating max_size on the auth_cap but it'll take a few runs to verify and I want ... Greg Farnum
09:54 AM CephFS Tasks #1039: cfuse: requests max_size from non-auth MDS
So the replica mds0 caps are examined before the auth mds1 caps are, and then the client requests a new max_size from... Greg Farnum
09:47 AM CephFS Tasks #1039: cfuse: requests max_size from non-auth MDS
Okay, the replica MDS is behaving appropriately -- it's issuing only shared caps. It looks like the problem is that f... Greg Farnum
08:51 AM CephFS Tasks #1039 (In Progress): cfuse: requests max_size from non-auth MDS
Greg Farnum
10:51 AM Bug #1048 (Resolved): MDS never finishes "stopping"
Running "ceph mds stop foo" tells the MDS to stop, but it doesn't seem to be able to finish stopping.
This is on a...
Anonymous
10:45 AM Linux kernel client Bug #970: Kernel crash (cause?: lots of small files)
Make that ca20892db7567c40e8ed0668f46cf0d085d7db6d in for-linus instead. Anonymous
09:15 AM Linux kernel client Bug #970 (Resolved): Kernel crash (cause?: lots of small files)
Fixed in ceph-client.git master... Anonymous
05:12 AM CephFS Bug #1047: mds: crash on anchor table query
Now I have a directory 'ls' in which make crash mds. Fyodor Ustinov
04:48 AM CephFS Bug #1047 (Resolved): mds: crash on anchor table query
Attempt delete directory with backup created by BackupPC.
2011-05-03 14:12:37.288166 7fcc61d6f700 mds0.cache.dir(1...
Fyodor Ustinov
01:41 AM Revision 441b54c1 (ceph): obsync: implement --owner
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:23 AM Revision 5ac87ffd (ceph): cfuse: encode/decode dev_t properly
The fuse layer passes through "encoded" dev_t values (probably for
compatibility reasons or something). I copied the...
Sage Weil

05/02/2011

11:54 PM Revision 8bd2305d (ceph): obsync: implement user translation (--xuser)
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:57 PM Revision fa2da0c5 (ceph): rgw: fix ACL XML generation
Put AccessControlPolicy in the http://s3.amazonaws.com/doc/2006-03-01/
namespace.
Signed-off-by: Colin McCabe <colin...
Colin Patrick McCabe
09:47 PM Revision 931b5804 (ceph): obsync: refactor LocalCopy
Combine LocalCopy, S3StoreLocalCopy, and RadosStoreLocalCopy into one
class called LocalCopy.
Signed-off-by: Colin M...
Colin Patrick McCabe
08:47 PM Revision 1701804d (ceph): FileStore: use proper object names for linking
They were backward before, which broke EVERYTHING.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
08:16 PM Revision ac23196b (ceph): MDS: fix handle_client_rename use of path_traverse.
It was using the MDS_TRAVERSE_DISCOVERXLOCK flag, which allows
path_traverse to return success if it encounters a NUL...
Greg Farnum
06:18 PM Bug #1046 (Resolved): rgw: changing object owners
We need to find out whether Amazon allows the object Owner to be changed by a setacl operation.
Actually, it break...
Colin McCabe
06:16 PM Bug #1013 (Can't reproduce): filejournal buffer::rebuild crash
Sage Weil
06:15 PM Bug #996 (Can't reproduce): osd: ReplicatedPG::do_osd_ops
Sage Weil
06:10 PM CephFS Bug #1031 (Resolved): dev node inconsistency between cfuse and kernel client
fixed by commit:5ac87ffd36c7a3561266d198726eefc9f6a11036 Sage Weil
04:57 PM Bug #1038: obsync: support --xuser
implemented by 8bd2305d1c244fc472693aa66ec2164c07612bcb.
Need to write some tests for test-obsync.py
Colin McCabe
10:24 AM Bug #1038 (Resolved): obsync: support --xuser
We need to support username translation. The users that exist on Amazon S3, RackSpace, or any other S3-compatible sto... Colin McCabe
04:49 PM CephFS Bug #1022 (Can't reproduce): every mds crash: Program terminated with signal 11, Segmentation fault.
I think the trail is cold on this one. Let's keep an eye out for this in case it comes up again. Sage Weil
03:53 PM Bug #1045 (Resolved): master doesn't pass testsnaps while changing replication
To reproduce:
1) start up cluster (I used 4 OSDs, 1 mon/mds)
2) start testsnaps
3) change pool replication (I set ...
Greg Farnum
03:23 PM Feature #1044 (Resolved): librbd: discard support
Sage Weil
02:52 PM Bug #1037 (Rejected): obsync: handle LFN for rados://
Sage Weil
01:12 PM Bug #1037: obsync: handle LFN for rados://
Right. I checked rgw, worked with the max bucket names and object names sizes allowed by the API. We should probably ... Yehuda Sadeh
12:57 PM Bug #1037: obsync: handle LFN for rados://
I don't think obsync has to do anything special; rados will now handle object names up to 4k (or whatever). The hash... Sage Weil
10:22 AM Bug #1037 (Rejected): obsync: handle LFN for rados://
However RADOS ends up doing LFN, we need to be able to do that, in order to support the rados:// backend.
Based on...
Colin McCabe
02:09 PM Bug #1043 (Resolved): Filestore is broken on object pushes
Got Yehuda to take a look at this, then pushed a patch that seems to fix it! Greg Farnum
12:39 PM Bug #1043 (Resolved): Filestore is broken on object pushes
This is probably a bug with transaction handling rather than pushes specifically.
Steps to reproduce:
1) Start a cl...
Greg Farnum
12:04 PM Cleanup #1042 (Resolved): need const iterator for bufferlist
There should be a bufferlist::const_iterator to match bufferlist::iterator.
The fact that we don't have this makes...
Colin McCabe
10:26 AM CephFS Bug #1041 (Resolved): standby-replay fails on multi-mds fsstress journals
Things break, figure out why. Greg Farnum
10:25 AM Bug #1040 (Resolved): obsync: preserve content-type, misc metadata
We should preserve the Content-Type of the object we got out of S3. We should preserve the miscellaneous metadata. (B... Colin McCabe
10:25 AM CephFS Tasks #1039 (Resolved): cfuse: requests max_size from non-auth MDS
See kai:/home/gregf/logs/fsstress/cfuse_caps
The export of caps seems to go well, and the client drops them, but t...
Greg Farnum
10:21 AM Bug #1036 (Won't Fix): obsync: handle LFN for file://
obsync needs to have a way to store long object names when given a file:// source or destination.
Otherwise, it's ...
Colin McCabe
10:16 AM Linux kernel client Bug #970: Kernel crash (cause?: lots of small files)
The same.
[ 1877.996453] libceph: msg_new can't allocate 512 bytes
[ 1877.996607] libceph: msg_new can't create t...
Fyodor Ustinov

04/30/2011

12:46 AM Revision 7d19f184 (ceph): mds: trim non-auth swallowed subtrees during resolve
Consider:
- peer auth for /foo
- ambiguous import /foo/bar
- peer claims /foo, swallows /foo/bar.
- disambiguate_...
Sage Weil
12:46 AM Revision 9e4e3452 (ceph): mds: fix replay of EFragment rollback
Remove from the uncommitted list.
Also, make uncommitted list updated unconditional: we need to do it even
if the in...
Sage Weil
12:17 AM Revision a09eb0c3 (ceph): rgw: log bytes received
Yehuda Sadeh

04/29/2011

11:15 PM Revision 03d82a3f (ceph): rgw_admin: dump also user email
Yehuda Sadeh
11:15 PM Revision 6a160190 (ceph): rgw: fix some logging problems
Yehuda Sadeh
09:48 PM Revision e97ce8ec (ceph): test/ceph_crypto: Check that the shutdown/fork/init trick works for NSS.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:10 PM Revision fc36eb6b (ceph): filestore: fiemap should close the fd
Yehuda Sadeh
09:09 PM Revision e4cdc583 (ceph): filestore: fiemap should close the fd
Yehuda Sadeh
08:19 PM Revision 264829b5 (ceph): common, cfuse: Hook into daemonization and shutdown/init NSS.
NSS cannot tolerate forks without this.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
Tommi Virtanen
08:17 PM Revision 98b08771 (ceph): msgr, common: Refactor to extract daemonization out of messenger.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
08:08 PM Revision 0e6bacc6 (ceph): msgr: Rename SimpleMessenger::start(daemonize, nonce) to start_with_nonce.
Otherwise, once we remove daemonize from the prototype,
all the existing ->start(false) calls will be taken
to mean n...
Tommi Virtanen
08:08 PM Revision 84454c24 (ceph): ceph_crypto: Assert that NSS initialization works.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
06:29 PM Revision 4107e296 (ceph): common_init: create common_init_daemonize
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:39 PM Revision 2d82fefc (ceph): config: Update sample config with more examples
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Signed-off-by: Wido den Hollander <wido@widodh.nl>
Wido den Hollander
05:23 PM Revision 2047b59d (ceph): common_init: set log_file, not log_dir, by default
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:21 PM Revision 689a1bdd (ceph): common_init: don't modify log_per_instance
check it in DoutStreambuf instead.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
04:49 PM Revision 0a2d3f25 (ceph): msgr: remove dup .start() call check, remove cruft
There is now no ordering constraint wrt the daemonize bits; those can
safely be pulled out.
Signed-off-by: Sage Weil...
Sage Weil
03:43 PM Revision e0ec4138 (ceph): hadoop: cleanups for libceph type update
Signed-off-by: Jim Schutt <jaschut@sandia.gov>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Jim Schutt
03:28 PM rgw Bug #1035 (Resolved): incorrect rgw log data
bad data in the following fields:
- HTTP status
- Object size
- Data sent
Need also to verify that there are...
Yehuda Sadeh
10:59 AM rgw Bug #1025 (Resolved): s3-tests should test S3 object extended attributes ("developer-added metada...
a test that checks creation of custom metadata has been added at commit:5861b129bc6097cb5e758f58c39ff4d0d8a69fa7. Yehuda Sadeh
07:22 AM Linux kernel client Bug #970: Kernel crash (cause?: lots of small files)
... DongJin Lee
05:44 AM Bug #1034 (Resolved): librados: Calling connect twice causes a segfault
While working on phprados I called rados.connect() twice by accident, this resulted in:... Wido den Hollander
02:31 AM Bug #1033 (Resolved): osd: CephxClientHandler::handle_response
On one of my OSD's I noticed the following crash:... Wido den Hollander
01:08 AM Bug #1032 (Can't reproduce): osd: Marked down and become zombies after killing
I've discussed this a bit with Tv on IRC, but it's still unclear to me what is really happening.
At first I saw OS...
Wido den Hollander

04/28/2011

11:01 PM Revision c9712e4f (ceph): lfn: put lfn outside of user.ceph namesapce
This completely hides the lfn from the ObjectStore interface users.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
10:55 PM Revision 3a146f07 (ceph): mdsmap: show mds name in summary
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:52 PM Revision f4687421 (ceph): hadoop: update libceph types
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:52 PM Revision 347bc9f2 (ceph): hypertable: update libceph types
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:49 PM Revision 101506aa (ceph): libceph: error out if USE_FILE_OFFSET64 not defined
Otherwise struct dirent will not match user code and badness on readdir
will ensure.
Signed-off-by: Sage Weil <sage@...
Sage Weil
10:45 PM Revision 6e727a9b (ceph): Merge remote branch 'origin/master' into lfn
Sage Weil
10:44 PM Revision 95cea34e (ceph): lfn: don't return ENOENT if it's not lfn in some cases
Yehuda Sadeh
10:17 PM Revision e9fac67f (ceph): mds: ignore fragment_notify when dft state doesn't match
In particular, if there is a resolve in there somewhere, we may have found
out about this refragment from the src bec...
Sage Weil
10:02 PM Revision 1c58f806 (ceph): mds: do not send fragment_notify to <= recovering nodes
They will get sorted out during rejoin.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:57 PM Revision 26145838 (ceph): client: do not send request to mds -1
If we can't find a target, or the chosen target isn't active, wait.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:57 PM Revision 4f39fae0 (ceph): mds: handle import cancel while logging EImportStart
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:57 PM Revision 27ca30dc (ceph): mds: fix uninint warning on cur
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:57 PM Revision aee20973 (ceph): lfn: set hash and file name constants
Yehuda Sadeh
08:51 PM Revision 9b3c3aaf (ceph): osd: remove warning about max object name length
Yehuda Sadeh
08:44 PM Revision 87efc952 (ceph): mds: try_trim_non_auth_subtree on any canceled import (including resolve)
We were trimming on journal replay of an import failure, but not on a
canceled ambiguous import during resolve. Fix ...
Sage Weil
08:34 PM Revision e942a2a0 (ceph): mds: make trim_non_auth paths complete filepaths (not dnames)
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:22 PM Revision 21cc059e (ceph): mds: fix steal_dentry dir_auth_pins adjustment
Pass down the correct value for dir_auth_pins (dh->auth_pins plus the
inode's auth_pins, but nothing nested beneath t...
Sage Weil
08:08 PM Revision 81041de1 (ceph): mon: use tcmalloc
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:00 PM Revision 8e4eed58 (ceph): mds: fix export_prep trace format
The prep message includes a spanning tree in the interior of the subtree
that includes all parent inodes of bounding ...
Sage Weil
07:42 PM Revision 47afbdae (ceph): mon: make 'ceph osd (down,out,in) N' take mulitple osd numbers
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:34 PM Revision 5d6718e6 (ceph): libceph: no _t types
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
06:24 PM Revision 4b9c093c (ceph): lfn: short fn length is constant and accurate
also, disabling real hashing for now Yehuda Sadeh
06:16 PM Revision c8859f04 (ceph): osd: bump up max object name size
Yehuda Sadeh
06:15 PM Revision 7dd592aa (ceph): crypto: add support for SHA256
Yehuda Sadeh
06:11 PM Revision 1fd2784d (ceph): libceph: typedef struct mystruct *mystruct_t
Needed to drop the ceph_ prefix on the internal ceph_dir_result_t type
to prevent the ceph_dir_result_t typedef from ...
Sage Weil
06:04 PM Revision aad7006f (ceph): Merge commit 'origin/master' into lfn
Yehuda Sadeh
05:37 PM Revision deb27efb (ceph): libceph: include 'struct' in declarations for C compilation
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:09 PM CephFS Bug #1031 (Resolved): dev node inconsistency between cfuse and kernel client
A dev node created on a cfuse mount is displayed correctly by ls -l on the same mount point:
crw-rw-rw- 1 root roo...
Alexandre Oliva
04:38 PM rgw Bug #985 (Resolved): radosgw listing keys of a bucket with name >=251 characters fails with NoSuc...
Fixed, commit:95cea34e8d813236064c2d975e870c83e9224e00. Yehuda Sadeh
04:37 PM Feature #1008 (Resolved): filestore: handle long object names
Done, merged at commit:c9712e4ffcaf91e212f73bc95c1f18e062dd0f22. Yehuda Sadeh
04:33 PM Bug #1030 (Resolved): osd: list pool/bucket contents excludes missing objects
listing pool contents only lists objects stored locally, which excludes anything missing on the primary.
we could ...
Sage Weil
04:30 PM Revision 8aab0eca (ceph): mds: fix auth_pin check
The inode only gets an auth_pin if the dirfrag is not a subtree root.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
03:55 PM Revision d2a18f69 (ceph): config: Remove debug output in conf_get
Signed-off-by: Wido den Hollander <wido@widodh.nl>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Wido den Hollander
10:59 AM Cleanup #813 (Resolved): libceph interface cleanup
Sage Weil
12:08 AM Revision a61b5195 (ceph): Merge branch 'master' of ceph.newdream.net:git/ceph
Sage Weil
12:07 AM Revision a490d1e4 (ceph): mds: handle freeze completion delayed by frozen inode
We can't complete a freeze_tree if we are not a subtree and the parent
inode is frozen. If that's the case, we were ...
Sage Weil

04/27/2011

11:35 PM Revision f998bf64 (ceph): lfn: replace hash function
for some reason crashes when using libnss Yehuda Sadeh
11:34 PM Revision 0a80865f (ceph): mds: add 'mds debug auth pins' option
This counts dirfrag auth_pins and ensure the inode's nested_auth_pins
count is correct. Helped catch the bug fixed i...
Sage Weil
11:33 PM Revision d994e8b4 (ceph): mds: fix nested_auth_pin accounting on refragment
The diri gets an auth_pin on the first frag pin when it is not a subtree
root. When we are moving dentries between f...
Sage Weil
10:52 PM Revision 27135c9e (ceph): mds: maintain dn pinning invariants during freezing for refragmenting
fragment_mark_and_complete aims to complete the in-cache directory,
mark+pin every dentry, then drop a final auth_pin...
Sage Weil
10:09 PM Revision d6917cd7 (ceph): mds: freeze fragments during split/merge
Freeze the target fragment(s) before unfreezing the old fragment(s) to
avoid any weird events going off when the unfr...
Sage Weil
08:03 PM Revision af6ed098 (ceph): lfn: some more fixes
Yehuda Sadeh
07:16 PM Revision c9825f08 (ceph): automake: Make debug targets known but not built by default in non-debu...
With this, "./configure --without-debug && make -C src testceph" will work.
Before this, it would use make builtin ru...
Tommi Virtanen
06:24 PM Revision 63b0cfa3 (ceph): mds: remove erroneous fixme.
This is for the client map journaling, but that's handled
elsewhere within this function...no idea why it ever had
a ...
Greg Farnum
05:59 PM Revision d1116818 (ceph): mds: handle discovers that race with refragmenting
Consider:
- send discover on frag X
- X refragments
- we take the waiter and rediscover on frag Y
- we get the...
Sage Weil
05:52 PM Revision a76d5831 (ceph): mds: Replay new client sessions on slave-rename importing.
We've been logging the sessions for ages but never
actually opened them.
Signed-off-by: Greg Farnum <gregory.farnum@...
Greg Farnum
05:14 PM Revision 33d1ea0d (ceph): mds: pay attention to *stat staleness during split
Leave only the first frag stale, since we are already doing that with the
accounted_ differential.
Signed-off-by: Sa...
Sage Weil
05:00 PM Revision 7aef5444 (ceph): mds: merge accounted_* stats
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
01:14 PM CephFS Tasks #1002 (Resolved): Assert failure in Locker::handle_file_lock
Greg Farnum
10:29 AM CephFS Bug #92 (Resolved): mds: journal client_map for rename importing inode
commit:a76d5831929d57b1505101445317fce778f08ed3 Greg Farnum
10:07 AM Feature #709 (Resolved): nagios plugin
Sage Weil
06:57 AM Revision 512ab307 (ceph): obsync: use lxml to parse XML ACL
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
03:45 AM Revision 698b1ead (ceph): libceph: move header file to include/ceph/libceph.h
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
01:18 AM Bug #1029 (Rejected): ceph 0.27 run gceph, printf "Caught signal (Segmentation fault) " at a cli...

Hi ,
ceph 0.27,
I copy ceph.conf from a mon host to a client host /etc/ceph folder,
run "gceph" ,then printf " C...
changping Wu
01:00 AM Bug #1028 (Resolved): segfault in OSDMap::object_locator_to_pg
As reported yesterday on IRC, this is a crash I get when starting an OSD.
this is at v0.27
*From the logs:*
<p...
ar Fred
12:24 AM Revision 6f074241 (ceph): lfn: some fixes
Yehuda Sadeh

04/26/2011

11:49 PM Revision 12542c8a (ceph): lfn: amend long file name hashing
Yehuda Sadeh
11:46 PM Revision a68340e4 (ceph): mds: ignore resolve messages received prior to resolve stage
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:39 PM Revision 68c2b578 (ceph): mds: handle aborted export during pre-export sync
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:33 PM Revision 2f16916b (ceph): lfn: push cid/oid translation down
compiles now, not tested, probably doesn't work Yehuda Sadeh
11:28 PM Revision f6d1ccb6 (ceph): mds: drop messages to down mdss
...instead of asserting in MDSMap::get_inst.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
11:18 PM Revision dd183ca0 (ceph): mds: do not send heartbeat when degraded
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:09 PM Revision e37878e0 (ceph): mds: fix discover tid assignment
Hmm!
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
10:51 PM Revision 35efa2ba (ceph): vstart.sh: remove cruft
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:44 PM Revision 1f5b6202 (ceph): mon: fix standby-replay assignment (again)
Only assign a random node to standby-replay if they are marked as
STANDBY_ANY.
Signed-off-by: Sage Weil <sage@newdre...
Sage Weil
10:39 PM Revision 319c20f2 (ceph): auth: Avoid const mismatch in nss_aes_operation
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Signed-off-by: Jim Schutt <jaschut@sandia.gov>
Jim Schutt
10:37 PM Revision 9854e27f (ceph): configure.ac: check for supported compiler flags
Ancient versions of gcc, such as the gcc 4.1.2 in RHEL 5.5, don't
support some -W flags that newer versions do. Fix ...
Jim Schutt
10:31 PM Revision 00a25206 (ceph): vstart.sh: set up pairs for each rank when -s is on
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:26 PM Revision 28edbe5f (ceph): mon: rework assignment of standby-replay, expansion nodes
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:43 PM Revision 53a8e7d6 (ceph): mon: fix standby-replay assignment logic
Assign a standby-replay at any time based on rank, name, or no preference.
Previously this could only happen when the...
Sage Weil
08:40 PM Revision 01f3526b (ceph): Merge branch 'osd_trans'
Sage Weil
08:40 PM Revision 7c771108 (ceph): Merge remote branch 'origin/stable'
Sage Weil
08:40 PM RADOS Bug #1017: ceph 0.26 ,mkcephfs --crushmap crush.new ,wait for very long time,mds stat is still "...
hi
ceph 0.27
take the following steps ,this issue doesn't exist.
1.# crushtool --num_osds 6 -o file --build ho...
changping Wu
08:39 PM Revision 6025dee1 (ceph): osd: move watch/notify effects out of do_osd_ops
Apply watch/notify side effects in do_osd_op_effects() only if the
transaction will succeed.
Signed-off-by: Sage Wei...
Sage Weil
08:28 PM RADOS Bug #1016: ceph 0.26,crushmap change,mount fail.
Hi ,
ceph 0.27 ,
i take the following steps, this issue doesn't exit.
1).
root@ubuntu-mon0:/etc/ceph/crushmap# cr...
changping Wu
07:36 PM Revision 0aeab99c (ceph): obsync: implement RadosStore
Implement RadosStore, a storage backend which accesses librados
directly, without going through RGW (Rados GateWay).
...
Colin Patrick McCabe
07:34 PM Revision ccf11fbe (ceph): osd: mention invalid snapc in log
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
07:10 PM Revision 896de0ac (ceph): osd: include (some) osd op flags in MOSDOp print method
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:10 PM Revision b08ee2c6 (ceph): osd: add RWORDERED osd op flag
Order this op wrt reads the same way a read-modify-write would be.
(Otherwise we may get a fast/stale read result on ...
Sage Weil
06:23 PM Revision a44065d7 (ceph): radostool: fix getxattr / setxattr return code
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:04 PM Revision 9c2f0f0c (ceph): rbd: make showmapped output a bit prettier
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:55 PM Revision 539f6719 (ceph): rbd: showmapped
Show mapped rbd devices.
Fixes: #1024
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:49 PM Revision df1e1c80 (ceph): pybind-rados: fix Ioctx::close
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:39 PM Revision dd99226e (ceph): mds: only include head dentries in check_rstats() rstat check
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:35 PM Revision e643642b (ceph): osd: move ObjectState side effects out of do_osd_ops
We want to be able to handle a failure mid-way through an OSDOp
transaction and bail out with no side effects. This ...
Sage Weil
05:29 PM Revision 101ca58e (ceph): objectstore: implement Transaction::swap()
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:29 PM Revision f922b64e (ceph): objectstore: transaction::append()
Combine two transactions into one.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
05:29 PM Revision 424116f9 (ceph): buffer: use std::swap
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:07 PM Revision 604e76f5 (ceph): test-obsync.py: add tests with --no-preserve-acls
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
04:53 PM Revision 24133026 (ceph): osd: move snapset_context into ObjectContext from ObjectState
ObjectState is now just static info (object_info_t and bool exists).
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
04:53 PM Revision 3210fe70 (ceph): osd: remove obsolete noop cruft
The noop branching is all dead code.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
04:53 PM Revision a31a6c12 (ceph): objectstore: drop decode support for <= v0.19 encoded transactions
This only affects online upgrade or journal replay of v0.19 generated
transactions.
Signed-off-by: Sage Weil <sage.w...
Sage Weil
04:53 PM Revision 08265b1d (ceph): mon: fix pg stat summary
Had the pg state counts in there twice.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
04:40 PM Revision 9b30040d (ceph): mds: undump-journal
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
04:40 PM Revision a4c0cfac (ceph): buffer: break out read_fd method
Read N bytes from the provided fd into the bufferlist.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
01:26 PM Bug #963 (Resolved): osd: errors part way through multiple ops leave inconsistent object context
commit:01f3526b62891b36333d89981e83c444253fa8e0 Sage Weil
11:03 AM Feature #1024 (Resolved): rbdtool: list current kernel mappings
Sage Weil
10:49 AM rgw Feature #1027 (Resolved): rgw log operations on non-existent bucket
When logging an operation on non-existent bucket we should append the log on a special log object and not create an o... Yehuda Sadeh
12:15 AM Revision 55ae580e (ceph): rgw: check if bucket is empty before removing it
Yehuda Sadeh

04/25/2011

11:39 PM Revision 87ad8da6 (ceph): obsync: another fix for --no-preserve-acls
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:03 PM Revision 010cc35d (ceph): obsync: fix bug in --no-preserve-acls
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:09 PM Revision dcca1460 (ceph): mds: Don't twiddle lock states in the middle of an import.
This should have gone in a028c8954ca240ec9a12682678aaee02eb507ae3.
Signed-off-by: Greg Farnum <gregory.farnum@dreamh...
Greg Farnum
09:34 PM Revision 3f820413 (ceph): Merge branch 'stable'
Conflicts:
src/mds/MDLog.cc
src/osdc/Journaler.cc
src/osdc/Journaler.h
Sage Weil
09:32 PM Revision 904af336 (ceph): rgw: send content length on put operation
Yehuda Sadeh
09:31 PM Revision 99c347a3 (ceph): rgw: send content length on put operation
Yehuda Sadeh
09:14 PM Revision 6cc67880 (ceph): mds: wait for blacklisting osdmap on standby-replay -> replay final pass
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:14 PM Revision 885acf58 (ceph): journaler: separate out trimmed_pos setter
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:14 PM Revision 74644732 (ceph): mds: small journaler cleanups
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:14 PM Revision 68bafc06 (ceph): mds: only write head once after expiring logsegments
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:14 PM Revision b31400d7 (ceph): mds: always trim standby segments after rereading the head
When we re-read the head we may get an expire_pos that has moved forward in
time. That is the appropriate time to tr...
Sage Weil
09:14 PM Revision e8847b2c (ceph): mds: only move the journaler expire_pos forward
We were seeing weird trim errors because expire_pos was getting moved
backwards after a standby-replay -> replay tran...
Sage Weil
06:07 PM Revision a59153ee (ceph): librados python binding: always use 64-bit offsets
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision ed7c583e (ceph): CephFSInterface: don't include Timer.h
We don't use it.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:05 PM Revision 0da60ead (ceph): client, libceph: clean up layout methods
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
06:05 PM Revision 34a72e1f (ceph): libceph: Remove *_precise
In Linux, struct stat includes nanosecond resolution already. No need to
create a separate stat structure that duplic...
Colin Patrick McCabe
06:05 PM Revision 4ebf73de (ceph): Client.cc: fix mode/flags confusion
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision e8ac7b5c (ceph): hadoop: get hadoop bindings to build again
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision 5b4690d8 (ceph): libceph: re-add set_default_preferred_pg
Hadoop needs it.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
06:05 PM Revision 8cb90183 (ceph): hadoop: re-add ceph_set_default_preferred_pg
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision 6b830d8b (ceph): hypertable: update bindings to use new libceph API
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision 57cfd767 (ceph): pybind-rados: fix read API
Read should have the arguments in the same order as pread.
Add a test for reading from a nonzero offset.
Signed-off-...
Colin Patrick McCabe
06:05 PM Revision 54782bf9 (ceph): libceph API change
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision bff3004f (ceph): Client: unmount should not be able to fail
If unmount fails, what is the API users supposed to do?
The client needs to be able to clean up after itself.
Signed...
Colin Patrick McCabe
06:05 PM Revision 66b84fa7 (ceph): hadoop: whitespace fixes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision 529ef2d5 (ceph): libceph: avoid DIR*, combine connect and mount
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision d3c0b420 (ceph): libceph: fix some bugs
Fix some bugs in libceph and testceph.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:05 PM Revision f7e51550 (ceph): testceph: add more tests
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision 0bd7ee50 (ceph): do_autogen.sh: don't clear CFLAGS, CXXFLAGS
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision e9fb106a (ceph): do_autogen: add -H for --with-hadoop
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:05 PM Revision 4d415071 (ceph): hadoop: convert to new libceph interface
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:21 PM Revision e38fc4f2 (ceph): mkcephfs: Fail if there are no mons defined.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
05:21 PM Revision 21504a06 (ceph): mkcephfs: Fail if a mon has no address set.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
05:20 PM Revision 3207c5df (ceph): mkcephfs: Remove temp dir, not just its contents.
Also fixes the case where no temp files were created in the dir.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dream...
Tommi Virtanen
05:15 PM rgw Bug #1026 (Resolved): rgw deletes non-empty buckets
Fixed, commit:55ae580e0c7c823acd6fef63218dcc8b45b536fd. Yehuda Sadeh
04:10 PM rgw Bug #1026 (Resolved): rgw deletes non-empty buckets
Yehuda Sadeh
05:01 PM Revision 829ca526 (ceph): journaler: fix flush completion when nothing to flush
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
04:44 PM Revision aca14f99 (ceph): journaler: default to readonly; fix asserts
Previously were were never in a readonly state, which made all the existing
asserts meaningless.
Signed-off-by: Sage...
Sage Weil
04:14 PM Revision 0c38da26 (ceph): vstart.sh: fix -s
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
02:43 PM rgw Bug #1025: s3-tests should test S3 object extended attributes ("developer-added metadata")
rgw should support it, tho it's not tested recently. So first step is to add it to s3-tests.git Sage Weil
02:41 PM rgw Bug #1025 (Resolved): s3-tests should test S3 object extended attributes ("developer-added metada...
From the S3 developer's guide, 2006-03-01, page 272:... Colin McCabe
02:34 PM CephFS Bug #92 (In Progress): mds: journal client_map for rename importing inode
Generally, importing node journals session info for the imported caps. During the cross-MDS rename paths it's not jou... Greg Farnum
02:07 PM CephFS Tasks #1002: Assert failure in Locker::handle_file_lock
Okay, this was the same problem as commit:a028c8954ca240ec9a12682678aaee02eb507ae3. Greg Farnum
01:28 PM CephFS Tasks #1002 (In Progress): Assert failure in Locker::handle_file_lock
This popped back up again. It appears to be the result of a newly-imported inode getting mixed (from sync), which sen... Greg Farnum
02:06 PM CephFS Bug #1023 (Resolved): just-recovered mds fails journaler assert (to > trimming_pos);
fixed by commit:e8847b2cddbadf4f31972b490d80944dcb9f992d and others Sage Weil
08:51 AM CephFS Bug #1023: just-recovered mds fails journaler assert (to > trimming_pos);
When it went fron standby-replay to replay a second replay thread was being forked. Cleaning this up in stable. Sage Weil
11:04 AM Feature #1024 (Resolved): rbdtool: list current kernel mappings
rbd kernel list|show? Sage Weil
11:02 AM Bug #910 (In Progress): Multi-MDS Ceph does not pass fsstress
Ran across at least one issue again.... Greg Farnum

04/24/2011

04:05 AM Revision a6ac9303 (ceph): mon: consisder osd recovery state in health check
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:04 AM Revision 2f95d920 (ceph): mon: include unfound count in pg recovery summary
Fixes: #1003
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil

04/23/2011

11:02 PM Revision 52b74811 (ceph): mon: fix up osd health report
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:08 PM Revision a9d12cb5 (ceph): mon: fix up pg health report
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:07 PM Revision 70640bf1 (ceph): mon: generalize health check a bit
Any PaxosService can return a status (or not).
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
09:32 PM Feature #975: osd: use fallocate(FL_PUNCH_HOLE) for zero
This doesn't appear to be in btrfs yet anyway.. let's wait! Sage Weil
09:27 PM Bug #1003 (Resolved): mon: health should show % degraded, unfound (and warn appropriately)
Sage Weil
08:09 PM Revision fcf095c7 (ceph): Merge branch 'master' of ssh://ceph.newdream.net/home/sage/ceph.newdrea...
Sage Weil
01:38 PM Feature #958 (Resolved): rbd: map/unmap kernel rbd device via rbd(?) tool
Sage Weil
12:22 AM Revision 4368e974 (ceph): Makefile.am: add -fno-strict-aliasing
Until we audit every place we have a typecast to make sure it's safe,
this should be off.
Signed-off-by: Colin McCab...
Colin Patrick McCabe
12:17 AM Revision 4fe53fca (ceph): Makefile.am: Wpointer-arith, Wstrict-null-sentinel
Add Wpointer-arith, Wstrict-null-sentinel, Winit-self
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe

04/22/2011

11:52 PM Revision 793034c6 (ceph): v0.27
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:41 PM Revision 4b547cbb (ceph): Makefile: add some new warnings to CXXFLAGS
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:39 PM Revision 268f1897 (ceph): clitests: fix osdmap unit test
Broken by removal of casdata in 8cd3f1cd2546a61bb5402fa374de7f37147dc3a0.
Signed-off-by: Sage Weil <sage.weil@dreamh...
Sage Weil
11:20 PM Revision 474be659 (ceph): mds: don't daemonize when doing journal reset.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
10:31 PM Revision 625e7851 (ceph): rbd: rename kernel add/remove to map/unmap
Unmap takes a device now, and uses the major number
to find the right sequence number in sysfs.
Also updated the man...
Josh Durgin
08:39 PM Revision f5e20331 (ceph): Merge remote branch 'origin/next'
Josh Durgin
08:34 PM Revision 4cc88f62 (ceph): common, mount.ceph: move functions for working with secrets into secret.h
Use sprintf instead of safe_cat, since we're just writing a string once.
Signed-off-by: Josh Durgin <josh.durgin@dre...
Josh Durgin
08:34 PM Revision 20719c7a (ceph): rbd: use rados' init_with_config because we already called common_init
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
08:34 PM Revision bffb9edf (ceph): addr_parsing: move implementation out of header
Also include missing headers and make it linkable with C,
since it's duplicated from mount.ceph.
Signed-off-by: Josh...
Josh Durgin
08:34 PM Revision def36668 (ceph): addr_parsing: rename mount_resolve_dest to resolve_addrs and don't modi...
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
08:34 PM Revision 2ff3c82b (ceph): addr_parsing: use strtok_r to be safe
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
08:34 PM Revision 98698596 (ceph): mount.ceph: use common implementations of secret handling and address r...
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
08:34 PM Revision c87fc696 (ceph): rbd: add commands for manipulating the kernel sysfs interface
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
07:30 PM Revision 88ebb304 (ceph): Merge remote branch 'origin/next'
Sage Weil
06:37 PM Revision 8cd3f1cd (ceph): osd: drop 'casdata' bucket by default
We don't use it for anything. It just means we create a bunch of useless
PGs.
Signed-off-by: Sage Weil <sage@newdre...
Sage Weil
06:37 PM Revision cb8237e1 (ceph): testlibrbd: fix signed/unsigned comparisons
testlibrbd.c: In function 'write_test_data':
testlibrbd.c:191: warning: comparison between signed and unsigned intege...
Sage Weil
05:33 PM Revision b419f3d7 (ceph): filestore: lfn_unlink removes the entry as last step
so that if it crashes in the middle of operation we're not left
with a hole in the list of objects. In case of a cras...
Yehuda Sadeh
01:37 PM CephFS Bug #1023 (Resolved): just-recovered mds fails journaler assert (to > trimming_pos);
3 mdses configured for standby-replay. mds.1 was active, the other two?!? (not sure) were apparently following it. ... Alexandre Oliva
12:17 PM Linux kernel client Bug #970: Kernel crash (cause?: lots of small files)
probably a memory leak? Sage Weil
12:13 PM CephFS Bug #1022: every mds crash: Program terminated with signal 11, Segmentation fault.
This looks like damage from a bug in the session journaling. Can you dump a copy of your journal so we can take a cl... Sage Weil
12:34 AM Revision 00ffafa8 (ceph): cmds: make journal-check mode run in the foreground.
daemonize does a bunch of stuff we don't want to do.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
12:10 AM Revision 804a6d6c (ceph): mds: massage handling of oneshot-replay.
We accidentally broke it in our last round of changes to support
standby-replay; patch it up again.
Signed-off-by: G...
Greg Farnum

04/21/2011

08:18 PM Revision 7979fa5c (ceph): OSDMon: make the defaults in reweight-by-utilization work.
an oload <= 100 fails out; set the new default to 120.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
05:06 PM CephFS Bug #1006 (Resolved): clean up cmds journal-check mode
Well, it will still take over the mds.a symlink if you start it up as a pre-existing MDS, but you shouldn't do that. ... Greg Farnum
06:22 AM CephFS Bug #1022 (Can't reproduce): every mds crash: Program terminated with signal 11, Segmentation fault.
A few seconds after startup, all my MDSes crash with the following message:... ar Fred
03:50 AM Revision 8109f745 (ceph): testlibrbd: fix signed/unsigned comparisons
testlibrbd.c: In function 'write_test_data':
testlibrbd.c:191: warning: comparison between signed and unsigned intege...
Sage Weil
03:50 AM Revision c8059372 (ceph): osd: drop 'casdata' bucket by default
We don't use it for anything. It just means we create a bunch of useless
PGs.
Signed-off-by: Sage Weil <sage@newdre...
Sage Weil
12:11 AM Revision 1cff807c (ceph): filestore: lfn fixes
also bumping up max object len to 2048, we'll probably want to change
that to a higher number (4096?), need to make s...
Yehuda Sadeh

04/20/2011

10:16 PM Revision 4e21db6e (ceph): auth: const cleanup
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:35 PM Revision 1421d70d (ceph): obysnc: use python2.5 compatible exception syntax
Apparently using "as" in "except" blocks is a new (and not
backwards-compatible) thing in Python 2.6.x. Who knew?
Si...
Colin Patrick McCabe
08:54 PM Revision 3d97c33b (ceph): PGMon: use the config observer framework
We now register observers on mon_osd_full_ratio and nearfull_ratio
to update the OSD full/nearfull lists.
Signed-off...
Greg Farnum
08:51 PM Revision 19408759 (ceph): filestore: fix getxattr
Yehuda Sadeh
08:51 PM Revision f940ee86 (ceph): ProfLogger: add NULL to KEYS in the config observer.
I believe that without the null pointer it will overrun into
uninitialized memory.
Signed-off-by: Greg Farnum <grego...
Greg Farnum
08:51 PM Revision 0e828416 (ceph): config: add comment clarifying virtual destructor.
Just in case anybody else is like me and gets confused.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
08:49 PM Revision e209db4a (ceph): PGMonitor: unregister the config obs in ~PGMonitor
Using the new unregister call, unregister the config observer in
~PGMonitor.
Signed-off-by: Colin McCabe <colin.mcca...
Colin Patrick McCabe
08:38 PM Revision 527ecd4d (ceph): config: add remove_observer
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:58 PM Revision 5b218b27 (ceph): filestore: introduce long-file-names
still needs testing, adjusting of constants and using a real hash function Yehuda Sadeh
05:58 PM Revision 7dc5a7f9 (ceph): PGMap: fill in full OSD sets on decode.
Previously these sets were only modified when applying an incremental,
which might have caused problems when restarti...
Greg Farnum
01:26 PM Feature #1010 (Resolved): mon: adjust mon-osd-[near]full-ratio on the fly
This seems to be working in master on commit:3d97c33bea5144cbe5ed1b40704f74fff1ec0fb1. Greg Farnum
10:19 AM Subtask #843 (Resolved): Decouple dout from g_conf
implemented by commit:42a7013907e312d864cfcf591cca932cf9f343b2 Colin McCabe
10:19 AM Bug #1011 (Resolved): config observer structure to eliminate SIGHUP requirement
implemented by commit:6e49c06ca90dc7aa696cbe298b4362dd4cb124ba, commit:8ebbd60a865605e7cc88e07b2b3f2f84521934a9 Colin McCabe
09:25 AM Bug #1021 (Can't reproduce): osd: _process_pg_info FAILED assert(pg->log.tail <= pg->info.last_co...
... Sage Weil
07:34 AM CephFS Bug #1019 (Resolved): mds: ~MDSlaveUpdate while on LogSegment list
Sage Weil
04:55 AM Revision 07f287c6 (ceph): Merge remote branch 'origin/classdist'
Sage Weil
12:59 AM Revision 8ebbd60a (ceph): conf: reopen proflogger on conf change
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:28 AM Revision 6e49c06c (ceph): conf: add observer framework
Objects can now register as configuration observers interested in a
subset of the configuration keys. The observers w...
Colin Patrick McCabe

04/19/2011

11:11 PM Linux kernel client Feature #42 (Resolved): Resize of rbd image
commit:e56433a0330b61e56489779e21f68fdc4c45f5be Sage Weil
10:33 PM Revision 36f00685 (ceph): cauthtool: -C not -c in man page
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:23 PM Linux kernel client Feature #819: robust nfs re-export
There are patches queued for .40 that also try LOOKUPINO on unconnected fh's. This all needs testing. Sage Weil
10:22 PM Linux kernel client Bug #811 (Can't reproduce): rbd warning and crash
Sage Weil
10:21 PM Cleanup #892 (Resolved): osd: remove class distribution infrastructure?
Sage Weil
10:19 PM Tasks #584 (New): do throughput scaling tests on sepia
Sage Weil
10:03 PM Revision 9a38acf0 (ceph): dout: remove DOUTSB_FLAG_STDOUT
This was used to implement log_to_stdout, but that doesn't exist any
more. Instead of we have log_to_stderr and the o...
Colin Patrick McCabe
10:03 PM Revision 433deec0 (ceph): dout: make dout a member of md_config_t
Since logging options are per-config, logically DoutStreambuf instances
should also be per-config. This also allows u...
Colin Patrick McCabe
10:02 PM Revision 0b6a023f (ceph): PGMap: add redo_full_sets() function for when ratios change.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
09:55 PM Revision af92e8bf (ceph): PGMap: always decode pg_remove.
pg_remove has been included for longer than we've had versions
in the struct, so this check for end is useless -- if ...
Greg Farnum
09:55 PM Revision a2613f82 (ceph): PGMap: add [near]full_ratio to the Incremental and encoding.
This way these ratios can be distributed by map updates.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
09:55 PM Revision 515c7677 (ceph): osdmon: Clean up debug output on map full flag.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
09:32 PM Revision f9056d0d (ceph): osd: better debug output on replay completion
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:13 PM Revision 634dfc90 (ceph): mkcephfs: allow a prebuild osdmap to be specified
Otherwise we'll create one with osdmaptool --createsimple with the default
generic settins.
Signed-off-by: Sage Weil...
Sage Weil
08:57 PM Revision ad71955a (ceph): cfuse, mds, dout: Do not create "rank" symlinks for log files.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
07:05 PM Revision 4428d1ec (ceph): Revert "Revert "autoconf: Complain if tcmalloc is not found.""
This reverts commit 05c281bfa9e9d69ea3d0197590950c8e6845a13a.
This should be okay now.
Sage Weil
07:05 PM Revision f6179fc3 (ceph): debian: Handle missing tcmalloc on Debian lenny.
lenny doesn't have a suitable libgoogle-perftools-dev, and
release.sh edits it out of build-deps. Detect that and tel...
Tommi Virtanen
07:05 PM Revision 0d98a62c (ceph): debian: Build without tcmalloc on non-i386/amd64.
This is not strictly needed as of 05c281bfa9e9d69ea3d0197590950c8e6845a13a,
but that reverting is hopefully only temp...
Tommi Virtanen
06:59 PM Revision bd7922a1 (ceph): remove old debian build helper scripts.
This is now handled by ceph-build.git
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
06:33 PM Revision 7c04f81c (ceph): mon: remove class distribution infrastructure
This is now the admin's job. Removes a lot of code with limited testing
and coverage.
We rev the internal monitor p...
Sage Weil
06:11 PM Revision deb0ee90 (ceph): osd: move ClassHandler.{cc,h} to osd/
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
06:09 PM Revision 964a0a6e (ceph): osd: load classes from a fixed location off disk
Simplify the class loading code to just load out of a local directory.
Do not request classes from the monitor.
Sign...
Sage Weil
05:28 PM Revision 54284c0a (ceph): common: add environment.cc/environment.h
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
04:51 PM Bug #1020 (Duplicate): osd: replay_queued_ops crash
duplicates 990. Working on a peering/recovery refactor which should take care of this. Samuel Just
02:35 PM Bug #1020 (Duplicate): osd: replay_queued_ops crash
... Sage Weil
04:50 PM Bug #906: clustered mds: lchown not setting uid/gid
Here's an idea: run the autotest say 10 times (after the test, ssh to the sepia machines and ensure they've rebooted,... Anonymous
04:43 PM Bug #906: clustered mds: lchown not setting uid/gid
Still unable to reproduce this locally, and running it again on the autotest cluster it didn't fail.
It's possible...
Greg Farnum
04:37 PM CephFS Bug #1006 (In Progress): clean up cmds journal-check mode
Okay, it's more broken than that -- somehow it ends up in standby-replay instead of oneshot-replay! Greg Farnum
04:25 PM Revision d55399ff (ceph): mds: remove MDSlaveUpdate from list on deletion
These are added to the LogSegment list on the slaves, but also need to be
removed from that list when we replay a COM...
Sage Weil
11:43 AM Linux kernel client Bug #1014: kclient can't complete fsstress on multi-mds cluster
Not high priority right now, so unassigning. Greg Farnum
09:13 AM CephFS Bug #1019: mds: ~MDSlaveUpdate while on LogSegment list
commit:d55399ffec224206ea324e83bb8ead1e9ca1eddc Sage Weil
08:52 AM CephFS Bug #1019 (Resolved): mds: ~MDSlaveUpdate while on LogSegment list
... Sage Weil
08:54 AM Bug #1015 (Rejected): ceph 0.26, mkcephfs : ERROR: error creating empty object store
You need to create the directory yourself and this is deliberate. It prevents administrators from not fully setting u... Greg Farnum
08:31 AM Bug #1018 (Can't reproduce): error on building ceph on red hat 5.5
building ceph on rh 5.5 i have obtained this error.
if g++ -DHAVE_CONFIG_H -I. -I. -I. -Wall -D__CEPH__ -D_FILE...
m6 m6
12:54 AM Revision 87def518 (ceph): common_init: move version printout to common_init
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:32 AM Revision ae0f5f03 (ceph): interval_set: slightly better API for erase
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:18 AM RADOS Bug #1017 (Closed): ceph 0.26 ,mkcephfs --crushmap crush.new ,wait for very long time,mds stat i...
Hi ,
ceph 0.26 + btrfs +ubuntu 10.04 x86_64;
we want to use a special crushmap when do mkcephfs,but wait for very v...
changping Wu
12:12 AM RADOS Bug #1016 (Closed): ceph 0.26,crushmap change,mount fail.
Hi ,
ceph 0.26 ,change crushmap,then at a client ,mount ceph ,but fail.ceph.conf/crush.new.txt/crush.origin.txt/ a...
changping Wu

04/18/2011

11:51 PM Bug #1015 (Rejected): ceph 0.26, mkcephfs : ERROR: error creating empty object store
Hi ,
when do mkcephfs ,if it doesn't create osdN directory manually, then ,mkcephfs fail.
1. ceph 0.26 + btrfs +ubu...
changping Wu
11:26 PM Revision faffcc56 (ceph): Change some global config options to env vars
Options that are inherently global, like malloc settings, and also
inherently debugging or profiling settings should ...
Colin Patrick McCabe
11:26 PM Revision e4e2b742 (ceph): Merge commit '8038c491ba90a8cbcd569e84d4cafc8bbdff81d5' into next
Sage Weil
11:23 PM Revision c93c6619 (ceph): Merge remote branch 'origin/stable' into next
Sage Weil
10:32 PM Revision 2e41f084 (ceph): journaler: fix do_flush adjustment
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:30 PM Revision bb4cfabc (ceph): osd: assert on query on deleting pg
This shouldn't happen; assert if it does.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
10:29 PM Revision 67721b00 (ceph): osd: do not create pgs on query
We do not need to create the pg on query. If we are a new replica we can
create it when we get the PGLog activate me...
Sage Weil
10:06 PM Revision b05f1ba4 (ceph): journaler: truncate/zero ahead of write position
Remove/zero objects N periods ahead of the journal write position. This
ensures that when we reprobe the journal len...
Sage Weil
10:06 PM Revision 974d859e (ceph): filer: remove whole objects on zero()
Make filer::zero() remove any whole objects. This is required by the
Journaler, given the way it probes the journal ...
Sage Weil
10:06 PM Revision 0f0c1c85 (ceph): interval_set: implement erase(iterator)
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:06 PM Revision eaf52413 (ceph): Merge branch 'next'
Sage Weil
09:34 PM Revision e6393525 (ceph): journaler: check return code on _finish_write_head.
If we get an error code and assume we successfully wrote the head,
there are going to be all kinds of issues on repla...
Greg Farnum
08:55 PM Revision 68863bb4 (ceph): osd: make ZERO on non-existent object a no-op
Fixes bug where oi.size gets out of sync with the object size because we
actually write zeros. (This explains #933.)...
Sage Weil
08:12 PM Revision ab9dc122 (ceph): vstart tests: specify ceph.conf
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
08:12 PM Revision 42a70139 (ceph): dout: remove references to g_conf
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
07:54 PM Revision 878f4a45 (ceph): rgw: return appropriate error for unresolvable email in acl
Yehuda Sadeh
06:53 PM Revision b8e791bc (ceph): config: reorder config_option struct members
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:52 PM Linux kernel client Bug #1014 (Closed): kclient can't complete fsstress on multi-mds cluster
cfuse is doing great with fsstress on multi-mds systems now, but the kclient won't finish. Analysis is needed. Greg Farnum
06:48 PM Bug #910 (Resolved): Multi-MDS Ceph does not pass fsstress
I've been unable to break this under cfuse in master all day. Greg Farnum
06:47 PM CephFS Tasks #1002 (Resolved): Assert failure in Locker::handle_file_lock
Greg Farnum
11:36 AM CephFS Tasks #1002: Assert failure in Locker::handle_file_lock
I suspect this got fixed up by some of the other changes, but want to leave it open for a little longer just to make ... Greg Farnum
06:44 PM Revision 3f275bcf (ceph): clitests: eliminate use of old-style section name
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:44 PM Revision 756a2acc (ceph): config: remove unused OPT_NONE type
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:44 PM Revision 8038c491 (ceph): clitests: fix radosgw_admin test
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:41 PM Revision 6058a36c (ceph): MDS: move slave rename xlock handling before finish_export_inode.
finish_export_inode changes states! That's not good for our checks,
so just handle unpinning and stuff before we fini...
Greg Farnum
05:41 PM Revision 14dd2994 (ceph): improve debug printing
Greg Farnum
05:41 PM Revision d8579833 (ceph): mds: Unify migration-handling code in _commit_slave_rename.
We need to handle locks and pins on exported inodes but we
were using a separate if block with its own (non-matching!...
Greg Farnum
05:40 PM Revision 6bd20815 (ceph): mds: _commit_slave_rename needs to drop auth_pins for exported xlocks.
Otherwise these pins are never dropped from the inode since we
don't go through our normal xlock teardown code. Now w...
Greg Farnum
05:40 PM Revision 1a6f4376 (ceph): MDS: Make _rename_apply inode import auth_pinning more intelligent.
We don't want auth_pins on the locallocks (they're never auth_pinned)
and we only want new auth_pins that are for loc...
Greg Farnum
05:40 PM Revision 478c6173 (ceph): mds: If we're a slave, clean up xlocks when we export an inode.
Because we can do an inode import during a rename that skips the usual
channels, we were getting into an odd state wi...
Greg Farnum
05:40 PM Revision 5299aabe (ceph): mds: properly drop imported xlocks.
Because we can do an inode import during a rename that skips the usual
channels, we were getting into an odd state wi...
Greg Farnum
05:36 PM Revision 97e357c4 (ceph): MDS: Server takes auth_pins for xlocks on imported inodes.
Should fix #934.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
05:15 PM Revision 216fd776 (ceph): objecter: resub ops on full->nonfull transition
This was broken a while ago during the last refactor. Whoops! Clean it
up to be smarter (and work at all).
Signed-...
Sage Weil
04:58 PM Revision 879adb61 (ceph): Merge remote branch 'origin/stable'
Conflicts:
src/osdc/Journaler.cc
Sage Weil
04:57 PM Revision c966410f (ceph): osd: show "full" or "nearfull" in osdmap summary line
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:56 PM Revision fa7061d2 (ceph): Merge branch 'rgw_uid'
Yehuda Sadeh
03:56 PM Revision 796528c3 (ceph): rgw: remove get_user_info() and clean up
rename all the get_uid_by_* to get_user_info_by_*, remove get_user_info()
and call the appropriate function instead (...
Yehuda Sadeh
03:32 PM Revision d8fe208d (ceph): rgw: store user info on all indexes in the same format
this breaks backward compatibility, we'll have to deal with that
later.
Yehuda Sadeh
03:15 PM Revision 11f1e2ef (ceph): rgw_admin: can lookup user by access key
Yehuda Sadeh
02:54 PM CephFS Bug #873 (Resolved): MDS journaler needs to truncate ahead of writes
commit:b05f1ba4c46976bd96a1df8a582dffd89860eb34 Sage Weil
10:53 AM CephFS Bug #873 (New): MDS journaler needs to truncate ahead of writes
Sage Weil
02:03 PM Bug #1013 (Can't reproduce): filejournal buffer::rebuild crash
... Sage Weil
12:41 PM rgw Bug #982 (Resolved): radosgw should fail with UnresolvableGrantByEmailAddress on add_email_grant ...
Fixed, commit:878f4a45ceebd3038a6983a97064b0fdcfec11fe. Yehuda Sadeh
10:12 AM rgw Bug #982: radosgw should fail with UnresolvableGrantByEmailAddress on add_email_grant to unknown ...
At this point, instead of returning an error, we just ignore the bad entry. Yehuda Sadeh
11:35 AM Tasks #1005 (Resolved): xlock is not unpinning during rename across MDSes
Looks like this is fixed. Greg Farnum
11:20 AM Bug #1012 (Rejected): Autotest: Measure RADOS IO performance under read and write loads
We've had sporadic but steady reports about writes starving reads. Write an autotest to measure various kinds of RADO... Greg Farnum
11:00 AM Feature #974 (Resolved): autotest: include ffsb benchmarks
Sage Weil
10:56 AM Bug #935 (Can't reproduce): ceph client heavy loading in Metadata server
Sage Weil
10:47 AM Bug #1011 (Resolved): config observer structure to eliminate SIGHUP requirement
Colin McCabe
10:11 AM rgw Bug #980 (Resolved): radosgw returns access_key instead of user_id when fetching acl
Fixed as of commit:796528c3db66d63d0bd75c880cb871d5e4f0322a. Yehuda Sadeh
09:58 AM Feature #1010 (Resolved): mon: adjust mon-osd-[near]full-ratio on the fly
The nearfull and full ratios are set in the PGMap constructor, and the lists for maintained privatley by PGMap. That... Sage Weil
09:42 AM Tasks #419 (Closed): 24/7 testing
Sage Weil
09:41 AM CephFS Bug #523 (Can't reproduce): cfuse locks don't wake on mds reconnect?
Sage Weil
09:37 AM Linux kernel client Bug #1004 (Resolved): hanging writes, bisected to i_state locking change
commit:283a85d Sage Weil
04:58 AM Revision d7789218 (ceph): mount.ceph: behave when CONFIG_KEYS is not compiled in
In that case we get ENOSYS. This also implies an old version of the client
and that we should fall back.
Signed-off...
Sage Weil
12:42 AM Revision d21bdd6e (ceph): radosgw_admin: Update manpage to new syntax
Signed-off-by: Wido den Hollander <wido@widodh.nl>
Signed-off-by: Colin McCabe <cmccabe@alumni.cmu.edu>
Wido den Hollander

04/17/2011

04:04 AM Revision 1eccc019 (ceph): MDS: Fix Locker::handle_reqrdlock for xlocked locks.
We previously dropped the request but that was inappropriate for that
one case because the replica has no way to trig...
Greg Farnum
04:03 AM Revision 79cac5ee (ceph): mds: Always _open_parents when opening a new snaprealm
Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Sage Weil
04:03 AM Revision a028c895 (ceph): mds: don't run all of try_subtree_merge on a rename across MDSes.
Previously we'd try and do the whole thing, which meant that
the replica got a lock twiddle before it had finished th...
Greg Farnum
04:02 AM Revision 6250e82c (ceph): mds: adjust LocalLock can_xlock_local().
I don't remember why we needed can_xlock_local() to begin with, but
I can tell that adding this get_xlock_by() check ...
Greg Farnum
04:02 AM Revision 5a65a04a (ceph): mds: Extend use of find_ino_peers.
Missed a few places that need it.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Signed-off-by: Sage Weil...
Greg Farnum
04:02 AM Revision bea966af (ceph): mds: Make use of find_ino_peers
Previously we just had to give up on ESTALE. Now
we can attempt to recover!
Signed-off-by: Greg Farnum <gregory.farn...
Greg Farnum
04:01 AM Revision 22e8519d (ceph): random commenting
Greg Farnum
04:01 AM Revision ace54db0 (ceph): MDS: Remove inappropriate assert from _logged_slave_rename.
The slave also can hold some auth pins from locks which the
master has asked it to grab. It's possible we can intelli...
Greg Farnum
04:01 AM Revision ac045dc3 (ceph): MDS: Server::handle_slave_rename_prep now accounts for dir snaplock.
Previously it ignored the auth pin required to hold snap xlock, which
is currently always held for a rename on a dir....
Greg Farnum
04:00 AM Revision 597e30ed (ceph): MDS: Don't move inode to snaprealms if not primary inode.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Greg Farnum
03:59 AM Revision 08bd2ef1 (ceph): MDCache: update assert to account for being a slave.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Greg Farnum
03:59 AM Revision 569cce39 (ceph): Server: push_projected_linkage in _link_remote
_link_remote_finish will pop the linkage if inc==true, so we'd
better push it to match!
Signed-off-by: Greg Farnum <...
Greg Farnum
03:59 AM Revision 5b825c3a (ceph): Server: ensure slave mdses have full dest tree
We were already taking rdlocks on the source tree, to make
sure that each slave MDS could traverse to the source dent...
Greg Farnum

04/16/2011

10:13 PM Cleanup #1009 (Resolved): osd: push pg message handling code into ReplicatedPG
There is a lot of code in OSD.cc that does PG-specific work, mostly in the handle_pg_* message handlers. Those in tu... Sage Weil
10:07 PM Feature #1008 (Resolved): filestore: handle long object names
extN and btrfs both limit filenames to 255 characters, but we want to store object names that are much longer than th... Sage Weil
10:03 PM Bug #906: clustered mds: lchown not setting uid/gid
This isn't popping up with single mds... probably a clustering thing. Sage Weil
09:42 PM Feature #1007 (Resolved): qa: osd failure and cluster recovery test(s)
We need tests of OSD failures that verify the cluster is able to recover. Eventually this will need to be fleshed ou... Sage Weil
09:33 PM CephFS Bug #994 (Resolved): EOpen reply on non-auth MDS is busted
I was wrong about the diagnosis before. Pretty sure commit:777bcba0 fixes this.
As for the non-auth caps, I forgo...
Sage Weil
12:20 AM Revision 544ce94a (ceph): rgw: basic support for separate uid and access key
Yehuda Sadeh
 

Also available in: Atom