Project

General

Profile

Activity

From 03/08/2012 to 04/06/2012

04/06/2012

09:07 PM Revision 8e1cc8ab (ceph): init-ceph: manage pid_file from init script
With upstart the daemon shouldn't manage the pid file itself. Move this
out of the default config and into the legac...
Sage Weil
08:48 PM Revision 81d2cbeb (ceph): config: move /var/run and /var/log defaults to config_opts.h
This flips the sense of the common_init defaults. Before, the alternate
defaults were filled in if it was a daemon. ...
Sage Weil
08:39 PM Revision dfa043df (ceph): config: {osd,mon}_data default to /var/lib/ceph/$type/$cluster-$id
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
07:26 PM Revision 2ceda946 (ceph): Merge branch 'stable'
Sage Weil
06:44 PM Revision 7680cdad (ceph): dencoder, rgw: make ceph-dencoder load much faster
by avoiding linking with unneeded shared objects.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
05:00 PM Revision 98326968 (ceph): encoding: use iterator to copy_in encoded length
This gives us a pointer to the position into the list where the final
length value will be copied. Previously we use...
Sage Weil

04/05/2012

09:55 PM Revision 689ac5d7 (ceph): v0.44.2
Sage Weil
09:53 PM Revision e0c4db9e (ceph): FileStore: do not check dbobjectmap without option set
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
09:25 PM Revision 38e24b1e (ceph): config: include /etc/ceph/$cluster.keyring in keyring search path
mkcephfs and the docs etc still write to /etc/ceph/keyring.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:25 PM Revision 57dff032 (ceph): config: expand metavariables for --show-config, --show-config-value
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:08 PM Revision 90e88a08 (ceph): Merge branch 'wip-cluster'
Reviewed-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com> Sage Weil
08:35 PM Revision cfee0333 (ceph): config: parse fsid uuid in config, not ceph_mon
Use the new OPT_UUID type.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
08:35 PM Revision 2c14c8b2 (ceph): config: add distinct UUID type
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
08:32 PM Revision 2c0dc47e (ceph): global: add -C or --cluster early args to specify cluster name
This will let you specify which cluster to talk to on the command line
(e.g., 'ceph -C foo ...' or when starting a da...
Sage Weil
08:32 PM Revision 930a669a (ceph): config: add cluster name as metavariable; use for config locations
Add a cluster name (default "ceph") to the config structure, and expand
$cluster in all config values.
Make the defa...
Sage Weil
08:25 PM Revision bda562fb (ceph): config: implement --show-config and --show-config-value <option>
Dump internal config value(s) to stdout and then exit.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
08:04 PM Revision f18b219a (ceph): test_workload_gen: fix logging
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:01 PM Revision 32b5d0f8 (ceph): config: remove obsolete bdev_* options
These were part of ebofs.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
07:59 PM Revision 1b769535 (ceph): Merge remote-tracking branch 'gh/wip-log'
Sage Weil
06:43 PM Revision 0e5d087c (ceph): README: update instructions
Needed to add submodule instructions.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
03:49 PM Revision 3d7f1db7 (ceph): Kernel: Pull linux-firmware from git
Signed-off-by: Mark Nelson <nhm@clusterfaq.org> Mark Nelson

04/04/2012

11:12 PM Revision 0df6fbd3 (ceph): rados: fix rados import
This fixes issue #2253. Wrong param order to fread().
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
08:56 PM Revision ba0fb3ed (ceph): cleanup-and-unlock.sh: helper to nuke and then unlock a set of nodes
I usually do something like
teuthology-lock --list-targets --owner scheduled_sage@metropolis > /tmp/b
./cleanup-an...
Sage Weil
08:54 PM Revision 3adf2bf9 (ceph): schedule_suite.sh: helper to schedule a suite
There's a bunch of stuff hardcoded in here, similar to the nightly, but
it's a useful starting point.
Sage Weil
04:21 AM Revision 0921c062 (ceph): config: drop loud ERROR prefix
This makes gitbuilder sad.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:03 AM Revision b9185bb2 (ceph): osdmap: allow row, room, datacenter, pool in conf for initial crush map
These work just like host and rack, except that they are optional.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:02 AM Revision 4313a2d8 (ceph): crush: don't warn on skipped types
It's perfectly okay to skip some.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:01 AM Revision 56a6aa7a (ceph): osdmap: set 'default' pool type correctly
Got this wrong in e85961167eb1f37f80f263257799e4e901d17e74
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil

04/03/2012

11:33 PM Revision dd7b84a5 (ceph): ceph-fuse: fix log reopen when -f is specified
Don't restart if it wasn't stopped.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
10:56 PM Revision 1836d467 (ceph): Added assertion to check that targets > roles
Signed-off-by: Mark Nelson <mark.nelson@dreamhost.com> Mark Nelson
10:56 PM Revision 95294027 (ceph): nuke: don't run umount when no xargs args
Gets rid of this noise:
INFO:teuthology.nuke:Unmount any osd data directories...
INFO:teuthology.orchestra.run.err:U...
Sage Weil
10:40 PM Revision e8596116 (ceph): osd: define more crush types
We don't use these by default, but this way they are there should someone
want to use them.
Signed-off-by: Sage Weil...
Sage Weil
10:35 PM Revision 2dbdadbe (ceph): test_rewrite_latency: check return value
Fixes warning
warning: test/test_rewrite_latency.cc:27:36: ignoring return value of ‘ssize_t pwrite(int, const void*...
Sage Weil
10:28 PM Revision 493344fd (ceph): Makefile: add mssing header
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:21 PM Revision d57d8af7 (ceph): rgw: throttle at num_threads * 2
If we throttle at num_threads, then nothing gets into the workqueue until
a worker thread is idle, which means you pa...
Sage Weil
08:44 PM Revision 1ef37ab8 (ceph): Merge remote-tracking branch 'gh/msgr-api-changes'
Reviewed-by: Sage Weil <sage@newdream.net> Sage Weil
08:41 PM Revision a31efd9c (ceph): filestore: print Sequencer name in debug output
And clean it up just a bit.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
08:22 PM Revision 756621d5 (ceph): msgr: clean up Pipe::do_sendmsg.
Document it as with the tcp stuff, remove an if(0)'d debugging block,
and remove the useless "sd" parameter since it'...
Greg Farnum
08:22 PM Revision 9f10a991 (ceph): msgr: write minimal documentation for the tcp functions.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
08:22 PM Revision e966c39d (ceph): msgr: make a bunch of stuff private.
Why were all these data members public? They're accessed by Pipes
and the Accepter and stuff, so maybe that's why...b...
Greg Farnum
08:22 PM Revision 096971d4 (ceph): msg: update the Dispatcher and Messenger documentation
Clarify what mark_down() and mark_down_on_empty() actually do.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost....
Greg Farnum
08:21 PM Revision 36ec8e93 (ceph): dispatcher: fix documentation for ms_handle_reset
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
08:21 PM Revision cbe13ab2 (ceph): msgr: rename set_ip() -> set_addr_unknowns()
The generic interface shouldn't reference specifics like that.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost....
Greg Farnum
08:13 PM Revision 607f35e7 (ceph): msgr: Remove _my_name and ms_addr, replace with direct access to my_inst.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
08:13 PM Revision 77f45667 (ceph): msgr: store the entity_inst_t in the Messenger.
Convert ms_addr and _my_name to be references to their fields in
the entity_inst_t my_inst.
This way we can use const...
Greg Farnum
08:11 PM Revision 6374d064 (ceph): buffer: implement a contents_equal function on bufferlists
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
08:11 PM Revision 5681461b (ceph): msgr: change the signature of get_myaddr()
Return a const reference to the actual address, instead of copying it.
All current users are happy with this, and I c...
Greg Farnum
08:11 PM Revision 45a76eaf (ceph): msgr: get_connection() is required to establish a connection if none ex...
Making an allowance for lossy server connections is silly. Just don't
ask for the Connection in that case. (There are...
Greg Farnum
08:10 PM Revision e80126ea (ceph): test: fix monmaptool help text
Broken by commit:15f0a3270fdcf09acce554313f2d0c0814a511e4
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
06:32 PM Revision e06436e9 (ceph): cls_rgw: guard decode
thee were few cases where decode wasn't guarded.
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com>
Yehuda Sadeh
06:30 PM Revision ebb487a6 (ceph): cls_rgw: reset return code in some cases
Beforehand the return code was ignored, so fixed the cases
where we erroneously return error instead of success.
Sig...
Yehuda Sadeh
05:12 PM Revision a8938422 (ceph): librados: fix exec test
Return for read operations is now returned correctly.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
04:06 PM Revision 57f52479 (ceph): doc: disable broken 'doxygenclass' class in librados c++ doc
This is the last remaining gitbuilder error. Add it back when the C++
docs actually build.
Signed-off-by: Sage Weil...
Sage Weil
03:58 PM Revision 9d4fcd08 (ceph): Merge remote-tracking branch 'gh/stable'
Sage Weil
03:44 PM Revision e40cf8ca (ceph): test_workload_gen: fix Sequencer ctor
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:04 AM Revision b5ca2fe0 (ceph): Merge remote-tracking branch 'gh/wip-name-sequencers'
Sage Weil
05:03 AM Revision d70191a8 (ceph): Merge remote-tracking branch 'gh/wip-2087'
Sage Weil

04/02/2012

08:24 PM Revision addc7446 (ceph): rgw: check for subuser existence
This fixes #1856: looking up subuser that doesn't exist returns
user as long as subuser prefix defined existing user....
Yehuda Sadeh
12:04 AM Revision e792cd93 (ceph): filestore: fix ZERO fallback write
It helps if we write zeros!
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil

04/01/2012

11:24 PM Revision 8434caf5 (ceph): qa: test_rewrite_latency
Tool to measure latency of overwriting a single block.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil

03/31/2012

03:31 AM Revision dbc70b9d (ceph): Merge remote branch 'gh/wip-mon_setup'
Reviewed-by: Sage Weil <sage@newdream.net> Sage Weil
03:18 AM Revision f8a53869 (ceph): osd: fix error code return from class methods
Don't shadow the result at function scope.
Fixes: #2148
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:22 AM Revision 15f0a327 (ceph): monmaptool: make clear you can set the fsid when making a new map.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
12:07 AM Revision 208daeb3 (ceph): ceph_mon: fix fsid parsing.
fsid is a field in the CephContext _conf structure and is parsed by
the standard options parsing library before it ge...
Greg Farnum

03/30/2012

11:15 PM Revision 9a69c3f3 (ceph): ceph.conf: enable 'osd recover clone overlap'
to test the recovery cloning in qa. this was redone, but forgot to enable
it in qa.
Sage Weil
11:14 PM Revision aa31035e (ceph): osd: update_stats() on reads too
Update pg stats on any op completion (read or write), not just writes. Do
the calls with log_op_stats() for consiste...
Sage Weil
11:11 PM Revision 28788654 (ceph): log: dump_recent in fatal signal handler
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:07 PM Revision f27acbc8 (ceph): Merge remote-tracking branch 'gh/wip-log'
Conflicts:
src/common/config_opts.h
Sage Weil
11:00 PM Revision 374bef9c (ceph): Merge remote branch 'gh/wip-osd-hb'
Sage Weil
10:37 PM Revision f7f65ebe (ceph): osd: fix typo in debug message
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:57 PM Revision 75e3b9b3 (ceph): Merge remote branch 'gh/wip-osd-recovery-sources'
Sage Weil
09:23 PM Revision df5860fe (ceph): objectstore: name Sequencers
Assign a (unique) name to each Sequencer. This will aid in debugging, and
can be useful when dumping traces of FileS...
Sage Weil
06:57 PM Revision 29c01f25 (ceph): ceph_common.sh: Remove dead code.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
06:27 PM Revision ba6bb4cf (ceph): man: Oops, update ceph-mon(8) for real. Sorry about that.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
06:26 PM Revision 541a543c (ceph): man: Update ceph-mon(8) after reStructuredText syntax fixes.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
06:16 PM Revision 2c542442 (ceph): doc: Remove duplicate anchor from (unused) overview doc.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
06:11 PM Revision 1ec47db1 (ceph): doc: Convert the mailing list mention to not be a section heading.
If toctree is inside a section, the subtree is inside the section too.
We don't want all of dev/* to be under "Mailin...
Tommi Virtanen
06:11 PM Revision b162696b (ceph): doc: Fix reStructuredText syntax errors.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
05:52 PM Revision 2d1a96d3 (ceph): add include/stringify.h
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:59 PM Revision b25817a5 (ceph): FileJournal: check pwrite return value when zeroing journal
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
04:52 PM Revision 41f84fac (ceph): filestore: set guard on collection_move
During recovery we submit transactions like:
- delete a/foo
- move tmp/foo to a/foo
This prevents the EEXIST chec...
Sage Weil
03:49 PM Revision f89f98df (ceph): osd: clear RECOVERING on start_peering_interval
This prevents us from, say, getting into a recovering+stray state.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
03:45 PM Revision 3cdd8d58 (ceph): osd: more heartbeat debug
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
03:45 PM Revision e1a58912 (ceph): osd: discard heartbeat_peer in note_down_osd
Discard the heartbeat_peer as soon as we find out, along with queued
failures, or else the heartbeat_check may come a...
Sage Weil
03:45 PM Revision 21e6e2b8 (ceph): osd: ignore peer epoch of 0 on ping reply
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:45 PM Revision efc27f19 (ceph): osd: don't fail new heartbeat peers
last_tx may be 0 because we just added this peer; don't mark them down
yet!
Signed-off-by: Sage Weil <sage.weil@drea...
Sage Weil
03:45 PM Revision 33b9187a (ceph): osd: rename hbin -> hbclient, hbout -> hbserver
This is way less confusing.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
03:44 PM Revision 4e2f0d14 (ceph): osd: simplify heartbeat logic
Simplify heartbeats to use a simple request/reply model.
- avoid any weirdness with map update timing
- no from/to...
Sage Weil
03:44 PM Revision fe5f0331 (ceph): osd: send pings from hbin
Fixes: #2212
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
02:32 PM Revision eebc9ec2 (ceph): test: test_workload_gen: Add callback for collection destruction.
When we remove a collection, we must cleanup after the coll_entry_t we
once had on the available collections set. For...
Joao Eduardo Luis
01:53 PM Revision 424b5b07 (ceph): ceph: --concise by default, add --verbose option
It's time.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
03:31 AM Revision 409b648b (ceph): config: drop old debug_* items
...and replace code references with conf->subsys.should_gather().
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
02:16 AM Revision 5d981b15 (ceph): rgw: add unittest just to verify we link
This will flush out references to stuff in libglobal.la, among other
things.
Signed-off-by: Sage Weil <sage.weil@dre...
Sage Weil
02:06 AM Revision 69b01726 (ceph): config: fix librados, libcephfs unit tests
No more g_conf->debug.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
01:08 AM Revision 394d8b1e (ceph): Add test for object source marked down
Samuel Just
01:08 AM Revision b4aa098f (ceph): make Thrasher not inherit from Greenlet
Samuel Just
01:02 AM Revision 1c8ec702 (ceph): PG,ReplicatedPG: update missing_loc_sources with missing_loc
In some cases missing_loc was updated without missing_loc_sources
Signed-off-by: Samuel Just <samuel.just@dreamhost....
Samuel Just
01:02 AM Revision 05ef3ba6 (ceph): ReplicatedPG: fix loop in check_recovery_sources
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just

03/29/2012

08:15 PM Revision 41a09bea (ceph): Merge remote branch 'upstream/wip_latency'
Samuel Just
02:34 PM Revision c39ed568 (ceph): test: test_workload_gen: Fixing a memleak.
Apparently, the FileStore does not cleanup after transactions once they
are applied, which may lead to huge memory le...
Joao Eduardo Luis
05:47 AM Revision b3069e50 (ceph): ceph_argparse: drop useless declaration from unit test
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:16 AM Revision 4269f8d5 (ceph): ReplicatedPG: ctx might not contain an OpRequest
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
12:16 AM Revision 135a11ba (ceph): FileJournal: optionally zero journal on create
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
12:15 AM Revision 2486c61a (ceph): FileStore: Pass OpRequestRef into filestore in queue_transaction
This allow us to track op progress through the filestore.
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Samuel Just
12:15 AM Revision d026cdc7 (ceph): FileJournal: use DSYNC for directio path
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
12:15 AM Revision 533bbf7b (ceph): osd/: OpRequest implements TrackedOp for passing into filestore
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just

03/28/2012

04:02 PM Revision 4f0d170a (ceph): test: test_workload_gen: Change CLI option and add '--help' usage.
With this commit, we support the following options (and old ones are no
longer available):
--test-num-colls VAL ...
Joao Eduardo Luis
03:34 PM Revision 18d219e5 (ceph): rgw: replace dout with ldout
librgw can't use g_ceph_context
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
01:59 PM Revision a3bdf055 (ceph): test: test_workload_gen: Default arguments, and minor changes.
Besides adding support for default arguments, passed onto global_init(),
this commit fixes a conflict in Makefile.am,...
Joao Eduardo Luis
01:32 PM Revision 37cdbcd4 (ceph): log: fix up unittest
Fewer entries; compile.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
02:58 AM Revision 94e3abf8 (ceph): Merge branch 'stable'
Sage Weil
12:22 AM Revision 8948ad01 (ceph): test: test_workload_gen: CodeStyle compliance and cleanup.
This commit aims at the compliance with Ceph's CodeStyle, as well
as cleaning up some lingering unused code.
Also, n...
Joao Eduardo Luis
12:22 AM Revision d172b40c (ceph): test: test_workload_gen: Destroy collections.
Joao Eduardo Luis
12:22 AM Revision 3770096a (ceph): test: test_workload_gen: Mimic an OSD's workload.
In it's current state, the workload generator will queue a lot of
transactions onto the FileStore, and will wait if n...
Joao Eduardo Luis
12:18 AM Revision 749826c2 (ceph): allow use of a separate journal block device
Samuel Just

03/27/2012

11:44 PM Revision ffc468f2 (ceph): osdmap: less noisy about osd additions during buildmap
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:44 PM Revision 36c2f27d (ceph): osdmaptool: fix clitest conf filename
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:37 PM Revision ca1f79b5 (ceph): dout: no newlines on dout_emergency
Preserve old behavior to avoid breaking all the cli tests.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
11:27 PM Revision d5360968 (ceph): throttle: fix off by one issue
We were blocking only if we exceeded max count, not if
we reached it.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdrea...
Yehuda Sadeh
11:23 PM Revision a52d048a (ceph): rgw: throttle incoming requests
Don't accept more than the number of threads, otherwise if cluster is
backed up for any reason we'd end up exhausting...
Yehuda Sadeh
11:16 PM Revision 30cadf01 (ceph): prebufferedstreambuf: fix typedef
'typename' not allowed here:
./common/PrebufferedStreambuf.h:27: error: using 'typename' outside of template
Signed...
Sage Weil
10:35 PM Revision 93ba4c00 (ceph): Merge branch 'wip-intent-fixes'
Yehuda Sadeh
10:35 PM Revision ca4fab47 (ceph): Merge branch 'master' of ssh://github.com/ceph/ceph
Yehuda Sadeh
10:35 PM Revision 16b60b3e (ceph): rgw: minor style fixes
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
10:12 PM Revision 4d74a7b2 (ceph): osd: fix handling of recovery sources when osds go down
If a source osd goes down, we need to
- reset any pulls (already did that before)
- remove peer from missing_loc s...
Sage Weil
10:03 PM Revision 8fdde24c (ceph): osd: remove down osds from peer_*_requested maps
This will leave less crap around to confuse recovery if a source osd goes
down and then up.
Signed-off-by: Sage Weil...
Sage Weil
10:02 PM Revision 1ee60873 (ceph): osd: maintain missing_loc_sources
This is a superset of all missing_loc values... everywhere we might
pull an object from, or are currently pulling fro...
Sage Weil
09:37 PM Revision 5dbb9715 (ceph): rgw: all intent log operations are now async
That includes removing a directory index object, and the removal of
the actual intent log object.
Signed-off-by: Yeh...
Yehuda Sadeh
09:20 PM Revision 0b1e3ed4 (ceph): osd: increase default heartbeat_interval to 6 seconds
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:12 PM Revision 69844496 (ceph): rgw: remove pool_list(), can't list_objects() on system buckets
pool_list() was broken, replaced now with pool_iterate(). list_objects()
shouldn't be used any more with system bucke...
Yehuda Sadeh
09:04 PM Revision 2e9079cf (ceph): rgw: intent log processing uses new pool_iterate()
intead of pool_list(), which is broken (assuming pgls results are
sorted, which are not).
Signed-off-by: Yehuda Sade...
Yehuda Sadeh
08:57 PM Revision 1814aac1 (ceph): Merge branch 'misc-fixes-for-review'
Greg Farnum
08:57 PM Revision d5c4015d (ceph): uclient: We want to release cache when we lose the CACHE cap, not gain it!
Looks like this was detected as a problem back in
84644dc56183b67050793a1b8da07850508b29d6 but the fix wasn't complet...
Greg Farnum
08:57 PM Revision c3b04644 (ceph): paxos: share_state sends every unknown value, including the stashed one
Sage points out that the stashed object might not be the same as the
one we actually archive. For instance, OSDMonito...
Greg Farnum
08:57 PM Revision 2acf4aea (ceph): mon: Paxos needs to store the latest version permanently on-disk.
Previously it was only storing this m->latest_value in the stash,
which of course got overwritten. And then when some...
Greg Farnum
08:57 PM Revision d0ba27ae (ceph): doc: add a short thing on kernel client troubleshooting.
I just noticed this sitting uncommitted in my tree.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Greg Farnum
08:02 PM Revision c89b7f22 (ceph): v0.44.1
Sage Weil
06:35 PM Revision 6044c5b8 (ceph): hadoop: define subsystem, fix logging
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
06:20 PM Revision ce61a83f (ceph): log: throttle message submission, trim recent
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
06:20 PM Revision fe56818e (ceph): config: configure log thresholds
- max new entries before we wait for flush
- max recent entries to keep around
Signed-off-by: Sage Weil <sage@newdre...
Sage Weil
06:05 PM Revision 339956df (ceph): log: don't spam -1 to syslog; add err_to_syslog for consistency
This matches the stderr settings.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:44 PM Revision 17a95c22 (ceph): log: use PrebufferedStreambuf
It's faster than ostringstream!
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:44 PM Revision bfa2bcd7 (ceph): prebufferedstreambuf: fix get_str()
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:43 PM Revision 0e3c0c44 (ceph): bench_log: flush
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:42 PM Revision 3a87e452 (ceph): log/EntryQueue: no implicit trim
dequeue() things explicitly if you want to remove them.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:41 PM Revision f66e0750 (ceph): utime_t: sprintf() method
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:41 PM Revision 6ab85264 (ceph): do_autogen: control optimization level
-O 2 -> -O2
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:41 PM Revision a4509273 (ceph): common: add PrebufferedStreambuf
Simple streambuf that uses a preallocated buffer, and then spills over
into a std::string if necessary.
Signed-off-b...
Sage Weil
05:41 PM Revision 23f0af3c (ceph): test log performance with PreallocatedStreambuf
- faster than ostringstream in optimistic case
- same as ostreamstream + std::string assignment in worst case (use
...
Sage Weil
05:41 PM Revision 8c5046fa (ceph): bench_log: simple util to time how long it takes to log stuff
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:41 PM Revision 362ca19b (ceph): log: move create_entry() into Log interface
This will let us be smarter than putting it on the heap.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:41 PM Revision c7242bfe (ceph): log: flush on_exit
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:41 PM Revision abfadb9b (ceph): assert: dump recent log entries on failed assertions
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
05:41 PM Revision f41887e3 (ceph): log: new logging infrastructure
- explicitly defined subsystems, and ceph_subsys_FOO enums to go with them
- modular log system with Entry object
- s...
Sage Weil

03/26/2012

11:48 PM Revision 974a2013 (ceph): objecter: don't call op_throttle_ops.take(1) unconditionally
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
11:17 PM Revision 679cd1fe (ceph): objecter: add in-flight ops throttling
In addition to ops length, we also want to throttle it by
actual number of ops.
Signed-off-by: Yehuda Sadeh <yehuda@...
Yehuda Sadeh
10:02 PM Revision d6b0cbd4 (ceph): config: use our assert
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
07:40 PM Revision c3dc6a6e (ceph): msg: assert pipe->msgr == msgr
Fixes: #2216
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
06:57 PM Revision e30b7710 (ceph): rbd: fix typo in default config
pyflakes would have caught this if 'all' weren't a built-in function Josh Durgin
06:43 PM Revision 483fcf80 (ceph): doc: include crush in toctree
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
06:30 PM Revision 3bd1f18e (ceph): doc: few notes on manipulating the crush map
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:15 PM Revision 6db77158 (ceph): doc/dev/peering.rst: fix typo
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:39 PM Revision 1a0360cb (ceph): osd/: OpRequest is no longer a RefCountedObject, remove puts/gets
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
04:38 PM Revision ea377a08 (ceph): osd/: Convert OpRequest* to OpRequestRef
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
04:38 PM Revision 2cb6c7d0 (ceph): OSD: Add typedef for shared_ptr<OpRequest>
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
04:36 PM Revision 3ed784c9 (ceph): osd/: add mark_event to OpRequest and move tracking into OpTracker
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
03:28 AM Revision e478a758 (ceph): vstart: enable omap for xattrs
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil

03/25/2012

03:05 PM Revision f4b2097a (ceph): Merge remote branch 'gh/wip-doc-peering'
Sage Weil
02:57 PM Revision d3bcac24 (ceph): Makefile: fix modules that cannot find pk11pub.h when compiling with NS...
Signed-off-by: Jim Schutt <jaschut@sandia.gov>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Jim Schutt
02:57 PM Revision 3ab28950 (ceph): don't override CFLAGS
leveldb adds -I flags to CFLAGS and CXXFLAGS, but if these macros are
overridden in the make command line, the flags ...
Alexandre Oliva
04:47 AM Revision ef17c8c9 (ceph): add smoke suite
This could probably be collapsed into a bunch of singleton tasks to make
it simpler to track how many actual jobs res...
Sage Weil
04:20 AM Revision b5641ef3 (ceph): rgw: don't #include fcgi from rgw_common.h
ceph-dencoder #includes rgw_common.h, and needs to build even when
--without-radosgw is specified and libfcgi isn't i...
Sage Weil
04:09 AM Revision 1c1192a9 (ceph): backfill: use 'rbd' pool instead of 'data'
(data has a replay interval, which makes writes take longer to resume
after repeering)
Sage Weil
04:09 AM Revision 397e7f2f (ceph): add osd_recovery task to test divergent osd logs
Sage Weil

03/24/2012

11:07 PM Revision 24910c3b (ceph): add osd-recovery test
Sage Weil
11:07 PM Revision 6bf9c957 (ceph): renamed backfill -> osd_backfill
Sage Weil
11:05 PM Revision ca9a5a4a (ceph): rename backfill -> osd_backfill
Sage Weil
10:36 PM Revision 22e80874 (ceph): put filestore xattr option in [global]
...for test_filestore_idempotent's benefit Sage Weil

03/23/2012

08:27 PM Revision 2ec8f27f (ceph): rados_bench: generate_object_name now takes a buffer length
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Reviewed-by: Josh Durgin <josh.durgin@dreamhost.com>
Samuel Just

03/22/2012

09:41 PM Revision 21a170e8 (ceph): doc: dev/peering.rst edits from Greg
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
03:33 PM Revision 8fa904a6 (ceph): doc: update dev/peering document
- fix discussion of last epoch started
- define terms for current and past intervals
- describe role of pg info
- rem...
Sage Weil
02:55 PM Revision de867632 (ceph): msgr: fix tcp.cc linkage
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
02:53 PM Revision fd9935b7 (ceph): cephtool: don't prefix log items
This just makes it hard to read them.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil

03/21/2012

11:41 PM Revision 2e21adf2 (ceph): Objecter: resend linger_ops on any change
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Reviewed-by: Josh Durgin <josh.durgin@dreamhost.com>
Samuel Just
11:35 PM Revision b47454b6 (ceph): ObjectStore: add COLLECTION_MOVE to dump
Signed-off-by: Samuel Just <rexludorum@gmail.com> Samuel Just
11:35 PM Revision 23313ee6 (ceph): FileStore: whitelist COLLECTION_MOVE on replay
Signed-off-by: Samuel Just <rexludorum@gmail.com> Samuel Just
11:35 PM Revision ec52eeb2 (ceph): FileStore: remove src on EEXIST during collection_move replay
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
11:35 PM Revision 52aff487 (ceph): ObjectStore: Add collection_move to generate_instances
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
09:01 PM Revision 3caa4319 (ceph): ceph: define and use a shell_scripts Makefile variable
Define a variable "shell_scripts" in the Makefile.in, and use it
along with some pattern rules to avoid some duplicat...
Alex Elder
09:01 PM Revision 1b2a0669 (ceph): ceph-kdump-copy: add tools for saving kdumps
This puts in place an init script and a command it runs to save a
kernel core dump to a remote server when a panic or...
Alex Elder
07:00 PM Revision 6f0f250b (ceph): suite: add missing print statement
Josh Durgin
06:58 PM Revision 8a9a5670 (ceph): suite: fix print statement when summary doesn't exist
Josh Durgin
01:30 PM Revision d0e8f148 (ceph): doc: update list of debian dists
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
01:28 PM Revision a608a8fe (ceph): Merge branch 'stable'
Sage Weil
02:00 AM Revision 91c08f6e (ceph): Add watch op to rados.py
Signed-off-by: Samuel Just <sam.just@dreamhost.com> Samuel Just
12:51 AM Revision 72361784 (ceph): Objecter: resend linger_ops on any change
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Reviewed-by: Josh Durgin <josh.durgin@dreamhost.com>
Samuel Just
12:51 AM Revision 3019d460 (ceph): TestRados: Add watch
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Reviewed-by: Josh Durgin <josh.durgin@dreamhost.com>
Samuel Just
12:20 AM Revision 2998368a (ceph): rgw: remove unused definition
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
12:20 AM Revision 4760536f (ceph): rgw: keep pool placement info also in cacheable location
Mirror the pools placement info, so that we can cache it.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
12:00 AM Revision f1563a66 (ceph): Revert "Objecter: add op->resend_on_any_change"
This reverts commit c53194d75390dd6d5aa4a9a33f741cbd106e3338.
recalc_linger_op_target is used for linger_ops
Signed...
Samuel Just

03/20/2012

11:11 PM Revision 2daff0e9 (ceph): ReplicatedPG: osd_max_notify_timeout -> osd_default_notify_timeout
This setting should not override user specified timeout.
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Samuel Just
11:11 PM Revision c53194d7 (ceph): Objecter: add op->resend_on_any_change
lingers must be resent even if the primary does not change.
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Samuel Just
11:11 PM Revision fc7a1bda (ceph): ReplicatedPG: return -EBUSY on delete for objects with watchers
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
10:15 PM Revision 6a5cbec3 (ceph): rgw: replace bucket_id generation
bucket_id is now string: <global instance id>.<num> where
num is increasing monotonically within the current rgw
inst...
Yehuda Sadeh
06:41 PM Revision cdd5298d (ceph): v0.44
Sage Weil
05:59 PM Revision e42fbb70 (ceph): rgw: process default alt args before processing conf file
this fixes #2189
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
05:52 PM Revision e0b8f7a0 (ceph): rgw: process default alt args before processing conf file
this fixes #2189
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
05:37 PM Revision 51a07339 (ceph): rgw: incrase socket backlog
20 is too small
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
05:25 PM Revision 5b331987 (ceph): rgw: fix internal cache api
This fixes issue #2190
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
02:50 PM Revision 815fc3e2 (ceph): suite: failed runs might not have durations
This was one cause of emails not being sent - stale /tmp/cephtest dirs
fail without recording a duration.
Josh Durgin

03/19/2012

11:10 PM Revision f923b840 (ceph): OSD: do not hold obc lock in disconnect_session_watches
ObjectContext::lock is used only for implementing read_lock and
write_lock. PG::lock is used to protect the ObjectCo...
Samuel Just
09:16 PM Revision a65d4136 (ceph): suite, coverage: use absolute dirs for isdir checks
This fixes the results to wait for all jobs to complete again. Josh Durgin
06:57 PM Revision bdb72c28 (ceph): filestore_idempotent: get coverage and coredumps
Josh Durgin
06:31 PM Revision 6c8db1a8 (ceph): suite: more results logging
Josh Durgin

03/18/2012

06:56 PM Revision 7173a8af (ceph): ceph.conf: no comment
Sage Weil
06:06 PM Revision 7de798f6 (ceph): ceph.conf: set 'filestore xattr use omap = true'
Sage Weil
05:50 PM Revision 7d2e1056 (ceph): fix teuthology-ls isdir check
Sage Weil
05:48 PM Revision 94f0ba1e (ceph): run valgrind with cwd set to /tmp/cephtest/archive/coredump
This lets us capture the vgcore.* files, which always go to valgrind's
cwd.
Fixes: #1953
Sage Weil
04:09 PM Revision fd851304 (ceph): ReplicatedPG: there should be no object_contexts during on_activate
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
04:08 PM Revision 6c17a7b3 (ceph): Merge branch 'next'
Sage Weil
04:08 PM Revision 77c08f86 (ceph): osd: fix object_info.size mismatch file due to truncate_seq on new object
If the first write that creates an object includes a truncate_seq and
truncate_size, we were taking the truncte patch...
Sage Weil

03/16/2012

11:59 PM Revision 619fe730 (ceph): .gitignore: xattr_bench
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:06 PM Revision 3a6c085e (ceph): heartbeatmap: use utimes(2) instead of futimens(2)
For poor users with ancient glibc. We don't much care about rename races
here anyway.
Signed-off-by: Sage Weil <sag...
Sage Weil
09:36 PM Revision 63ec06b3 (ceph): osd: remove special handline for head recovery from clone
This breaks because:
- we don't have the head or current snapset
- get_object_context() creates a new snapset, whi...
Sage Weil
08:49 PM Revision d8bcc1b3 (ceph): config: fix recursive locking of md_config_t::lock
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
Sage Weil
08:30 PM Revision 58c5d5a0 (ceph): osd: ReplicatedPG::create_object_context()
New helper that creates a new object context.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
08:30 PM Revision d4addf57 (ceph): osd: re-use create_object_context() in get_object_context()
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
08:30 PM Revision 15d85af4 (ceph): osd: explicitly create new object,snap contexts on push
We specifically want to use this during recovery to avoid loading the obc
or ssc for a previous version of the object...
Sage Weil
08:28 PM Revision 01924a22 (ceph): disable rbd thrash workload, #2174
Sage Weil
08:04 PM Revision 96780bd1 (ceph): osd: create_snapset_context()
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
07:15 PM Revision 872bdd0d (ceph): osd: ensure we don't clobber other *contexts when registering new ones
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
06:52 PM Revision 9791035d (ceph): Merge branch 'wip_omap_xattrs'
Samuel Just
06:44 PM Revision 07b97fe7 (ceph): suite: log results and coverage generation
Need to figure out where and when results emails are failing. Josh Durgin
06:40 PM Revision 2a593dda (ceph): RadosModel: test xattrs with omap
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:40 PM Revision a49a1972 (ceph): ReplicatedPG,FileStore: clone should copy xattrs as well
_make_clone (called from make_writeable) and _rollback_to included
attr reads from head or a clone. In that case, an...
Samuel Just
06:40 PM Revision 14506dc6 (ceph): FileStore: add support for omap xattrs
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:31 PM Revision a5f143d2 (ceph): Merge branch 'wip-msgr4'
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com> Sage Weil
06:29 PM Revision 983fd190 (ceph): ObjectMap: add interface for storing xattrs
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:29 PM Revision d8325e50 (ceph): DBObjectMap: implement xattr interface
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:29 PM Revision fdb92748 (ceph): test_object_map: update unit test for xattr
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:29 PM Revision 8fc43179 (ceph): config_opts.h: opts for omap_xattrs
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:29 PM Revision ecd875fe (ceph): tests/: Added xattr bench
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:29 PM Revision b09fb15d (ceph): ObjectMap: use Index object for locking rather than path object
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
06:28 PM Revision 9fd4a12a (ceph): DBObjectMap: add support for storing xattrs
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
05:39 PM Revision 0904c7b7 (ceph): configure: fix warnings
Finally!
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
05:04 PM Revision f2e6b8d7 (ceph): ReplicatedPG: populate_object_context during handle_pull_response
A cached objectcontext should always have its watchers populated.
Signed-off-by: Samuel Just <samuel.just@dreamhost....
Samuel Just
04:43 PM Revision 4cfc34f8 (ceph): leveldb: .gitignore TAGS
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
04:40 PM Revision 5db6902b (ceph): leveldb: un-revert
Accidentally reverted by c2af646b38995ba005140e748a21baba4263e53f.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
12:34 AM Revision 8fbd087d (ceph): results: make sure email is sent before anything else fails
Josh Durgin

03/15/2012

05:35 PM Revision 89ccd95a (ceph): osd: maybe clear DEGRADED on recovery completion
We set degraded if we don't have enough "active" replicas, which excludes
the backfill target. We need to recheck th...
Sage Weil
05:32 PM Revision b4572351 (ceph): Revert "disable rbd thrash workload, #2174"
This reverts commit 1bec416c7c7ff8a6462d94baaba8e7da73e88ab4.
Fixed with #2174
Sage Weil
12:16 AM Revision 826d30f1 (ceph): rgw: remove extra layer of RGWAccess
Not needed, now that we got rid of RGWFS
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh

03/14/2012

11:33 PM Revision 80e2a5e8 (ceph): msgr: switch all users over to abstract interface
This will let us transparently swap implementations out.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
11:29 PM Revision 1e1453c1 (ceph): msgr: introduce static Messenger::create() function
Create a new messenger, with whatever implementation is appropriate.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
11:29 PM Revision d26feffd (ceph): msgr: promote more methods to abstract Messenger interface
This will be everything that people actually use.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
11:01 PM Revision c2af646b (ceph): rgw: put_obj() uses bufferlist instead of extra alloc/copy
makes it cleaner.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
11:01 PM Revision 2b3bfd0c (ceph): rgw: remove fs backend
was broken anyway
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
10:51 PM Revision 1bec416c (ceph): disable rbd thrash workload, #2174
Sage Weil
08:32 PM Revision e14d428c (ceph): Merge branch 'master' of github.com:ceph/teuthology
Mark Nelson
08:32 PM Revision 2b879905 (ceph): Merge branch 'master' of github.com:ceph/teuthology
Mark Nelson
08:01 PM Revision a81b23e2 (ceph): Merge branch 'next'
Sage Weil
07:59 PM Revision bec47b57 (ceph): introduce CEPH_FEATURE_OMAP
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:55 PM Revision 8c96fd26 (ceph): leveldb: new .gitignore entry
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
07:14 PM Revision 20d11714 (ceph): osd: rev cluster internal protocol
This covers:
- the push/pull changes in 0.43 (which we forgot to protect against; see
#2132)
- the new omap stuff ...
Sage Weil
04:36 PM Revision a0bcab5a (ceph): ceph-fuse: make big_writes optional via 'fuse big writes'
Fixes: #2159
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:21 AM Revision 5912312c (ceph): rgw: remove some more globals from librgw
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
12:04 AM Revision 213a3f5e (ceph): rgw: fix identation
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
12:04 AM Revision d90298de (ceph): ceph-dencoder: don't use rgw types if configured without rgw
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh

03/13/2012

11:23 PM Revision a9d18975 (ceph): Merge branch 'master' of github.com:ceph/ceph
Johnw
11:22 PM Revision 60524aba (ceph): Added documentation for building the ceph documentation.
Johnw
09:59 PM Revision b9097619 (ceph): rgw: get rid of references to g_ceph_context where required
trickling down ceph context.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
08:48 PM Revision e6969258 (ceph): global: drop yellow warning on startup
Fixes: #2143
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
08:48 PM Revision e455d388 (ceph): doc: update project status/stability blurb
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Reviewed-by: Mark Kampe <mark.kampe@dreamhost.com>
Sage Weil
07:55 PM Revision e5934f10 (ceph): qa: kclient/file_layout.sh: ...
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
06:46 PM Revision 0a2068fc (ceph): Merge branch 'librados-cleanup'
Reviewed-by: Sage Weil <sage.weil@dreamhost.com> Josh Durgin
06:46 PM Revision 8f278647 (ceph): librados: split into separate files and remove unnecessary headers
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
06:46 PM Revision 5f92f338 (ceph): librados: move methods that require an IoCtx to IoCtxImpl
RadosClient still does a few different things, but at least it
no longer does all the work of an IoCtx.
Signed-off-b...
Josh Durgin
06:46 PM Revision db126279 (ceph): ObjectCacher: remove unused and crufty atomic sync operations
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
06:46 PM Revision 095c3a0e (ceph): OSDMap: make get_pools() const
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
06:46 PM Revision 16f99606 (ceph): osd_types: use uint64_t for ObjectExtent offsets and lengths
This is just client in-memory state, and allows us to address objects >4GiB,
to match the existing librados/Objecter ...
Josh Durgin
05:49 PM Revision b90354db (ceph): thrash: put client on separate machine from osds
This allows us to run kenrel clients (kclient, rbd) against the thrashing
cluster.
Sage Weil
05:09 PM Revision 5c9acbd8 (ceph): gitbuilder: put flavor last
in case we refine the field later Sage Weil
05:02 PM Revision 1a01ccaa (ceph): Pull from new gitbuilder.ceph.com locations.
Simplifies the flavor stuff into a tuple of
<package,type,flavor,dist,arch>
where package is ceph, kenrel, etc.
typ...
Sage Weil
12:02 AM Revision 98792e93 (ceph): rgw: add more meaningful tests instances of encoded objects
this completes #2140
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh

03/12/2012

11:46 PM Revision dfe50bcb (ceph): build-doc: use alternate virtualenv dir, if specified
The docs gitbuilder will use this to avoid rebuilding the virtualenv on
every build.
Signed-off-by: Sage Weil <sage@...
Sage Weil
10:22 PM Revision 096427d5 (ceph): remove dup ceph tasks from new thrash workloads
Sage Weil
10:12 PM Revision 6869c576 (ceph): test_idempotent: fix global_init call
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:01 PM Revision 401a5716 (ceph): qa: kclient/file_layout.sh poking
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:59 PM Revision 7e0e7ce1 (ceph): rgw: modify bucket instance for encoding test
This makes 'make check' happy, otherwise we need to create
a bucket name that starts with a period. This version is b...
Yehuda Sadeh
09:58 PM Revision 9969bba8 (ceph): FileStore: clarify debug/error output
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
09:58 PM Revision 6ca070ad (ceph): FileStore: ignore ERANGE and ENOENT on replay
The source object may either not exist or be the wrong size
during replay if the destination object was deleted in a ...
Samuel Just
09:58 PM Revision f20f6ea7 (ceph): test: add test_filestore_idempotent2
Signed-off-by: Samuel Just <rexludorum@gmail.com> Samuel Just
09:41 PM Revision e19417ef (ceph): Makefile.am, rgw: remove fcgi dependency where not needed
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
09:22 PM Revision 3ff5492c (ceph): rgw: add more meaningful test instances of some encoded objects
still need to add tests for other objects
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
08:22 PM Revision 31578c19 (ceph): rgw: tone down some log messages
dout(0) -> dout(1)
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
08:21 PM Revision 452b1248 (ceph): rgw: provide different default values for 'debug rgw'
Currently rgw and radosgw-admin require different chattiness
defaults.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdre...
Yehuda Sadeh
08:21 PM Revision 2c88f85c (ceph): config: alternative config options for global_init()
We want to be able to provide alternative default config values, than
the ones we set in common/config_opts.h. This c...
Yehuda Sadeh
08:13 PM Revision 3833ada8 (ceph): Made the example better with multiple roles.
Mark Nelson
07:33 PM Revision 0a61ffad (ceph): Added some example yaml files and an example parallel execution task.
Mark Nelson
07:01 PM Revision 968d29d1 (ceph): qa: use recent kernel for kernel_untar_build.sh
Happier on oneiric!
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
06:43 PM Revision 93164393 (ceph): rgw: switch ops log flag to use ceph config
It's turned on by default. So now we're using the
'rgw enable ops log' config param in ceph.conf, instead
of RGW_SHOU...
Yehuda Sadeh
06:22 PM Revision c9898f43 (ceph): filestore: fix op_num offset/labels
Start at 0, not 1.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
06:20 PM Revision 7c753498 (ceph): config: tmap to omap upgrade, true by default
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
04:50 AM Revision 2b9e7bc5 (ceph): clusters/fixed-3.yaml: 2 -> 6 osds
plana nodes have 3 scratch disks... use them! Sage Weil
04:32 AM Revision 51d817fe (ceph): Revert "disable s3tests on valgrind/lockdep until #2103 is fixed"
This reverts commit 9f757ca9511374f6565d74263e242c74e39f8a3f. Sage Weil
04:28 AM Revision af445189 (ceph): add rbd, kclient workloads to regression thrash collection
This will get us some kernel osd_client osd restart coverage. Sage Weil
04:16 AM Revision 3bba6b72 (ceph): Makefile: link libfcgi to librgw
Need this to make a linker error go away on my squeeze dev box. We
probably need to make sure librgw doesn't touch f...
Sage Weil
03:36 AM Revision 945218cc (ceph): qa/workunits/kclient/file_layout: escape *
Escape * so that it is expanded as root.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil

03/11/2012

08:03 PM Revision 71e6e62e (ceph): fix typo, ceph-fyuse -> ceph-fuse
Sage Weil
07:31 PM Revision a8497874 (ceph): filejournal: less log noise
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:01 AM Revision b84897e5 (ceph): use dbench workunit, not the autotest one
The autotest one uses an old tarball that doesn't build. Workunit assumes
the dbench package is installed.
Sage Weil
03:15 AM Revision 008cf7fd (ceph): autotest: pull from github.com/ceph/autotest
Sage Weil

03/10/2012

11:34 PM Revision 2124129e (ceph): workunit: include python2.7 path too
Sage Weil
04:55 AM Revision 0851b747 (ceph): filestore: remove unused bool idempotent
This was from the old broken mechanism.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
01:07 AM Revision 6980ed98 (ceph): filestore: fix arguments
From a change that was rebased out; missed this caller.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
12:42 AM Revision ea34aa59 (ceph): Merge remote branch 'gh/wip-2098'
Reviewed-by: Samuel Just <samuel.just@dreamhost.com> Sage Weil
12:34 AM Revision 9b2a5c5d (ceph): filestore: sync object_map on _set_replay_guard()
We need to sync the object_map too. We can _almost_ check to see if there
are keys for the object and only do it the...
Sage Weil
12:32 AM Revision 51372a76 (ceph): filestore: guard replay of collection_add
- set guard on apply
- check guard on replay
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:32 AM Revision 6613b415 (ceph): filestore: guard collection_remove replay
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:32 AM Revision 13afce83 (ceph): filestore: remove old post-idempotent transaction trigger_commit
The old strategy was to initiate a commit after any non-idempotent
transaction. This only worked if the transaction ...
Sage Weil
12:32 AM Revision c9550c59 (ceph): omap: add sync method to ObjectMap
Signed-off-by: Samuel Just <rexludorum@gmail.com> Sage Weil
12:32 AM Revision 808812a2 (ceph): filestore: use proper type for readdir_r tmp
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:32 AM Revision a6077f6c (ceph): filestore: pass trans_num into _do_transaction
This gives us the <op_seq, trans_num, op_num> triple to identify every
constituent operation.
Signed-off-by: Sage We...
Sage Weil
12:32 AM Revision babb1e90 (ceph): add SequencerPosition type
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:32 AM Revision e81bc971 (ceph): filestore: fgetxattr helpers/wrappers
Also, do the getxattr using fgetxattr, to avoid duplicating code. This is
slightly slower probably because we open a...
Sage Weil
12:32 AM Revision 3b47c6ba (ceph): filestore: maintain SequencerPosition during _do_transaction
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:32 AM Revision f8a047f2 (ceph): filestore: implement _set_replay_guard, _check_replay_guard
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:32 AM Revision e99940d1 (ceph): filestore: guard clone replay
- set guard xattr on clone, clone_range
- check before applying/replaying
Signed-off-by: Sage Weil <sage.weil@dreamh...
Sage Weil
12:32 AM Revision 63d2c93d (ceph): filestore: fix collection_rename error code
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:32 AM Revision dd284c4f (ceph): filestore: guard collection_rename replay
- check guard on replay
- set guard on apply
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
12:32 AM Revision 4ea6e0d2 (ceph): filestore: guard replay of basic collection ops
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil

03/09/2012

10:24 PM Revision 11844978 (ceph): levedb: fix commit
This got reverted back to the old commit, somehow.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
10:13 PM Revision 184b1802 (ceph): Merge branch 'master' of github.com:ceph/ceph
Sage Weil
10:12 PM Revision 7f9cfdd9 (ceph): RadosModel: fix omap_clear case in RemoveAttrsOp
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
10:03 PM Revision fce180df (ceph): Merge branch 'wip-rgw-encode'
Conflicts:
src/rgw/rgw_cls_api.h
Reviewed-by: Sage Weil <sage@newdream.net>
Sage Weil
10:01 PM Revision b66cdea6 (ceph): Makefile.am: update link dependencies for some unit tests
Yehuda Sadeh
10:01 PM Revision b4f05788 (ceph): test/encoding/import.sh: fix target directory
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com> Yehuda Sadeh
10:01 PM Revision b71d814c (ceph): ceph-object-corpus: added 0.43
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com> Yehuda Sadeh
10:01 PM Revision 799e6f97 (ceph): rgw: fix rgw_cls_list_ret ctor
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:01 PM Revision 09949b3d (ceph): rgw: various encoding related fixes
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
09:34 PM Revision e43546de (ceph): osd: fix watch_lock vs map_lock ordering
watch_lock is inside map_lock (and pg->lock), which means we need to
drop it to take pg->lock here. That means verif...
Sage Weil
08:26 PM Revision 80d92528 (ceph): osd: update_heartbeat_peers as needed
Before, we were being very careful about updating the heartbeat peers if
new PGs were created or when certain types o...
Sage Weil
08:06 AM Revision 619244d8 (ceph): rgw: implement dump() for encoders
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
12:58 AM Revision 2277fb45 (ceph): rgw: add stubs for dencoder test
still need to add some content to the dump methods
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
12:15 AM Revision 71323ffe (ceph): Merge remote branch 'origin/wip-2139'
Conflicts:
src/cls_rgw.cc
src/rgw/rgw_rados.cc
src/rgw/rgw_rados.h
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@drea...
Yehuda Sadeh
12:14 AM Revision ddc1ab0c (ceph): rados.py: include setattr and rmattr
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just

03/08/2012

11:54 PM Revision 64e3ffb2 (ceph): Merge branch 'master' of ssh://github.com/ceph/ceph
Yehuda Sadeh
11:18 PM Revision ac28b603 (ceph): ceph: document the way files are laid out
This adds a document that I wrote about how Ceph client file data
is striped across Ceph objects to the repository. ...
Alex Elder
11:09 PM Revision 1ed1d466 (ceph): librados: fix unit test for omap_get_vals_by_key rename
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:06 PM Revision ce43bd53 (ceph): osd: format time nicely in ops_in_flight output
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:06 PM Revision 934ee487 (ceph): librados: fix map -> std::map in header, string -> std::string
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
11:02 PM Revision fafbddd9 (ceph): doc: example of diagnosing radosgw hang
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:55 PM Revision 99cb9945 (ceph): doc: explain how unfound objects happen
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:55 PM Revision 47ce7ade (ceph): doc: make osd failure example include >3 osds
More realistic.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
10:46 PM Revision 80864a12 (ceph): testrados: fix omap_get_vals_by_keys call
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:30 PM Revision e7e3baeb (ceph): osd: add zero_to field to PG::OndiskLog; track zeroed region of pg log
Track which region of the log has been zeroed on disk. This may be
different from tail if 'osd preserved trimmed log...
Sage Weil
10:30 PM Revision ed6cc47b (ceph): filestore: use FL_ALLOC_PUNCH_HOLE to zero, when available
First try the FL_ALLOC_PUNCH_HOLE fallocate() flag. If we get EOPNOTSUPP,
fall back to writing zeros.
Check for fal...
Sage Weil
10:16 PM Revision 1468d951 (ceph): osd: fix op_wq vs pg->lock ordering
map_lock
-> pg->lock
-> op_wq
Fixes: #2153
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Samuel Just...
Sage Weil
06:58 AM Revision c0aa3319 (ceph): Merge branch 'master' of ssh://skinny/home/yehudasa/ceph
Yehuda Sadeh
06:53 AM Revision 5f8bbf1f (ceph): Merge branch 'wip-rgw-new-atomic'
Yehuda Sadeh
06:52 AM Revision 465a88ea (ceph): rgw: append the currect bucket marker when removing bucket
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
06:39 AM Revision 8ce3d229 (ceph): Merge branch 'master' of ssh://skinny/home/yehudasa/ceph
Yehuda Sadeh
06:35 AM Revision 89648a0d (ceph): Merge branch 'wip-rgw-omap'
Yehuda Sadeh
06:25 AM Revision 72d678b8 (ceph): cls_rgw: fix rgw_bucket_init_index
was failing to error in case header already existed
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
06:19 AM Revision eaafc578 (ceph): rgw: remove extra unused params from omap_get()
and also rename it to omap_get_all()
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Yehuda Sadeh
06:18 AM Revision 765962dc (ceph): rgw: add cls_cxx_map_clear
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
05:59 AM Revision afe2598a (ceph): leveldb: drop compaction unit test
Signed-off-by: Samuel Just <rexludorum@gmail.com> Samuel Just
01:20 AM Revision 4d6578ca (ceph): ReplicatedPG,librados: add filter_prefix to omap_get_vals
Signed-off-by: Samuel Just <rexludorum@gmail.com> Samuel Just
01:10 AM Revision e0744390 (ceph): rgw: use prefix filter for bucket listing
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
01:03 AM Revision 4c908442 (ceph): objclass, cls_rgw: add prefix to omap_get_vals()
Yehuda Sadeh
01:02 AM Revision a6b524f6 (ceph): librados: add higher level call for omap_get_keys() with prefix
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
12:46 AM Revision 7a72bf01 (ceph): Merge remote-tracking branch 'origin/wip_prefix' into wip-rgw-omap
Yehuda Sadeh
12:29 AM Revision ffcf62f6 (ceph): rgw: switch to new encoders/decoders
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net> Yehuda Sadeh
12:28 AM Revision ffae4dfe (ceph): enconding: add legacy decoder for 32 bit versions
In these cases if the version is smaller than the compat ver
we skip 3 bytes.
Signed-off-by: Yehuda Sadeh <yehuda@hq...
Yehuda Sadeh
12:05 AM Revision b0c9d58c (ceph): rbd: pass all mon addrs when mapping devices
Previously this repeated the address of the first monitor.
Fixes: #2152
Signed-off-by: Josh Durgin <josh.durgin@drea...
Josh Durgin
 

Also available in: Atom