Project

General

Profile

Activity

From 02/19/2011 to 03/20/2011

03/20/2011

12:10 PM Revision 41675b1b (ceph): Fix manpage typos
Close escape names correctly. Laszlo Boszormenyi
11:44 AM Revision e7abf595 (ceph): Remove unused cdbs build dependency
Debian packaging uses debhelper and not cdbs; remove that build dependency. Laszlo Boszormenyi
11:17 AM Revision e2f1d784 (ceph): Change wording of Debian package descriptions
Be more general in naming users per policy recommendation. Laszlo Boszormenyi
07:36 AM Revision be97e60d (ceph): Make Ceph Debian packaging Linux only
Build Ceph on all Linux archs, but only build-depend google-perftools on
x86 and x64 archs only.
Laszlo Boszormenyi
07:23 AM Revision 5959e76e (ceph): Disable libatomic-ops on armel archs
armel supports ARMv4t or above instructions sets.
libatomic-ops is only usable with Ceph for ARMv6 or above.
Signed-...
Laszlo Boszormenyi

03/19/2011

07:45 PM Revision 9b969ce9 (ceph): Add cross compilation support
Taken from Debian bugreport #618939 , courtesy by Hector Oron.
Signed-off-by: Hector Oron <zumbi@debian.org>
Laszlo Boszormenyi
07:15 PM Revision 1ad567e3 (ceph): Add parallel building support for multi{core,processor} systems.
Laszlo Boszormenyi
12:41 AM Revision 241e29bd (ceph): CephxProtocol.cc: invalid authorizer data should not crash the osd
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
12:07 AM Revision 54f7d83e (ceph): ceph.spec.in: some CentOS fixes
BuildRequires: cryptopp-devel has been replaced by nss-devel. Skip
google-perftools-devel because that package is no...
Colin Patrick McCabe
12:03 AM Revision 47abc4f3 (ceph): osync: fix hash compares
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe

03/18/2011

11:35 PM Revision 4f8efd2c (ceph): osync: fix s3store iterator
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:10 PM Revision 1065bef0 (ceph): pybind: convert to new API
Fix the python bindings to use the new librados API.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
10:09 PM Revision 9db1ecf3 (ceph): backtrace: user the proper version header
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
10:08 PM Revision 07ba8ee8 (ceph): libceph: use the proper version header
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:49 PM Revision f772a163 (ceph): libceph: pull version from new version define
Signed-off-by: Sage Weil <sage@newdream.net> Sage Weil
09:47 PM Revision 55bb9ef8 (ceph): configure: no ~
This confuses fedora and isn't really necessary.
Signed-off-by: Sage Weil <sage@newdream.net>
Sage Weil
09:37 PM Revision e7f3df72 (ceph): use 'git describe' version
Sage Weil
06:38 PM Revision 45e88ebc (ceph): librados: rados_ioctx_lookup -> rados_pool_lookup
rados_pool_lookup has nothing to do with io contexts!
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:37 PM Revision 0b70fe59 (ceph): librados: bump minor version number
rados_create_internal -> rados_create_with_config
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:31 PM Revision 87e4aa23 (ceph): librados: bump minor version number
rados_create_internal -> rados_create_with_config
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
05:59 PM Revision 624410fb (ceph): librados: rados_ioctx_lookup -> rados_pool_lookup
rados_pool_lookup has nothing to do with io contexts!
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
05:28 PM Bug #897 (Resolved): RGW does not send content-length for HEAD requests sometimes
The attached patch fixes the issue. Also, Colin's patch got a positive review and will be merged into boto. Yehuda Sadeh
05:08 PM CephFS Subtask #879: Implement function to check fragstat and rstat on CDirs
Okay, I think this is done in the wip_mds_rstats branch. I'm going to leave it separate until I manage to solve #860 ... Greg Farnum
04:04 PM Bug #904 (Resolved): confutils: should warn about syntax errors
When a user has a syntax error in a configuration file, we should log a warning rather than silently doing the wrong ... Colin McCabe
04:00 PM Bug #902 (Resolved): libradys: sync up python bindings to librados changes
Created #903 to do the test.
Closing this bug since it's been implemented.
Colin McCabe
03:12 PM Bug #902: libradys: sync up python bindings to librados changes
should be resolved by commit:1065bef0eb777117a2950fa7fefeff8233b4e29e
still ought to write an autotest that makes ...
Colin McCabe
02:56 PM Bug #902 (Resolved): libradys: sync up python bindings to librados changes
Sage Weil
04:00 PM Bug #903 (Resolved): write an autotest that calls test-pybind.py
write an autotest that calls test-pybind.py to make sure that the python bindings don't break as librados changes. Colin McCabe
02:45 PM Bug #635 (Resolved): RHEL6 beta packaging breaks unexpected characters
commit:55bb9ef82135bdc93f200f3a0bc768114bbca598 Sage Weil
02:22 PM Bug #877 (Resolved): Qemu refuses to start with multiple RBD disks
The fix worked. Josh Durgin
11:00 AM Feature #901 (Resolved): autotest: get all 4 racks of sepia online
well, let's leave a few machines (10?) out of the pool. Sage Weil
10:59 AM Feature #900 (Resolved): qa: thrash in/out
Sage Weil
10:59 AM Feature #899 (Resolved): autotest: hammer rbd mount(s) with standard fs benchmarks
Sage Weil
09:48 AM Messengers Bug #882: misc leaks in librados
I thought I saw something related to and QEMU on the lists -- am I making that up, or have we identified the source o... Greg Farnum
09:47 AM Bug #893: no filesystem created if all mdses are configured for standby-replay
Well, the intention was that if you specified standby-replay that meant you didn't want it going active unless the MD... Greg Farnum
01:02 AM Revision a3475610 (ceph): direct_io_test: use mkstmp instead of mkostemps
mkostemps isn't present in older glibc versions, like the ones in CentOS
5.5. We don't really use any of the extra fu...
Colin Patrick McCabe
12:50 AM Revision 4db8801b (ceph): Makefile: check for new enough version of gtkmm
Versions older than 2.13 don't build, so check for that with automake.
Signed-off-by: Colin McCabe <colin.mccabe@dre...
Colin Patrick McCabe

03/17/2011

11:10 PM Revision 1e342b7e (ceph): osync: remove some debug printout
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:32 PM Revision 609b9c0d (ceph): rgw: handle swift auth requests
still doesn't really do anything Yehuda Sadeh
09:32 PM Revision 033eb9be (ceph): rgw: dump content length for certain operations
Yehuda Sadeh
07:50 PM Revision 2aaf2c60 (ceph): osync: first version
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
07:50 PM Revision 172f0a2c (ceph): osync: s3 fixes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
07:06 PM Revision 6b3baf2e (ceph): msgr: move test binaries to updated msgr bind/start interface
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:05 PM Revision acd7d744 (ceph): msgr: fix start() return value
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:00 PM Revision 601f5985 (ceph): PG,OSD: activate pg during replay
Replay PGs already accept and queue transactions. PGs will now go to
active during replay in order to simplify the s...
Samuel Just
06:59 PM Revision 68a2f46f (ceph): blobhash: Avoid size_t in templatized hash functions.
On S/390, the earlier rjhash<size_t> failed with
"no match for call to '(rjhash<long unsigned int>) (size_t&)'".
It s...
Tommi Virtanen
06:36 PM Revision ceb76bad (ceph): msgr: temp hack to keep nonce unique
Temp hack for: #877
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
06:33 PM Revision 7670b264 (ceph): msgr: let user explicitly set nonce
There will be problems if two messengers use the same entity_addr_t because
they are on the same ip and choose the sa...
Sage Weil
06:17 PM Revision 2fb9323c (ceph): config: whitespace fix
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:16 PM Revision e7e2bb88 (ceph): config: fix get_val, set_val
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:28 PM Revision 70d92b7f (ceph): librados: check whether objecter is initialized before shutting it down
Fixes failing unit test Librados.CreateShutdown
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
05:02 PM Bug #897: RGW does not send content-length for HEAD requests sometimes
http://groups.google.com/group/boto-dev/browse_thread/thread/0e007388ef08bf4c# Colin McCabe
04:40 PM Bug #897: RGW does not send content-length for HEAD requests sometimes
I posted a patch to boto-dev which allows libboto to handle a missing content-length as a 0 content-length. We'll jus... Colin McCabe
04:19 PM Bug #897: RGW does not send content-length for HEAD requests sometimes
That's the actual apache code that does it:... Yehuda Sadeh
04:02 PM Bug #897: RGW does not send content-length for HEAD requests sometimes
You're quoting the wrong symptom and the workaround stated here will not work:... Yehuda Sadeh
03:57 PM Bug #897 (Resolved): RGW does not send content-length for HEAD requests sometimes
RGW does not send content-length for HEAD requests when content-length would be 0. This breaks libboto:... Colin McCabe
05:01 PM Bug #898: vstart.sh fails if host has many IP addresses
Workaround when you're running on a single machine: ./vstart.sh --localhost Anonymous
05:00 PM Bug #898 (Resolved): vstart.sh fails if host has many IP addresses
As reported by Noah Watkins <jayhawk@cs.ucsc.edu> on the mailing list,
vstart.sh fails (confusingly) on some hosts. ...
Anonymous
02:22 PM rgw Bug #896 (Resolved): list buckets doesn't dump content length
apparently this breaks the boto library Yehuda Sadeh
11:57 AM Cleanup #878 (Resolved): osd: crashed+replay -> active[+clean]+replay
commit:601f59857e7347168799def55e846bb53e3bed50 Sage Weil
11:54 AM Bug #837 (Resolved): AuthAuthorizeHandler fails to build on s390
merging this for v0.26 to get some extra testing. no rush on s390 support :) Sage Weil
11:33 AM Bug #877: Qemu refuses to start with multiple RBD disks
Pushed fixes for stable and master branch. Sage Weil
11:17 AM Bug #884 (Resolved): testrados: glibc detected *** /home/ceph/ceph-server/src/.libs/lt-testrados:...
fixed by commit:e7e2bb884f29ac42df0dd2419861f87dd8c36005 Colin McCabe

03/16/2011

11:51 PM Revision d7c5c56c (ceph): rados tool: fix fd leak in import
Yehuda Sadeh
11:44 PM Revision 2dae8ad5 (ceph): objecter: close all sessions when shutdown
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:38 PM Revision 17b98e80 (ceph): rgw: fix plain formatting
Yehuda Sadeh
11:14 PM Revision cd40aabf (ceph): rgw: fix openstack list buckets with plain formatting
Yehuda Sadeh
09:52 PM Revision 24894694 (ceph): mds: fix replay of fragment ROLLBACK
In the rollback event the bits are negative. Replay accordingly.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
09:52 PM Revision 1fbd3a70 (ceph): mds: resync fragmentation during cache rejoin
During rejoin we may find that different MDSs have different fragmentation
for directories. When that happens we sho...
Sage Weil
09:52 PM Revision cae43fc7 (ceph): Makefile: drop libradosgw_a LDFLAGS
Fixes the warning
src/Makefile.am:299: variable `libradosgw_a_LDFLAGS' is defined but no program or
src/Makefile.am:...
Sage Weil
09:52 PM Revision 6fa470ba (ceph): common: disable log_per_instance for non-daemons
Turn off the logging and symlink rotation, not just symlink rotation.
This is a somewhat arbitrary distinction (log ...
Sage Weil
09:51 PM Revision 9b52da5d (ceph): rgw_admin: show '-' if bucket owner doesn't exist (in log)
Yehuda Sadeh
09:37 PM Bug #893: no filesystem created if all mdses are configured for standby-replay
It sounds like the monitor needs to make the mds as up:creating or up:starting (or up:replay) if the cluster isn't ye... Sage Weil
09:26 PM Bug #893: no filesystem created if all mdses are configured for standby-replay
That is quite clear. What gave me incorrect expectations is that IIRC it started the cluster successfully from a ful... Alexandre Oliva
08:57 AM Bug #893: no filesystem created if all mdses are configured for standby-replay
Hmm. Is http://ceph.newdream.net/wiki/Standby-replay_modes not clear enough?
> *mds standby replay*
>
> If this is...
Greg Farnum
09:21 PM Revision 32fce3ca (ceph): rados_create: correctly handle null id
Passing a null id to rados_create means "use the default id."
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
09:18 PM Revision f06f4eed (ceph): librados: always call keyring_init in connect
Formerly only the C interface was calling keyring_init in connect!
Signed-off-by: Colin McCabe <colin.mccabe@dreamho...
Colin Patrick McCabe
09:18 PM Revision 586fc66e (ceph): librados: don't call keyring_init in init_internal
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
08:53 PM Revision 9e1828af (ceph): objecter: make response_data bufferlist static
Putting it on the heap unnecessary additional complexity.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
08:38 PM Revision 251fd504 (ceph): rados_create_internal calls keyring_init
Yehuda Sadeh
08:32 PM Tasks #895 (Resolved): make backlogs charts work
See Charts under http://www.redminebacklogs.net/en/installation/
When I do rake redmine:backlogs:generate_chart_da...
Sage Weil
07:25 PM Revision c5489762 (ceph): rados_create: set id based on parameter
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
07:06 PM Revision b1c33216 (ceph): librados: add rados_create_internal
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
07:04 PM Revision dfa8e50e (ceph): Merge commit 'origin/rgw_librados_priv' into rgw
Yehuda Sadeh
06:52 PM Revision d1cea6ff (ceph): rgw: use rados::init_internal
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:37 PM Revision c9eccb95 (ceph): librados: add rados_create_internal
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:23 PM Revision a70b5a81 (ceph): filestore: return negative error code if open fails
ENOENT was being treated as a read of length 2, causing #890.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
05:57 PM Revision a772c8bb (ceph): rgw: merge crypto changes
Yehuda Sadeh
05:45 PM Revision 8f2392b8 (ceph): Merge commit 'origin/master' into rgw
Conflicts:
src/Makefile.am
src/rados.cc
src/rgw/rgw_admin.cc
src/rgw/rgw_main.cc
src/rgw/rgw_rest.cc
Yehuda Sadeh
05:35 PM Bug #877: Qemu refuses to start with multiple RBD disks
The default nonce (pid) used by SimpleMessenger was the problem. We'll have to figure out what we want to set it to. Josh Durgin
04:38 PM Bug #877: Qemu refuses to start with multiple RBD disks
Here's a snippet of this occurring with objecter and messenger debugging:... Josh Durgin
05:00 PM rgw Bug #894 (Resolved): openstack pseudo folders
the current implementation is not compatible with swift. Yehuda Sadeh
04:42 PM Messengers Bug #882: misc leaks in librados
The remaining messenger-related leak with --show-reachable=yes:... Josh Durgin
04:12 PM rgw Bug #343 (Resolved): Bad 100-Continue handling
Ok, tested it quite a bit and it seems that it's working without any problems. It's commit:3fed7a553db315a855f3b2f697... Yehuda Sadeh
04:08 PM rgw Bug #766: slow bucket creation times
It's much better now, though can still be somewhat slow. Yehuda Sadeh
04:06 PM rgw Feature #770: rgw: logging
We log user activity on the rgw. However, currently we don't provide any way for the users to see the logs. Yehuda Sadeh
01:48 PM Bug #870 (Resolved): The -dev packages are missing conflicts, could avoid SONAME in package name.
commit:b63d40649e06f962e3c23be1d86a11fc3a9ad23c Sage Weil
11:22 AM Bug #890 (Resolved): testradospp causes osd crash after running testlibrbd
Fixed by commit:a70b5a81a5c7ec29ab06eea162b7201b74d0510c. Josh Durgin
05:23 AM Revision 3f442f06 (ceph): init-ceph, mkcephfs: fix $name normalization
Strip leading . only, to tolerate osd0 and osd.0.
This also turns osd.....foo -> osd.foo, but that's better than
osd...
Sage Weil
05:21 AM Revision d7f6000b (ceph): init-ceph: use consistent $type.$id naming
Use $type.$id, regardless of what the user uses.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
05:18 AM Revision 844093fb (ceph): osd: only update last_epoch_started after all replicas commit peering r...
The PG info.history.last_epoch_started is important because it bounds how
far back in time we think we need to look i...
Sage Weil
03:57 AM Revision 87e6d372 (ceph): Merge remote branch 'origin/stable'
Sage Weil
01:41 AM Bug #802: osd: failing to send heartbeats (btrfs hang?)
I noticed that btrfs tends to freeze quite often when I use a journal within the osd tree, or within a separate ods's... Alexandre Oliva
12:17 AM Revision 5d7a12cf (ceph): rgw: explicit case mtime to uint64 before encoding/decoding
Yehuda Sadeh
12:16 AM Revision 6843a0b8 (ceph): rados tool: export bucket
Yehuda Sadeh

03/15/2011

11:32 PM Bug #893 (Resolved): no filesystem created if all mdses are configured for standby-replay
If the [mds] section contains:
mds standby replay = true
then, once nodes are started after mkcephfs, a...
Alexandre Oliva
10:36 PM Bug #891 (Resolved): osd: fix last_epoch_started updates
commit:844093fbf7cc47add68e5e8fcac52c6ec875dcc3 Sage Weil
09:28 PM Bug #891 (Resolved): osd: fix last_epoch_started updates
last_epoch_started is used to bound how far back in time we query other OSDs in order to recovery PG state (this is t... Sage Weil
10:21 PM Linux kernel client Bug #784 (Can't reproduce): kclient crash
Sage Weil
10:02 PM Cleanup #892 (Resolved): osd: remove class distribution infrastructure?
If we leave object class distribution to the administrator,
- the admin has to copy a .so into /usr/lib/ceph/class...
Sage Weil
10:00 PM Revision 9862afa4 (ceph): testlibrbd, testradospp: read default conf file
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
09:59 PM Revision 2319ae13 (ceph): logging: don't add --debug
--debug is already taken to change the global debug level.
Just offer -d for now.
Signed-off-by: Colin McCabe <colin...
Colin Patrick McCabe
09:49 PM Revision abc64b01 (ceph): logging: --foreground options reorganization
-f now just means stay in the foreground.
-d now means stay in the foreground and log to foreground.
Both options now...
Colin Patrick McCabe
08:18 PM Revision 22241f8d (ceph): librbd: int -> ssize_t for aio completion wrappers too
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
08:16 PM Revision d93c1184 (ceph): librbd: ssize_t return values for read, write
size_t is 32bits on 64bit archs. Use ssize_t (long) for return values.
Signed-off-by: Sage Weil <sage.weil@dreamhos...
Sage Weil
07:59 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
Hi ,
i git commit 22241f8daea36df602c9069c311f59e22670918c,
took the following steps to this issue.which should be ...
changping Wu
01:22 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
for what it's worth, I got these results at commit:ca613786f84d44f352fa4fee4ebd57f4b1ec4cdd... Colin McCabe
01:18 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
Hi Jeff,
I've pushed a few different patches cleaning up these type sizes. It's working on our end.. can verify t...
Sage Weil
01:42 AM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument

librbd.cc:line 1217,
modify
int total_write = 0;
to
to uint64_t total_write = 0;
int aio_write(ImageC...
changping Wu
01:24 AM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
hi ,
commit: 4ee75a881ec637e2b0c5b74b16b1e44ac710707c
modify
librbd.cc:read_iterate:line 1024 :
int tota...
changping Wu
07:43 PM Revision 3ecfbfbb (ceph): filestore: adjust op_queue throttle max during fs commit
The underlying FS (btrfs at least) will block writes for a period while it
is doing a commit. If an OSD workload is ...
Sage Weil
07:43 PM Revision 24342a71 (ceph): filestore: instrument filestore, journal throughput and throttling
Signed-off-by: Sage Weil <sage@newdream.net>
Conflicts:
src/os/FileJournal.cc
src/os/FileStore.cc
src/os/FileSto...
Sage Weil
06:15 PM Revision 4c22c159 (ceph): librados: add default to rados_conf_read_file
In rados_conf_read_file, read from the default configuration file
locations if the library user passes NULL as the lo...
Colin Patrick McCabe
06:15 PM Revision 51b93726 (ceph): testrados: test default conf file location
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:07 PM Revision ca613786 (ceph): rbd: int -> int64_t on do_export
Prevent 32-bit overflow.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
04:47 PM Revision 174aa56c (ceph): librbd: use int64_t for read_iterate
The read_iterate can cover > addressable memory on 32-bit archs.
Reported-by: Jeff Wu <cpwu@tnsoft.com.cn>
Signed-of...
Sage Weil
01:31 PM Bug #890 (Resolved): testradospp causes osd crash after running testlibrbd
Backtrace:... Josh Durgin
01:18 PM Tasks #889 (Resolved): librbd.cc : more int ->uint64_t
Sage Weil
09:44 AM Tasks #889: librbd.cc : more int ->uint64_t
Oh, nevermind, I see why it matters (read_iterate can cover more data because it goes in pieces).
should be fixed ...
Sage Weil
09:39 AM Tasks #889: librbd.cc : more int ->uint64_t
In both of these cases, we can read no more than the size_t len. In practical terms, we will never read more than wh... Sage Weil
02:08 AM Tasks #889 (Resolved): librbd.cc : more int ->uint64_t
Hi ,
1.
commit : 4ee75a881ec637e2b0c5b74b16b1e44ac710707c
still exist some of params that need modify int ->uint6...
changping Wu
12:41 PM Bug #531 (Resolved): Journaling Causes System Hang
commit:24342a71919e50e81a8c05682a5687b2e54d649b Sage Weil
11:00 AM Bug #632 (Won't Fix): init script won't stop an instance that's been removed from config
I don't think we're going to fix this one. Sage Weil
10:14 AM Linux kernel client Bug #571 (Closed): client hangs after osd disconnection
Sage Weil
10:13 AM Linux kernel client Bug #502 (Won't Fix): honor osdmap FULL flag
The osd returns ENOSPC if it's map is full. This is more reliable since we don't have to worry about the client gett... Sage Weil
10:11 AM Linux kernel client Bug #782 (Won't Fix): mount -o name=client.foo fails (name=foo succeeds)
Sage Weil
09:55 AM Feature #728 (Closed): automate package builds
Sage Weil
07:59 AM Bug #868: librbd::AioCompletion::add_block_completion causes Qemu to crash
Let me get back on that. While 20GB went fine, 100GB did not.
In my logs I found:...
Wido den Hollander
05:49 AM Bug #868: librbd::AioCompletion::add_block_completion causes Qemu to crash
Seems to be working here too. I didn't notice the memory usage which you are describing, but I could have missed it.
...
Wido den Hollander
12:11 AM Revision 4ee75a88 (ceph): objecter: fix leak of bufferlist from MPoolOpReply
bufferlist->claim already clears the source bufferlist,
but setting it to NULL prevented it from being destroyed.
Si...
Josh Durgin

03/14/2011

11:44 PM Revision 723a9265 (ceph): Merge branch 'stable'
Conflicts:
configure.ac
debian/changelog
src/cfuse.cc
src/rgw/rgw_rest.cc
Sage Weil
11:13 PM Revision 58ffd37e (ceph): rados tool: close dir after reading through
Yehuda Sadeh
11:09 PM Revision 84b65b5c (ceph): rados tool: recursively import from dir to pool
Yehuda Sadeh
11:04 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument

$ uname -a
Linux cephhost 2.6.35-24-generic #42-Ubuntu SMP Thu Dec 2 02:41:37 UTC 2010 x86_64 GNU/Linux
changping Wu
10:54 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
$ ./src/rbd ls -p foo
10GB
10GB is a file created by " dd if=/dev/zero of=./10GB bs=1M count=10240" at local d...
changping Wu
10:46 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument

Hi ,
I verified this issue,
use master commit: 4ee75a881ec637e2b0c5b74b16b1e44ac710707c
export file size > 2Gb...
changping Wu
10:45 PM Revision df8c0094 (ceph): cfuse: set proper defaults
Since cfuse usually runs as a nonprivileged user, its defaults must be a
little different from those of the other dae...
Colin Patrick McCabe
10:39 PM Revision db25852f (ceph): cfuse: always daemonize hack
Always daemonize, until the next round of common_init fixes lands.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
10:39 PM Revision 7f4a161e (ceph): v0.25.1
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:16 PM Revision 448010f2 (ceph): osd: small pull recovery adjustments
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:14 PM Revision 4046c4b7 (ceph): ReplicatedPG,OSD: Track which osds we are pulling from
Currently, a PG waiting on a pull from a dead OSD cannot continue
recovery. ReplicatedPG::pull now tracks open pulls...
Samuel Just
10:01 PM Revision a7fba4c8 (ceph): vstart.sh: escape " "
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:47 PM Revision aed8227c (ceph): rgw_rest: fix printf format specifier
32-bit
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
09:47 PM Revision e55047d1 (ceph): rados: fix map type
32-bit build issue
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
09:44 PM Revision 52542be8 (ceph): librbd: delete block completion in aio_read callback
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
09:44 PM Revision 2b8ef02d (ceph): librados: initialize done in C_NotifyComplete
Caught by valgrind, this was uninitialized in the caller.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
09:44 PM Revision 87056e1a (ceph): monclient: fix leak of AuthClientHandler
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
09:44 PM Revision a94cf48b (ceph): testlibrbdpp: read conf file and don't double-delete AioCompletion
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
09:40 PM Revision a0e81758 (ceph): librados: fix size_t -> uint64_t
Only comes up on 32-bit builds.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
09:40 PM Tasks #888 (Resolved): get new sepia machines into autotest pool
Sage Weil
09:39 PM Revision 66603cfa (ceph): librbd: more off_t and size_t -> uint64_t changes
These only pop on up on 32-bit builds.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
09:38 PM Tasks #887 (Rejected): gitbuilder dash?
It would be cool to have a page that shows the top summary lines from each of the gitbuilder instances. The colored ... Sage Weil
09:23 PM Revision d99b5b66 (ceph): mds: journal fragment rollback events
If we rollback a prepared but uncommitted dir refragment, journal it!
This prevents a pattern like
2011-03-14 09:53:...
Sage Weil
09:23 PM Revision c52dc5e0 (ceph): vstart: put logging options in daemon sections, not [global]
We don't want random command line utils to have non-default logging
behavior.
Signed-off-by: Sage Weil <sage.weil@dr...
Sage Weil
08:22 PM Revision 8954d2b3 (ceph): Merge branch 'stable'
Conflicts:
src/include/rados/librados.h
src/include/rados/librados.hpp
src/librados.cc
Sage Weil
08:20 PM Revision d01bd862 (ceph): librbd: size_t -> uint64_t on internal resize
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
08:15 PM Revision 9bfdf4b7 (ceph): librados: use uint64_t for extent len in extmap
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
08:13 PM Revision b468d67d (ceph): librados: fixup rados_trunc
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:22 PM Revision 7218b090 (ceph): radosgw: first authorize user then try to read the acls
can't read acls if user wasn't authorized yet. Yehuda Sadeh
05:23 PM Messengers Bug #882: misc leaks in librados
The only remaining leak whose backtrace came from the messenger is:... Josh Durgin
05:14 PM Bug #868: librbd::AioCompletion::add_block_completion causes Qemu to crash
I noticed prior to crashing like this, qemu would consume lots of memory. I fixed a bunch of memory leaks in aio hand... Josh Durgin
05:09 PM Revision bc5b27aa (ceph): librados: make AioCompletions delete themselves when released
AioCompletion->release() already accounted for the implementation, but the wrapper was kept around. Josh Durgin
04:17 PM Support #885 (Resolved): "librados" C API support get_fs_stats
commit:610c76d87e456dee6f79fd61e09276e4a2b8c683 Sage Weil
12:19 AM Support #885 (Resolved): "librados" C API support get_fs_stats
Hi ,
Could you add C API support for
int librados::RadosClient::get_fs_stats(ceph_statfs& stats)
?
To get ...
changping Wu
03:23 PM Bug #864 (Resolved): osd: pull doesn't fail when pulled-from node restarts
commit:448010f27ea767a3c810358b5a49c77e14e65787 Sage Weil
02:49 PM Tasks #827 (Resolved): Make i386 build cleanly in gitbuilder
Sage Weil
02:47 PM Revision 8126621d (ceph): cpp_strerror: handle negative error code
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
02:46 PM Revision 1fe9c544 (ceph): cpp_strerror: handle negative error code
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:57 PM Revision 610c76d8 (ceph): librados: rename statfs to cluster_stat
Yehuda Sadeh
12:56 PM Revision 1695c0ef (ceph): librados: add statfs to C interface
also rename the corresponding C++ method Yehuda Sadeh
12:48 PM Revision fe917607 (ceph): librbd: uint64_t for image sizes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Sage Weil
12:48 PM Revision b8280df9 (ceph): rados, rbd: off_t -> uint64_t
off_t is 32-bit on 32-bit archs when compiled without _FILE_OFFSET_BITS=64.
Avoid any such ambiguity in the library i...
Sage Weil
12:10 PM Revision 25fcb6ba (ceph): Revert "librados,librbd: use 64-bit offsets and lengths"
This reverts commit f294b26746a30960971757c42d679208a99995a7. Colin Patrick McCabe
11:54 AM Bug #837: AuthAuthorizeHandler fails to build on s390
There's a stab in the dark that might solve this in branch tv-blobhash-837. Anonymous
11:39 AM Revision 77444412 (ceph): logging: disable log_sym_history for non-daemons
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:10 AM CephFS Cleanup #886 (Resolved): journaler: rip out ack_barrier cruft
This is from when the MDS used to submit some journal events waiting for ack and some for commit/safe. It ensured th... Sage Weil
12:00 AM Bug #884 (Resolved): testrados: glibc detected *** /home/ceph/ceph-server/src/.libs/lt-testrados:...
Hi ,
reproduce steps:
1. ceph version: master 34cf240d70d1992263e32931031b2ba6cd497f14
2.testrados.c ,set rados_...
changping Wu

03/13/2011

09:57 AM Feature #883 (Resolved): osync tool
Build a simple tool for syncing object buckets from s3, swift, rados, and/or a directory.
Maybe use argument synt...
Sage Weil

03/12/2011

06:00 AM Revision 8acdb914 (ceph): mds: fix stray anchortable debug spam
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:59 AM Revision 34cf240d (ceph): buffer: disable buffer alloc tracking by default
This can have high overhead on SMP systems.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
02:49 AM Revision 7ae5c984 (ceph): librbd: free RBD::AioCompletion when it's released
Josh Durgin
02:49 AM Revision e1605c8b (ceph): librados: cleanup RadosClient's objecter instance when destroyed
Josh Durgin
02:49 AM Revision e172de98 (ceph): librados: Remove OperationOp from WatchCtx
It was unused and doesn't need to be on the heap. Josh Durgin
02:49 AM Revision 3a5b4efe (ceph): librbd: don't leak rados_completion
The implementation is already referenced by librados callbacks, so it
will stick around.
Josh Durgin
02:49 AM Revision f6f1d635 (ceph): librbd: delete block completion after it's finished
Josh Durgin
12:50 AM Revision 277d8ce6 (ceph): rgw: avoid duplicate openstack users
Yehuda Sadeh
12:22 AM Revision a373a3d5 (ceph): mkcephfs: some fixes
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:13 AM Revision b63d4064 (ceph): debian: Conflict on earlier -dev packages with sonames.
This ensures a smooth, automatic transition, by telling apt/dpkg that
it's ok to replace the old package with the new...
Tommi Virtanen

03/11/2011

11:51 PM Revision b0831f21 (ceph): rgw_admin: typo
Yehuda Sadeh
11:35 PM Revision 06d9262c (ceph): rgw: remove bucket metadata object on bucket delete
Yehuda Sadeh
11:34 PM Revision 2574968e (ceph): rgw: configurable prefix for openstack urls
Yehuda Sadeh
10:57 PM Revision 8218486e (ceph): Merge remote branch 'origin/stable'
Conflicts:
debian/control
Sage Weil
10:46 PM Revision 28931877 (ceph): autoconf: Fix typo that made --without-gtk2 not work.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
10:11 PM Revision 5d0fa63a (ceph): autoconf: Handle --without-debug, --with-debug=junk properly.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
10:08 PM Revision 5613e367 (ceph): autoconf: Handle --without-profiler, --with-profiler=junk properly.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:56 PM Revision bccffecb (ceph): autoconf: If given --with-gtk2, not finding it is fatal.
Use --with-gtk2=check (default) if you're ok with both cases.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhos...
Tommi Virtanen
09:13 PM Revision 4a93e525 (ceph): auth: Change header file guard define, to make room for non-auth crypto.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision d95367cb (ceph): rgw: Make rgw_op use MD5 via compatibility shim.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision efa2506b (ceph): ceph_crypto: Add unittests for the MD5 compatibility shim.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision edcf6a0a (ceph): ceph_crypto: Implement MD5 wrapper for NSS.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision 7e099f95 (ceph): rgw: Make rgw_main use HMAC-SHA1 via compatibility shim.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision 2921d6b4 (ceph): ceph_crypto: Add unittests for the HMAC-SHA1 compatibility shim.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision a60ac551 (ceph): ceph_crypto: Implement HMAC-SHA1 wrapper for NSS.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision c58b0ab4 (ceph): common: Initialize ceph_crypto in common_init.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision 367131a0 (ceph): auth: Let common_init (or CephCrypto::init) init auth crypto.
This avoids doing it in a global constructor.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
Tommi Virtanen
09:13 PM Revision 420289d4 (ceph): auth: Add unit tests to check basic crypto sanity.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision 6cef992c (ceph): auth: Drop "using namespace", it's almost always used explicitly anyway.
This helps us be agnostic about what crypto library is in use.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamho...
Tommi Virtanen
09:13 PM Revision ff24c82d (ceph): auth: Use AES IV constant directly, not via local static pointer.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision dfbb5ea4 (ceph): auth: Make error message on bad AES key lenght say the bad length too.
Helps debugging.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
Tommi Virtanen
09:13 PM Revision 3424e3ac (ceph): auth: Allow using NSS as crypto library.
Added new configure flag --with-nss that enables this. NSS is also
automatically used if it is available and CryptoPP...
Tommi Virtanen
09:13 PM Revision 55ab9765 (ceph): auth: Add a microbenchmark for AES encrypt/decrypt.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision f81e5452 (ceph): rgw: use random byte generation in auth/Crypto, instead of CryptoPP.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
09:13 PM Revision 10b0da92 (ceph): Add test/osd/RadosModel.h to noinst_HEADERS.
Caught by "make distcheck".
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
Tommi Virtanen
09:13 PM Revision e639a932 (ceph): auth: Removed unused function generate_random_string.
It doesn't sound like a good idea in the first place, with
embedded zero bytes terminating the string prematurely.
S...
Tommi Virtanen
09:09 PM Revision 5df13bb0 (ceph): autoconf: Complain if FUSE is not found.
Use --without-fuse if you don't want it.
Fixes part of #826.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhos...
Tommi Virtanen
09:09 PM Revision a9afdca1 (ceph): autoconf: Complain if tcmalloc is not found.
Use --without-tcmalloc if you don't want it.
Fixes part of #826.
Signed-off-by: Tommi Virtanen <tommi.virtanen@drea...
Tommi Virtanen
09:09 PM Revision a2c02d17 (ceph): autoconf: Complain if libatomic-ops is not found.
Use --without-libatomic-ops if you don't want it.
Fixes part of #826.
Signed-off-by: Tommi Virtanen <tommi.virtanen...
Tommi Virtanen
08:55 PM Revision 5c960e1d (ceph): osd: wait for handle_osd_map transaction ondisk without doing a full sync
Doing a full sync (forcing a btrfs transaction etc) was just wrong here.
All we (might) care about is whether our Obj...
Sage Weil
08:55 PM Revision e731885d (ceph): osd: avoid setting up_thru on new PGs
This trades off the possibility of peering blockage if the OSDs in the
first interval (after pg creation) go down and...
Sage Weil
07:24 PM Revision 3fb4fd86 (ceph): utime: fix operator double() to use the right number of zeros.
We should probably use a const (or even a #define would be better)
instead of typing out the constant in all these pl...
Greg Farnum
06:08 PM Revision f294b267 (ceph): librados,librbd: use 64-bit offsets and lengths
size_t is usually 32-bit on 32-bit architectures and 64 on 64-bit ones.
On the other hand, we want our offsets and le...
Colin Patrick McCabe
05:43 PM Revision d1d2e870 (ceph): debian: add udev rules
Add /lib/udev/rules.d/50-rbd.rules to debian package.
crbdnamer generates the dev path:
/dev/rbd/<pool>/<name>:<numbe...
Sage Weil
05:23 PM Revision 8ec6fff9 (ceph): osd: fix osdmap scanning on pg creation
On PG creation we were scanning the complete history of all osdmaps ever.
Fix initialization of PG::Info::History epo...
Sage Weil
05:19 PM Bug #876 (Resolved): rbd export rbd image > 2GB, export error: Invalid argument
Colin McCabe
05:14 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
fixed by commit:f294b26746a30960971757c42d679208a99995a7 Colin McCabe
04:42 PM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
Looks like rbdtool goes wacky when you try to create an image of more than 4200 MB (or so). At least on 32 bit. Colin McCabe
11:20 AM Bug #876: rbd export rbd image > 2GB, export error: Invalid argument
Hi Jeff,
What version are you using? A commit id would be best.
C.
Colin McCabe
04:32 PM Bug #881: confutils: memory leaks
Taking a closer look at this, it looks like there are some real errors in the ConfUtils class. The other stuff is jus... Colin McCabe
04:18 PM Bug #881: confutils: memory leaks
It would be best to replace those char* in md_config_t with std::string. With all the strdup antics going on, I'm sur... Colin McCabe
04:01 PM Bug #881 (Resolved): confutils: memory leaks
Running valgrind --leak-check=yes .libs/lt-testlibrbd reveals several leaks in configuration and initialization. I'm ... Josh Durgin
04:06 PM Messengers Bug #882: misc leaks in librados
Repurposing duplicate for the messenger leaks. Josh Durgin
04:01 PM Messengers Bug #882 (Closed): misc leaks in librados
Running valgrind --leak-check=yes .libs/lt-testlibrbd reveals a few leaks in the messenger:... Josh Durgin
03:46 PM Feature #812 (Closed): switch up crypto library (again)
Merged as 367131a0ae10a083b39d8d2516c22d4056a1b54d. Anonymous
03:43 PM Bug #870: The -dev packages are missing conflicts, could avoid SONAME in package name.
I see 95db4c5cb868c26567e3f5095108481aa7e76a80 renamed the -dev packages.
That's going to be problematic for upgra...
Anonymous
02:58 PM Revision 55f2b31b (ceph): Destructors for virtual classes should be virtual
Add -Wnon-virtual-dtor to the makefile. Fix the warnings that were
generated.
Signed-off-by: Colin McCabe <colin.mcc...
Colin Patrick McCabe
02:56 PM rbd Feature #699 (Resolved): support snapshot notify
Sage Weil
02:47 PM Bug #880 (Closed): automake: --without-gtk2 doesn't work
... Anonymous
02:39 PM Bug #880 (Closed): automake: --without-gtk2 doesn't work
... Colin McCabe
02:46 PM Subtask #825: osd: remove pg map updating from handle_osd_map
I don't think this is necessary now that the syncs and multiple flushes are gone. Sage Weil
02:30 PM Revision 290637f6 (ceph): atomic.h: fix "crappy slow implementation"
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:48 PM Bug #835 (Resolved): osd: avoid the sync in handle_osd_map
commit:5c960e1de9eba1aedb97506d8a61a48619271e69 Sage Weil
01:47 PM Bug #788 (Resolved): slow btrfs commits
commit:5c960e1de9eba1aedb97506d8a61a48619271e69 Sage Weil
01:46 PM Linux kernel client Bug #856 (Resolved): busy loop osd reconnects if osd is down
Sage Weil
01:22 PM CephFS Subtask #879 (Resolved): Implement function to check fragstat and rstat on CDirs
Write a function that compares the number of primary links the CDir has to what it has in its fragstat, and that comp... Greg Farnum
01:10 PM Bug #826 (Closed): autoconf: don't autodect fuse, tcmalloc, etc.
Done:
a2c02d1 autoconf: Complain if libatomic-ops is not found.
a9afdca autoconf: Complain if tcmalloc is not fou...
Anonymous
12:56 PM Revision 0cc42531 (ceph): testlibrbdpp: include assert.h
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:37 PM Revision f9e83804 (ceph): librados: librados::WatchCtx needs virtual dtor
This one was definitely biting because librados itself calls delete on
these objects, deleting them through a pointer...
Colin Patrick McCabe
11:32 AM Revision 435470b3 (ceph): osd: CapMap: add virtual dtor to virtual class
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:23 AM Bug #836: atomic-ops error on Debian arm
It does build successfully without the atomic-ops package installed at all. Attempting to get it building with an old... Greg Farnum
11:19 AM Revision c077d6ff (ceph): crushtool: fix warning seen on i386
Fix implicit narrowing warning seen on i386
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
10:21 AM Cleanup #878 (Resolved): osd: crashed+replay -> active[+clean]+replay
this is old code that is implemented in an awkward way. the pg statuses are also confusing. should be easy to fix. Sage Weil
10:01 AM Feature #849 (Resolved): include rbd udev rules in packages
Sage Weil
09:50 AM Linux kernel client Bug #498 (Can't reproduce): reconnect sends string with NULL?
Sage Weil
09:49 AM Bug #513 (Closed): limited xattrs length
Sage Weil
09:49 AM Bug #378 (Closed): test dir fragmentation (single mds)
Sage Weil
09:48 AM Bug #491 (Can't reproduce): osd: pg incorrectly going active
Sage Weil
09:48 AM Bug #327 (Closed): OSD crash PG::IndexedLog::print
Sage Weil
09:46 AM Bug #102 (Closed): Fix signal handler
Sage Weil
09:45 AM Bug #99 (Closed): Check return codes everywhere
Sage Weil
09:43 AM CephFS Feature #12 (Resolved): uclient: Make cap handling smarter
ages ago Sage Weil
09:38 AM Bug #762 (Can't reproduce): cmon: PGMonitor::encode_pending() assert failure
Sage Weil
07:12 AM Bug #877 (Resolved): Qemu refuses to start with multiple RBD disks
When trying to start a VM with multiple RBD disks attached, this fails, I keep getting a "hunting for new mon"
<pr...
Wido den Hollander
01:09 AM Revision 1f57d492 (ceph): tests: add bufferlist unit test
pushing_back an empty bufferptr to an empty bufferlist should be a noop.
In particular, the bl.begin() should be equa...
Samuel Just
12:42 AM Revision adaa2f08 (ceph): rados: Add "stat" option, and fix "put" to work on larger block sizes.
We didn't have a stat option, now we do.
Previously, "put" allocated its read space on the stack. That meant
the max ...
Greg Farnum
12:38 AM Revision 4a8400b2 (ceph): clitest: Fix tests after osdmaptool --clobber bugfix.
Commit 5c8146b55dbd60bdfa47b53b93f2769f7d0524dc fixed clobber,
adjust clitests to match. Reordered test logic to have...
Tommi Virtanen
12:08 AM Revision 863ef7c3 (ceph): debian: add udev rules
Add /lib/udev/rules.d/50-rbd.rules to debian package.
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Samuel Just

03/10/2011

11:13 PM Bug #876 (Resolved): rbd export rbd image > 2GB, export error: Invalid argument
Hi ,
reproduce steps:
1).ceph v0.25.
2) Imported a 10GB image into foo pool
$ rbd ls -p foo
10GBB
10GBrbd
3...
changping Wu
11:11 PM Revision d1f9e5f3 (ceph): osd: fix keyring loading
Load keyring if NOT mkfs.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
10:57 PM Revision 5c8146b5 (ceph): osdmaptool: don't require clobber to create new osdmap
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:17 PM Revision 95db4c5c (ceph): debian: remove so version from -dev packages
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:06 PM Revision 924adafe (ceph): filestore: assert on ENOTEMPTY
ENOTEMPTY implies rmdir failed due to stray crap in the directory. We
should fail now, instead of later when we rest...
Sage Weil
07:34 PM Revision 00f2deec (ceph): rgw: can read old buckets format
Yehuda Sadeh
07:20 PM Revision d3464af7 (ceph): filer: set RMW bit on probe
Setting the RMW bits on the probe stat call will make the OSD wait for
pending writes on the object to flush to disk....
Sage Weil
06:17 PM Revision 0abf2c9b (ceph): osd: fix peer no missing optimization
This shortcut was broken: we need to populate peer_missing with missing
objects in terms of the master log, not the p...
Sage Weil
06:01 PM Revision f04b6adc (ceph): rgw: can turn off logging
Yehuda Sadeh
05:54 PM Revision 99ef6f6c (ceph): osd: fix missing.rm()
The version specifies which version of the object no longer should be
missing. We should thus remove it from the mis...
Sage Weil
05:44 PM Revision 62054fdb (ceph): osd: fix merge_log missing calculation at split point when logs diverge
If primary log is something like
1'1
1'2
1'3
and remote log is
1'1
1'2
2'3
2'4
2'5
Then 1'2 is the split ...
Henry Chang
04:59 PM Feature #812: switch up crypto library (again)
In branch tv-nss-crypto, commit 329fcc4dd5bb83ece520a9316c5fb1b35562e867. Will get merged after a brief code review, ... Anonymous
04:33 PM Feature #875 (Resolved): osd: clean up old osdmaps
This should be easier to do on the osd if the monitor keeps the full history (for now) Sage Weil
04:18 PM CephFS Bug #805 (Resolved): mds startup: _replay journaler got error -22, aborting
The misread size got fixed by commit: d3464af7d046cfff887127710ad9656b4877c452.
The issue with lost data is an unl...
Greg Farnum
11:25 AM CephFS Bug #805: mds startup: _replay journaler got error -22, aborting
After discussion with Sage, it turns out that we don't need to worry about later blocks getting accepted but earlier ... Greg Farnum
04:11 PM Revision d0abd58e (ceph): mkcephfs: modularize
The goal is to support the old "ssh to everything" mode and also a
piecewise mode that lets the administrator do each...
Sage Weil
03:59 PM Feature #400 (Resolved): mkcephfs: work on multiple nodes without using ssh
commit:cda125087a00f81a9363a1e7d4aa232e2e219517 Sage Weil
03:50 PM Bug #836: atomic-ops error on Debian arm
Managed to reproduce this issue locally. I'll try building without atomic-ops too, to see if that works. And will int... Greg Farnum
03:49 PM Revision 8e3abf3c (ceph): Don't use -i to set id for non-daemons
Due to conflicts, don't use -i to set id except for daemons.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
03:29 PM Revision 33d6251a (ceph): common: replace -I with -i, rework --name
Remove -I. All programs will take -i to set ID now.
Support setting the type and id simultaneously with --name or -n...
Colin Patrick McCabe
03:11 PM Bug #874 (Duplicate): Fix configure checks for g++
I'm not sure what the exact problem is, but when attempting to build Ceph on arm I had issues with the configure scri... Greg Farnum
03:06 PM Revision 79605f5a (ceph): cauthtool: remove short form of --create-keyring
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:57 PM CephFS Bug #873 (Resolved): MDS journaler needs to truncate ahead of writes
As discussed briefly in #805, there is a race condition due to MDS failover where an old MDS could have written log d... Greg Farnum
01:34 PM Revision c56e1a92 (ceph): Merge branch 'globalfoo'
Colin Patrick McCabe
01:32 PM Revision a6d0a994 (ceph): librbd.cc: trim includes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:20 PM Revision 9f32c500 (ceph): cram: test --conf=foo cconf syntax
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:20 PM Revision 7fe7a816 (ceph): common_init: Split common_init into multiple parts
Split common_init into several different parts which can be called
individually from libraries. Eliminate startup_fla...
Colin Patrick McCabe
01:16 PM Revision 88063e3b (ceph): config: trim deadcode
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:13 PM Bug #872 (Resolved): osd: crash due to missing pginfo
Sage Weil
01:11 PM Bug #872: osd: crash due to missing pginfo
Wido den Hollander wrote:
> Just thought about this, will this something a admin would run into? I ran into this due...
Sage Weil
12:22 PM Bug #872: osd: crash due to missing pginfo
Just thought about this, will this something a admin would run into? I ran into this due to the recovery issue. But i... Wido den Hollander
11:56 AM Bug #872: osd: crash due to missing pginfo
I do not think that crashing due to one faulty dir is what I'd do, but on the other hand, it will force a admin to ke... Wido den Hollander
11:43 AM Bug #872: osd: crash due to missing pginfo
Ah, this is my fault. I made a copy of the files in 3.7c9 in a subdir called 't' (they were missing xattrs... :/) wh... Sage Weil
05:52 AM Bug #872 (Resolved): osd: crash due to missing pginfo
I just upgraded "noisy" and saw osd1 go down after restart with:... Wido den Hollander
12:49 PM Bug #790 (Resolved): convert read, write, pread, pwrite to sage's safe versions
Colin McCabe
12:47 PM Subtask #842 (Resolved): initialization: have appropriate library-specific defaults
library-specific defaults can be set in common_preinit or in the library itself after commit:7fe7a8165af16501c255e3a6... Colin McCabe
12:44 PM Subtask #840 (Resolved): Clean separation between different components of initialization
Done via commit:7fe7a8165af16501c255e3a6a11eedf55d5cad7b.
Libraries don't need to call common_init any more, with ...
Colin McCabe
12:38 PM Subtask #841 (Resolved): don't call daemon_init in library code
librados and librbd are now doing the right thing as of commit:7fe7a8165af16501c255e3a6a11eedf55d5cad7b
libceph is...
Colin McCabe
01:06 AM Revision 2bbe83ea (ceph): rgw: escape certain strings in log dump
Yehuda Sadeh

03/09/2011

09:29 PM Revision d0faba06 (ceph): rgw: fix acl checking when object does not exist
In that case we also need to check the bucket acl so that we can
return the correct error code.
Yehuda Sadeh
09:28 PM Revision c6072195 (ceph): rgw: log also includes the REST operation
Yehuda Sadeh
07:58 PM Revision d4d1a8c0 (ceph): rgw: get acl explicitly return success
also don't crash if op didn't explicitly set the http return code Yehuda Sadeh
07:49 PM Revision 6a19790e (ceph): rgw: fix log when object not specified
Yehuda Sadeh
07:43 PM Revision 8148d694 (ceph): ConfUtils::_parse: fix uninitialized var
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
04:06 PM Bug #868: librbd::AioCompletion::add_block_completion causes Qemu to crash
hmm.. looking at the librbd::aio_write(), we loop through the blocks, creating a completion and triggering a write fo... Yehuda Sadeh
02:13 PM Bug #868: librbd::AioCompletion::add_block_completion causes Qemu to crash
Finally managed to reproduce this using virtio and cache=writeback. I'm not sure if it'll occur in other configuratio... Josh Durgin
03:08 PM CephFS Bug #805: mds startup: _replay journaler got error -22, aborting
Okay, here's the problem. The previous object is ... Greg Farnum
01:05 PM Revision 20c1ffb5 (ceph): config: ConfFile::open: return error code
Return a integer result code specifying why we failed, if we fail.
Signed-off-by: Colin McCabe <colin.mccabe@dreamho...
Colin Patrick McCabe
12:06 PM Revision 326cb5c2 (ceph): build:add common/entity_name.h to noinst_HEADERS
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:42 AM Revision 8f0fd62f (ceph): makefile:Suppress hash warning in include/encoding
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:31 AM Feature #828 (Resolved): make cpu profiler work
oprofile, another sampling profiler, is working.
I wrote a wiki page about using oprofile with Ceph. It's at:
htt...
Colin McCabe
12:49 AM Revision c9135519 (ceph): rgw: add logging
Yehuda Sadeh

03/08/2011

11:08 PM Revision 1f120284 (ceph): Suppress gnu_cxx::hash warning a little bit better
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:59 PM Revision 058b3531 (ceph): config.cc: retab
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
09:25 PM Revision 0d7b9533 (ceph): rgw: cast size_t to unsigned long to fix a 32-bit warning.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
09:24 PM Revision deca678f (ceph): librbd: cast offset values to uint64_t for unsigned comparison warning.
It seems that size_t, off_t, and le64 have different signed/unsigned
properties on 32 and 64-bit Linux platforms, so ...
Greg Farnum
08:30 PM Revision bb5aa7e8 (ceph): Merge branch 'stable'
Greg Farnum
08:30 PM Revision cf6b1de4 (ceph): uclient: Clear the CEPH_CAP_FILE_BUFFER ref on _flush, if safe.
Previously we just returned if safe, but leaving the CEPH_CAP_FILE_BUFFER
ref around breaks _fsync horribly. The root...
Greg Farnum
04:52 PM CephFS Bug #805: mds startup: _replay journaler got error -22, aborting
So, the MDS that originally wrote that journal object got blacklisted shortly after writing it, and then a standby MD... Greg Farnum
02:39 PM CephFS Bug #805 (In Progress): mds startup: _replay journaler got error -22, aborting
We got this on our playground today. I have found one promising lead. Object 200.0001b88d_head is the last object in ... Greg Farnum
04:43 PM rgw Feature #770: rgw: logging
done with commit:c9135519b2eff07480b6ae81262162f0e5fac57b. Yehuda Sadeh
04:39 PM Revision dae26c55 (ceph): common_init: call to ProfilerFlush is unneeded
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
04:38 PM Revision e11bf6fe (ceph): Replace g_conf.name and g_conf.id with entityname
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
02:59 PM Revision d789d551 (ceph): makefile: Add -Wno-deprecated
Until we can replace gnu_cxx::hash_map with std::tr1::unordered_set,
build with -Wno-deprecated.
Signed-off-by: Coli...
Colin Patrick McCabe
02:36 PM Revision 30791abe (ceph): Merge branch 'globalfoo'
Colin Patrick McCabe
02:32 PM Revision d79d4e39 (ceph): Add missing includes
Don't rely on header files being included in a certain order or
combination.
Signed-off-by: Colin McCabe <colin.mcca...
Colin Patrick McCabe
02:32 PM Revision 37f1c172 (ceph): Create common/entity_name.h
Create common/entity_name.h. Refactor EntityName a bit.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
02:32 PM Revision b9da5f9a (ceph): common_init: no signal handlers for library code
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:21 PM Bug #859 (In Progress): Ceph does not pass fsstress
Well, I got it to finish a run-through while testing my cfuse fix. Still need to reproduce and debug the rstat issue,... Greg Farnum
12:12 PM CephFS Tasks #862 (Resolved): cap_refs[CEPH_CAP_FILE_BUFFER] isn't cleared if truncation zaps changes
Pushed to stable in commit:cf6b1de4a692ca0f3e86a600bcf4642723ccade7, and merged stable into master. Greg Farnum
08:56 AM CephFS Tasks #862: cap_refs[CEPH_CAP_FILE_BUFFER] isn't cleared if truncation zaps changes
Ah, so it doesn't call delete on the oset. That was just me misreading the code.
However, I still believe it does ...
Greg Farnum
12:26 AM Revision 56548b2e (ceph): mds: use projected subtree in rename anchor check
We want to (try to) reanchor the directory on rename when our _projected_
subtree is not a leaf. If we use the norma...
Sage Weil

03/07/2011

10:22 PM Revision eb31edd9 (ceph): Merge commit 'origin/master' into rgw
Conflicts:
debian/control
src/rgw/rgw_rest.cc
Yehuda Sadeh
09:44 PM Revision 67b61875 (ceph): librados: add append to object
Yehuda Sadeh
07:40 PM Revision 065b5189 (ceph): osd: document last_epoch_clean caveat
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
07:34 PM Revision 1cd878b1 (ceph): Bump debian/changelog timestamp so it's greater than previous one.
This shuts up lintian, and just makes sense.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
Tommi Virtanen
07:33 PM Revision 6ef3b676 (ceph): Make git ignore stamp files from debian build.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
07:32 PM Revision 425570ae (ceph): osd: include all stray peers in might_have_unfound
We should always consider any OSD that has a copy of the PG as a possible
location for missing objects. There are ca...
Sage Weil
07:06 PM Revision d97064e5 (ceph): Typos.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
05:19 PM Revision dc8ff94e (ceph): Merge branch 'mds'
Greg Farnum
04:32 PM Tasks #860: mds rstat assert failure on fsstress
Looked at this with Sage, and we're stumped. Hopefully this will become easier to reproduce once we deal with the oth... Greg Farnum
04:28 PM CephFS Tasks #861 (Resolved): handle_client_rename thinks nonexistent dir is in subtree map
After discussion, this was because the directory in question had a projected parent but not a parent, as it hadn't be... Greg Farnum
03:23 PM CephFS Tasks #862: cap_refs[CEPH_CAP_FILE_BUFFER] isn't cleared if truncation zaps changes
Okay, looks like the problem has to do with update_inode_file_bits calling objectcacher->truncate_set(). This:
1) ca...
Greg Farnum
01:36 PM CephFS Tasks #862: cap_refs[CEPH_CAP_FILE_BUFFER] isn't cleared if truncation zaps changes
Oh well, duh, those aren't the same inode. So for some reason the cap_refs[CEPH_CAP_FILE_BUFFER] count is off, or not... Greg Farnum
11:04 AM CephFS Tasks #862 (In Progress): cap_refs[CEPH_CAP_FILE_BUFFER] isn't cleared if truncation zaps changes
Greg Farnum
03:23 PM Tasks #863 (Resolved): osd spinning during fsstress
should be fixed in 67c8b91dd5a9ea6fd508b7544e397154ba330142 Samuel Just
01:34 PM Revision 67c8b91d (ceph): buffer.h: push_back,push_front of an empty buffer pointer should be noop
Also adds an assert to copy to ensure that bufferlist iterator copy
completes.
Signed-off-by: Samuel Just <samuel.ju...
Samuel Just
01:14 PM Revision b533727d (ceph): libceph: when calling common_init,set library flag
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:49 PM rbd Bug #867 (Resolved): Configure script is not updated to new librados API
Thanks for noticing this. I just removed the CEPH_OSD_TMAP_SET test because it precedes librbd. Fixed by 3a4df898b200... Josh Durgin
04:49 AM rbd Bug #867: Configure script is not updated to new librados API
We probably want to add a include for "rbd/librbd.h" here too, just to make sure librbd is present on the system. Wido den Hollander
12:44 PM Subtask #839: Globals cleanup. Replace g_conf.name with g_conf.entity_name.to_str(). Remove g_con...
fixed by 86e8b161535a08c2032a77a05b93cde7e59f59b3 Colin McCabe
12:44 PM Subtask #839 (Resolved): Globals cleanup. Replace g_conf.name with g_conf.entity_name.to_str(). R...
Colin McCabe
11:40 AM Bug #865: osd: mark pg clean only after purging strays
documented in commit:065b518996db67491fab4fe65f075185e14ee88d. not sure if this is really worth fixing.. it means th... Sage Weil
11:08 AM Cleanup #871: replace gnu_cxx::hash_map with tr1::unordered_set
the gcc message I referred to is here http://www.mail-archive.com/gcc-bugs@gcc.gnu.org/msg99225.html Colin McCabe
11:07 AM Cleanup #871 (Resolved): replace gnu_cxx::hash_map with tr1::unordered_set
gcc has started giving me this warning message about gnu_cxx::hash_map:... Colin McCabe
11:08 AM Bug #779 (Can't reproduce): mds: loses port information
Sage Weil
11:04 AM Revision 468ce23e (ceph): do_autogen: add -O2 when compiling for profiling
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:10 AM Bug #870 (Resolved): The -dev packages are missing conflicts, could avoid SONAME in package name.
You can't install librados1-dev.deb and librados2-dev.deb at the same time anyway, they both contain /usr/include/rad... Anonymous
09:20 AM Bug #848 (Resolved): limited commit_partial probably broke mds recovery
Greg Farnum
09:20 AM Bug #848: limited commit_partial probably broke mds recovery
Okay, after discussing this with Sage he's happy -- if we lose the journal there's not a lot we can do about partial ... Greg Farnum
09:11 AM Feature #524 (Resolved): object_locator_t
MOSDOp message updated by commit:6fd6db7ffec625d58dfe0d6e18becb6593609576 Sage Weil

03/06/2011

06:08 PM Bug #793 (Resolved): osd: avoid blocking in scrub_wq
merged in commit:0fb5ef2ce92a0c9f5cc755744e4f9ff2b0951d11 Sage Weil
05:27 AM Revision 94a4e862 (ceph): Merge branch 'stable'
Sage Weil
05:26 AM Revision 1b99add0 (ceph): tests/cli/osdmaptool: default pg_num changed
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:50 AM Revision d4e4af1b (ceph): testlibrbd: signed return types
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:41 AM Revision 8fe0f48b (ceph): filestore: fix signedness so we can handle errors from safe_pread
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:40 AM Revision 69c7e59c (ceph): version: fix const warning
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:40 AM Revision aa251bd6 (ceph): safe_io: fix signed/unsigned comparisons
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:39 AM Revision 0cbfbee3 (ceph): tests/cli/osdmaptool: default pg_num changed
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:44 AM phprados Tasks #869 (Resolved): Update to new librados API
Update phprados to the new librados API Wido den Hollander

03/05/2011

11:27 PM Revision 7a529d58 (ceph): crush: remove misleading comment
This is a stale comment from an earlier iteration of the implementation.
Reported-by: Alexander Lyakas <alex.bolshoy...
Sage Weil
11:27 PM Revision 46d63d98 (ceph): crush: fix memory leak
Reported-by: Alexander Lyakas <alex.bolshoy@gmail.com>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
11:27 PM Revision 10bc2d99 (ceph): Merge branch 'next'
Conflicts:
configure.ac
debian/changelog
debian/control
src/Makefile.am
src/cmds.cc
src/cosd.cc
src/include/ra...
Sage Weil
09:59 PM Revision 3fa121bf (ceph): v0.25
Sage Weil
09:59 PM Revision 4ac08810 (ceph): Bump librados soname to 2.
Update Debian packaging. For human-only mentions of librados,
use just "librados"
Signed-off-by: Tommi Virtanen <tom...
Sage Weil
09:30 PM Revision 82282f25 (ceph): config: back to 6 pg bits for now
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:44 AM Bug #868: librbd::AioCompletion::add_block_completion causes Qemu to crash
I've attached gdb to backtrace what is going on:... Wido den Hollander
07:04 AM Bug #868 (Can't reproduce): librbd::AioCompletion::add_block_completion causes Qemu to crash
I've updated my Qemu to the latest code and am experiencing crashes on my system.... Wido den Hollander
04:13 AM rbd Bug #867 (Resolved): Configure script is not updated to new librados API
The current configure script is not updated to the new librados API, attached is a patch to fix this. Wido den Hollander

03/04/2011

11:46 PM Revision 3d629383 (ceph): osd: debug the hell out of heartbeat thread
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:25 PM Revision 08af63da (ceph): rgw: put object request returns etag
Yehuda Sadeh
10:19 PM Revision 46b01f4a (ceph): Merge branch 'osd_recovery' into next
Sage Weil
10:19 PM Revision c07f3578 (ceph): test_missing_unfound: asdf
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:11 PM Revision 072a4bd2 (ceph): rgw: rest put returns with etag on all APIs
Yehuda Sadeh
10:11 PM Revision 43f6a39c (ceph): rgw: remove warnings
Yehuda Sadeh
10:00 PM Revision 2494d593 (ceph): osd: requeue pg for recovery if we may have found someting
If we get a peer log/missing and call search_for_missing, requeue the pg
for recovery so we can pull anything we may ...
Sage Weil
09:59 PM Revision 53428c0e (ceph): osd: include all up peers in might_have_unfound when desperate
If our might_have_unfound calculation was off (it currently can be, see
#865) we could prematurely give up. Try any ...
Sage Weil
09:57 PM Revision fbc73704 (ceph): rgw: openstack HEAD on container responds with metadata
Yehuda Sadeh
05:39 PM Revision 30c5091c (ceph): osd: recover_primary if recover_replicas starts no ops
recover_replicas may fail to start anything if we see an unexpected error.
In that case, try recover_primary immediat...
Sage Weil
05:38 PM Revision 836f72a1 (ceph): osd: discover more missing if unfound and do_recovery can't start anything
If we couldn't start any recovery ops and things are still
unfound, see if we can discover more missing object locati...
Sage Weil
05:38 PM Tasks #863: osd spinning during fsstress
This seems to be caused by the following chain:
1) bufferlist iterator copy from a bufferlist containing one empty...
Samuel Just
12:55 PM Tasks #863 (Resolved): osd spinning during fsstress
During some fsstress runs, I've managed to end up with an OSD spinning at 100% cpu, making no apparent progress, whic... Greg Farnum
05:30 PM Revision 88cc244e (ceph): do_autogen.sh: add -P option
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:21 PM Bug #837: AuthAuthorizeHandler fails to build on s390
Current understanding:
it's the key hashing function for an in-RAM hash table
Plan:
rewrite hash table to us...
Anonymous
03:21 PM Feature #697 (Resolved): create rbd library
Sage Weil
02:23 PM Bug #847 (Resolved): OSD: Recovery does not complete, PG's stay active
phew! all pgs are now active+clean. hopefully scrub won't turn anything up :)
Sage Weil
04:47 AM Bug #847: OSD: Recovery does not complete, PG's stay active
I've searched the logs again for rb.0.1.00000000a638/head and I found:... Wido den Hollander
02:17 AM Bug #847: OSD: Recovery does not complete, PG's stay active
I think it was syslog. The logger machine is not on the same location, could be that there is a bandwith issue which ... Wido den Hollander
02:17 PM rgw Bug #866 (Resolved): RGW PUT object does not responds with etag
Fixed in commit:08af63da1e78c47444720f6d443421ff2b5badb1. Yehuda Sadeh
02:15 PM rgw Bug #866: RGW PUT object does not responds with etag
This causes the s3cmd utility to spit errors when trying to upload an object. Yehuda Sadeh
02:03 PM rgw Bug #866 (Resolved): RGW PUT object does not responds with etag
Yehuda Sadeh
01:40 PM Bug #865 (Won't Fix): osd: mark pg clean only after purging strays
Right now we set last_epoch_clean prior to cleaning replicas (and actually becoming "clean"). This means we might ha... Sage Weil
01:09 PM CephFS Tasks #861: handle_client_rename thinks nonexistent dir is in subtree map
Server.cc:4722 passes ... Greg Farnum
12:51 PM CephFS Tasks #861 (Resolved): handle_client_rename thinks nonexistent dir is in subtree map
... Greg Farnum
01:00 PM Bug #864 (Resolved): osd: pull doesn't fail when pulled-from node restarts
Recovery should continue. Sage Weil
12:53 PM CephFS Tasks #862 (Resolved): cap_refs[CEPH_CAP_FILE_BUFFER] isn't cleared if truncation zaps changes
... Greg Farnum
12:46 PM Tasks #860 (Resolved): mds rstat assert failure on fsstress
This is during an unlink.... Greg Farnum
12:44 PM Bug #859 (Resolved): Ceph does not pass fsstress
So far we haven't gotten Ceph to successfully run the Linux Test Project's fsstress test. A typical run for us looks ... Greg Farnum
12:43 PM CephFS Bug #858 (Resolved): cfuse craps out with fsstress
I have yet to see any cfuse issues with this. I will continue running and reopen if it does, but in the meantime I wi... Greg Farnum
09:31 AM Linux kernel client Bug #852: secret key shows up in /etc/mtab after mount -o secretfile=/.../key
> Tv, can you see if the kernel key management stuff is appropriate here?
That is what I wanted to do. They alre...
Anonymous
09:06 AM Linux kernel client Bug #853: bonnieloop.sh
First time, I think. Samuel Just
06:32 AM Revision 964f1e19 (ceph): Fix test/signals.cc
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:34 AM Revision ab74d498 (ceph): librados: cosmetic header changes
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:10 AM Revision e779a3c0 (ceph): librados, librbd: use separate IoCtxs for data and metadata
Adds deep copy method IoCtx::dup, so that the data and metadata
contexts can have different snap_seqs and snap contex...
Josh Durgin
12:10 AM Revision 37edd473 (ceph): librbd: fix error message and unnamed constant
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
12:08 AM Revision 49343296 (ceph): librbd: change RBD::open to take a reference to an Image instead of a p...
This makes the API more consistent with the librados API.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
12:08 AM Revision fdd50a15 (ceph): librados: remove unused member of IoCtx
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
12:08 AM Revision 1de0b274 (ceph): librados: IoCtx destructor should put reference only if initalized
Yehuda Sadeh
12:06 AM Revision 2e3b8448 (ceph): librados: can set up object locator
Yehuda Sadeh
12:05 AM Revision f45a790f (ceph): librados:rados_ioctx_stat -> rados_ioctx_pool_stat
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:05 AM Revision 3ebaa4c7 (ceph): object_locator: fix clear()
Yehuda Sadeh
12:04 AM Revision b2ceb75c (ceph): librados: use atomic_t for reference count
Use an use atomic_t for the reference count in IoCtxImpl.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
12:04 AM Revision 6f797af1 (ceph): librados: make IoCtxImpl a pointer in WatchContext
Adds get and put to IoCtxImpl for refcounting,
and uses them in WatchContext, which shouldn't
be creating a copy of t...
Josh Durgin
12:04 AM Revision 773f0034 (ceph): librados: decrement refcount of old io_ctx_impl in assignment operator
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
12:04 AM Revision 0e32cd2f (ceph): librados: fix IoCtx::from_rados_ioctx_t
IoCtx::from_rados_ioctx_t creates an IoCtx out of a rados_ioctx_t.
However, this IoCtx must share ownership of the Io...
Colin Patrick McCabe
12:03 AM Revision ecab94ca (ceph): Rename radios_ioctx_{open,close} to create/destroy
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:03 AM Revision ae77624b (ceph): librados: remove IoCtx::close()
We decided we don't want IoCtx::close(), since IoCtx::~IoCtx() exists.
Signed-off-by: Colin McCabe <colin.mccabe@dre...
Colin Patrick McCabe
12:03 AM Revision 7d06b1b2 (ceph): Make git ignore core files.
Tommi Virtanen
12:03 AM Revision 77880416 (ceph): Make git ignore python generated files.
Tommi Virtanen
12:02 AM Revision 7d6a4fc6 (ceph): librados: Crashed on shutdown if connect was never called.
Add a trivial unit test to trigger this. Tommi Virtanen
12:00 AM Revision b7340431 (ceph): libradoshpp: put ceph stuff in namespace librados
Try a little bit harder to avoid polluting the user's global namespace
with our stuff.
Signed-off-by: Colin McCabe <...
Colin Patrick McCabe
12:00 AM Revision b97388f9 (ceph): librados: don't create unused SnapContext objs
There were some unused temporary variables hanging around.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
12:00 AM Revision 062dd5eb (ceph): librados: fix copy ctor of ObjectIterator
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe

03/03/2011

11:59 PM Revision 46d6214b (ceph): testrados: add object stat test
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:59 PM Revision 60482f5a (ceph): testlibrbd: recreate test pool each time
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:48 PM Revision 2a4b0d1d (ceph): radosgw_admin: change usage, improve uid lookup
commands can get also either the email or the openstack uid Yehuda Sadeh
11:24 PM Revision 75f7ea30 (ceph): librbd: fix error message and unnamed constant
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:24 PM Revision a6ef9077 (ceph): librados, librbd: use separate IoCtxs for data and metadata
Adds deep copy method IoCtx::dup, so that the data and metadata
contexts can have different snap_seqs and snap contex...
Josh Durgin
10:54 PM Revision 1ed2d8c5 (ceph): Fix test/signals.cc
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
10:15 PM Revision 9bd627d1 (ceph): rgw: can show bucket size and count
Yehuda Sadeh
09:50 PM CephFS Bug #858: cfuse craps out with fsstress
1) Spinning the cpu. I have logs and a core file but haven't looked into them deeply. (one of my spare disks I use fo... Greg Farnum
09:26 PM CephFS Bug #858: cfuse craps out with fsstress
Greg Farnum wrote:
> What kind of issues are you expecting to crop up here? I've so far run across:
> 1) an issue w...
Sage Weil
05:28 PM CephFS Bug #858: cfuse craps out with fsstress
What kind of issues are you expecting to crop up here? I've so far run across:
1) an issue with cosd spinning that I...
Greg Farnum
09:46 PM Revision a41865e3 (ceph): messanger: shouldn't throw sigpipe on failed socket
Yehuda Sadeh
09:33 PM Linux kernel client Bug #853: bonnieloop.sh
Did it do this the first time, or after a few runs? Sage Weil
09:32 PM CephFS Bug #854: unsynchronized clocks between kernel-client/cmds cause PJD fstest failures
The only reasonably sane idea I have here is for the client/mds to compare clocks to estimate skew and have some sort... Sage Weil
09:29 PM Linux kernel client Bug #852: secret key shows up in /etc/mtab after mount -o secretfile=/.../key
Tv, can you see if the kernel key management stuff is appropriate here?
The client key is static.. only needs to...
Sage Weil
08:59 PM Linux kernel client Bug #855 (Resolved): fsstress kernel opps
Samuel Just wrote:
> Ah, just noticed that it's fixed in commit:fe7c17ec5ec0851550e32be986788e367b1f8e00.
Yeah th...
Sage Weil
05:50 PM Linux kernel client Bug #855: fsstress kernel opps
Ah, just noticed that it's fixed in fe7c17ec5ec0851550e32be986788e367b1f8e00. Samuel Just
05:44 PM Linux kernel client Bug #855: fsstress kernel opps
Annoyingly, I am suddenly having some trouble triggering the bug, but the previous output suggests the get_user_pages... Samuel Just
04:06 PM Linux kernel client Bug #855: fsstress kernel opps
New debug output, pages is invalid out of ceph_get_direct_page_vector on O_DIRECT.
[ 1231.684328] ceph: ...
Samuel Just
07:56 PM Revision 8c3133e5 (ceph): configure: fix profiler check
Yehuda Sadeh
07:44 PM Revision bb42a71b (ceph): configure: fix profiler check
Yehuda Sadeh
07:26 PM Revision 6a686c8f (ceph): Merge branch 'master' into rgw
Conflicts:
src/Makefile.am
Yehuda Sadeh
04:43 PM Revision b37facc3 (ceph): msgr: fix typo
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:50 PM Revision b941cfdc (ceph): common: block SIGPIPE everywhere we can
It's much better to get EPIPE than SIGPIPE.
Block SIGPIPE in all threads we create. In the daemon, block SIGPIPE in
...
Colin Patrick McCabe
03:50 PM Revision 3b34e2f3 (ceph): messanger: shouldn't throw sigpipe on failed socket
Yehuda Sadeh
03:25 PM Revision d1fce13f (ceph): common: block SIGPIPE everywhere we can
It's much better to get EPIPE than SIGPIPE.
Block SIGPIPE in all threads we create. In the daemon, block SIGPIPE in
...
Colin Patrick McCabe
03:23 PM Feature #828: make cpu profiler work
This still isn't working for me on current master (with and without the last SIGPIPE patch).... Sage Weil
01:58 PM Bug #847: OSD: Recovery does not complete, PG's stay active
Starting looking through your logs to debug this but it really looks like they are incomplete.. either syslog is drop... Sage Weil
11:35 AM Bug #847: OSD: Recovery does not complete, PG's stay active
Just checked another PG (just to make sure), 3.22b in this case:... Wido den Hollander
10:51 AM Bug #847: OSD: Recovery does not complete, PG's stay active
I searched for the object:... Wido den Hollander
08:35 AM Bug #847: OSD: Recovery does not complete, PG's stay active
Can you look manually on the OSDs for the objects that it's showing as 'still unfound'? rb.0.1.00000000f6c0/head bec... Sage Weil
03:14 AM Bug #847: OSD: Recovery does not complete, PG's stay active
I tried the new branch, but it isn't working as expected yet.
When following the progress I saw:...
Wido den Hollander
12:30 PM Revision ed01fa1f (ceph): dout: Log version message when (re)opening log
Log a version message whenever we open the dout log, not just the first
time. However, only output it to log files an...
Colin Patrick McCabe
12:24 PM Revision 82c5f3a8 (ceph): Thread: don't mask signals except in library code
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:15 PM Revision 5c668d2b (ceph): dout: Log version message when (re)opening log
Log a version message whenever we open the dout log, not just the first
time. However, only output it to log files an...
Colin Patrick McCabe
11:25 AM Feature #857 (Resolved): log open marker
implemented by commit:5c668d2b1737ffb823b68b51bae94c89b70122ee Colin McCabe
10:56 AM Linux kernel client Bug #856: busy loop osd reconnects if osd is down
hopefully fixed by commits in for-linus, see commit:c3d5a0cd56fa1b57db04aa151a994424657cf264 among others Sage Weil
09:34 AM Bug #848: limited commit_partial probably broke mds recovery
Hmmm. I was under the impression that inconsistencies like that would be taken care of during journal replay (ie, the... Greg Farnum
08:53 AM Bug #848: limited commit_partial probably broke mds recovery
I'm afraid this still isn't right, because the header in the CDir object includes recursive stats that should be accu... Sage Weil
02:52 AM Revision 1ad48f12 (ceph): CDir: Don't write out the header on a partial commit.
If we write out the header as part of a partial commit, and then
fail to complete a subsequent commit (network error,...
Greg Farnum
02:49 AM Revision a7126649 (ceph): CDir: pay attention to the max_dir_commit_size!
Somehow it seems to have been ignoring this previously, which
doesn't make any sense at all since otherwise our tests...
Greg Farnum
12:37 AM Revision abf46a9f (ceph): Merge branch 'tcmalloc_optimizations'
Greg Farnum
12:18 AM Revision f12e1a98 (ceph): tcmalloc: warn if you try and dump without the profiler running.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
12:13 AM Revision d467fbfd (ceph): mds: rip out rename linkmerge support
It turns out POSIX says rename(a,b) is a no-op when a and b link to the
same inode. This is super weird but good new...
Sage Weil
12:08 AM Revision f36e4582 (ceph): tcmalloc: create perfglue handle_command functionality.
Switch the OSD and MDS to use it, instead of handling
the calls on their own. Note that this is a command interface c...
Greg Farnum
12:04 AM Revision ae72c608 (ceph): Merge remote branch 'origin/master' into locator
Yehuda Sadeh
12:04 AM Revision aac1e958 (ceph): locator: pool id is signed
Yehuda Sadeh

03/02/2011

11:55 PM Revision 3fccc0a9 (ceph): qa/workunits: added fsstress.sh
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
11:29 PM Revision 39d70de2 (ceph): osd: drop old ceph_osd_request_head
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
11:29 PM Revision 6fd6db7f (ceph): osd: new encoding for MOSDOp when OBJECTLOCATOR feature is present
The new encoding includes the object_locator_t. It also avoids the old
C struct.
Signed-off-by: Sage Weil <sage.wei...
Sage Weil
10:56 PM Revision 71e46d8f (ceph): osd: add OBJECTLOCATOR protocol feature bit
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
10:24 PM Revision 3e09e1c1 (ceph): encode locator information in osd op
Yehuda Sadeh
10:23 PM Linux kernel client Bug #855: fsstress kernel opps
Sam, are you able to reproduce this? I have a possible fix, but want to make sure it's the right thing first. If we... Sage Weil
04:22 PM Linux kernel client Bug #855: fsstress kernel opps
somewhat more readable, from teh console:... Sage Weil
03:17 PM Linux kernel client Bug #855: fsstress kernel opps
Forgot to mention: This is on ceph1 with sepia mounted. Also, the kernel output occurred just just after I hit ^C t... Samuel Just
03:16 PM Linux kernel client Bug #855 (Resolved): fsstress kernel opps
/usr/lib/ltp/testcases/bin/fsstress -d . -l 1 -n 1000 -p 10
Message from syslogd@ceph1 at Wed Mar 2 15:13:50 2011...
Samuel Just
10:13 PM Revision 07bf9b82 (ceph): tcmalloc: switch the interface.
Previously, we used function pointers. Fun for me to learn about, icky
to actually have!
Now we use our own wrapper f...
Greg Farnum
10:01 PM CephFS Bug #858 (Resolved): cfuse craps out with fsstress
... Sage Weil
09:58 PM Revision 5edf58a3 (ceph): testradospp: don't try to read /etc/ceph/ceph.conf explicitly
Yehuda Sadeh
09:39 PM Revision 75e2a077 (ceph): cmds/cosd: Fix IsHeapProfilerRunning implicit return type cast.
G++ complains about the difference between the return type of tcmalloc's
IsHeapProfilerRunning (int) and the return t...
Alexandre Oliva
09:29 PM Feature #857 (Resolved): log open marker
We used to have a marker every time the log is (re)opened that included process name, pid, log file, and ceph version... Sage Weil
09:10 PM Revision 1a2e2a77 (ceph): msgr: fix chdir after daemonize
We don't care of the mkdir succeeds. It has dubious value anyway, though;
if you specify a unique directory for the d...
Sage Weil
06:38 PM Bug #848: limited commit_partial probably broke mds recovery
I haven't tested this yet, but I pushed a short fix to the mds branch which takes advantage of message ordering and I... Greg Farnum
06:20 PM Revision f76cf9b7 (ceph): librbd: change RBD::open to take a reference to an Image instead of a p...
This makes the API more consistent with the librados API.
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Josh Durgin
05:50 PM Revision a6167332 (ceph): mds: drop some dead code
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
05:41 PM Revision b6bfa8c5 (ceph): mds: fix one rename dentry linkage projection case
There are more. :(
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
03:36 PM Revision 64186f99 (ceph): dout: Reopen dout after parsing all config opts
Reopen the dout stream only after we parse all configuration options.
Specifying --log-file on the command line now w...
Colin Patrick McCabe
03:33 PM Revision bf1ae374 (ceph): dout: remove g_conf.log_to_file
Remove the log_to_file configuration option. Instead, only log to a file
if either log_file or log_dir is set.
This ...
Colin Patrick McCabe
03:29 PM Revision 5ebd4f86 (ceph): logging: default to foreground logging
At global constructor time: default to logging everything to stderr.
During common_init: set appropriate logging def...
Colin Patrick McCabe
03:29 PM Revision 0c87dfda (ceph): dout: Reopen dout after parsing all config opts
Reopen the dout stream only after we parse all configuration options.
Specifying --log-file on the command line now w...
Colin Patrick McCabe
03:26 PM Linux kernel client Bug #856 (Resolved): busy loop osd reconnects if osd is down
This is fallout from commit:ab48fe45f3f51e54975be158a9b4ca3ec90d4aad.
There is a confusing and subtle breakdown ...
Sage Weil
03:16 PM Revision 07b99e85 (ceph): dout: remove g_conf.log_to_file
Remove the log_to_file configuration option. Instead, only log to a file
if either log_file or log_dir is set.
This ...
Colin Patrick McCabe
02:44 PM CephFS Bug #854: unsynchronized clocks between kernel-client/cmds cause PJD fstest failures
Ah, that makes sense. This is something we're unlikely to fix -- currently a lot of operations occur "on" the MDS (re... Greg Farnum
02:32 PM CephFS Bug #854 (Duplicate): unsynchronized clocks between kernel-client/cmds cause PJD fstest failures
I'm seeing a varied number (generally 5-8) of POSIX tests within the PJD fstest suite failing when the tests are bein... Brian Chrisman
02:40 PM Revision 67355779 (ceph): Merge branch 'logging'
Colin Patrick McCabe
02:40 PM Revision b9224d81 (ceph): logging: default to foreground logging
At global constructor time: default to logging everything to stderr.
During common_init: set appropriate logging def...
Colin Patrick McCabe
01:52 PM Linux kernel client Bug #852: secret key shows up in /etc/mtab after mount -o secretfile=/.../key
we should probably be using keyctl?
http://www.ibm.com/developerworks/linux/library/l-key-retention.html
Sage Weil
12:32 PM Linux kernel client Bug #852 (Resolved): secret key shows up in /etc/mtab after mount -o secretfile=/.../key
mount.ceph reads secretfile in and passes mount the actual secret. It becomes <hidden> in /proc/mounts, but /etc/mta... Alexandre Oliva
01:51 PM Revision c916905a (ceph): osd: cache map bufferlists until they are flushed to disk
Another thread may share maps with a peer. Make sure they pull bufferlists
out of our cache if this happens prior to...
Sage Weil
01:29 PM Revision d5da4f07 (ceph): safe_io: fix signed/unsigned comparisons
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
01:22 PM Linux kernel client Bug #853: bonnieloop.sh
Kernel client: 7751b01 Samuel Just
01:17 PM Linux kernel client Bug #853 (Resolved): bonnieloop.sh
On ceph1 and ceph2 I ran bonnieloop.sh against sepia (simultaneously). In both cases, I got the following output:
...
Samuel Just
12:49 PM Revision e55c2a94 (ceph): osd: handle osd_ping (and ack requests) while !active
In particular, we may start getting ping requests before getting (or while
processing) our first map that makes us go...
Sage Weil
12:49 PM Revision 7cd8ac0b (ceph): osd: trigger discover_all_missing after replay delay
We were calling discover_all_missing only when we went immediately active,
not after we were in the replay state (whi...
Sage Weil
12:49 PM Revision 49bbe0af (ceph): mds: fix one rename dentry linkage projection case
There are more. :(
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
12:49 PM Revision 74f5bc50 (ceph): mds: drop some dead code
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
02:40 AM Bug #339: OSD crash: ReplicatedPG::sub_op_modify
Hit this bug yesterday. The gdb output:... Henry Chang
12:29 AM Revision 0fb5ef2c (ceph): Merge remote branch 'origin/scrub_noblock'
Sage Weil
12:25 AM Revision c031e5af (ceph): CDentry/CDir/CInode: Add comment on use of boost::pool.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com> Greg Farnum
12:10 AM Revision f353f596 (ceph): osd: simple test for random missing objects during recovery
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:04 AM Revision 0b886a8f (ceph): librados: remove unused member of IoCtx
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
12:03 AM Revision b86461dc (ceph): osd: recovery cleanups, better error messages
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
12:02 AM Revision 29cb6f86 (ceph): osd: update missing_loc when infering an empty missing set
We infer an empty missing set, but weren't calculating object locations
based on that. Usually it was okay because w...
Sage Weil
12:01 AM Revision f74593ee (ceph): osd: fix unfound output
We were printing unfound when not, and vice versa.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil

03/01/2011

11:19 PM Revision 7c2e4bfa (ceph): librados: IoCtx destructor should put reference only if initalized
Yehuda Sadeh
11:11 PM Revision f3bdfc57 (ceph): osd: add object to missing if we find it missing on disk
If the recovery finds the object missing on disk during recovery, add it
to the local missing set so we can (hopefull...
Sage Weil
11:01 PM Revision 9359cb58 (ceph): Makefile.am: fix for testlibrbdpp
Yehuda Sadeh
10:42 PM Revision 14592345 (ceph): osd: (semi-)handle case where primary copy isn't there
Continue recovering, at least.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
10:25 PM Revision 5997059a (ceph): osd: continue recovery after encountering missing objects
1- If we try to pull an object that isn't there, send an empty push in
reply.
2- If we get an empty push, call a new...
Sage Weil
10:20 PM Revision afbd7050 (ceph): librados: can set up object locator
Yehuda Sadeh
09:53 PM Revision 26dfe159 (ceph): object_locator: fix clear()
Yehuda Sadeh
08:06 PM Revision 412af3ec (ceph): librados: make IoCtxImpl a pointer in WatchContext
Adds get and put to IoCtxImpl for refcounting,
and uses them in WatchContext, which shouldn't
be creating a copy of t...
Josh Durgin
08:06 PM Revision fa8fa401 (ceph): rgw: bucket creation uses tmap for atomic update
Yehuda Sadeh
08:06 PM Revision a524c093 (ceph): rgw: initialize bucket creation time
Yehuda Sadeh
08:06 PM Revision 3e4cf6fe (ceph): rgw: Remove unused definition of "SERVER_NAME"
Wido den Hollander
08:06 PM Revision 5bc1a332 (ceph): rgw: Remove unused CGI_PRINTF lines
Wido den Hollander
07:35 PM Revision f013b8a7 (ceph): librados: decrement refcount of old io_ctx_impl in assignment operator
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
07:26 PM Revision 644bcb6c (ceph): debian: add libcurl dependency
Yehuda Sadeh
07:26 PM Revision 4ed8bec6 (ceph): debian: fix libcurl dependency again
Yehuda Sadeh
07:26 PM Revision 3552c29b (ceph): debian: remove extra dependencies
Yehuda Sadeh
07:25 PM Revision d3285d65 (ceph): rgw: move things around, separate implementations
Yehuda Sadeh
07:25 PM Revision 090a7c0b (ceph): rgw: move authorization to the specific rest handlers
Yehuda Sadeh
07:25 PM Revision fc63d973 (ceph): rgw: can output data in multiple formats
Yehuda Sadeh
07:25 PM Revision 543b9864 (ceph): rgw: add missing files
Yehuda Sadeh
07:25 PM Revision 93e56b61 (ceph): rgw: openstack: list containers, list objects
Yehuda Sadeh
07:25 PM Revision fecf37e2 (ceph): rgw: openstack: implement some more functionality
Yehuda Sadeh
07:25 PM Revision 4e3ad0c6 (ceph): rgw: fix get obj
Yehuda Sadeh
07:25 PM Revision be6f8489 (ceph): rgw: openstack put object fixes
Yehuda Sadeh
07:25 PM Revision 0bad44a7 (ceph): rgw: multiple openstack, rgw_admin fixes
Yehuda Sadeh
07:25 PM Revision e2c11254 (ceph): Makefile.am: update noinst_HEADERS with new rgw headers
Yehuda Sadeh
07:25 PM Revision 0a4f4d72 (ceph): configure: add libcurl dependency for rgw
Yehuda Sadeh
07:24 PM Revision 3428fe3f (ceph): rgw: verify openstack tokens
Yehuda Sadeh
07:24 PM Revision fe871d98 (ceph): rgw: keep openstack user to rgw user mapping
Yehuda Sadeh
07:24 PM Revision 3e62d8a2 (ceph): rgw: add a cache layer for the backend
Yehuda Sadeh
07:24 PM Revision 57d0c17b (ceph): rgw: fix crash
Yehuda Sadeh
07:24 PM Revision c77c753e (ceph): rgw: disable cache
Yehuda Sadeh
06:36 PM Revision 57248073 (ceph): testrados: add object stat test
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
06:33 PM Revision 58d60e04 (ceph): testlibrbd: recreate test pool each time
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
04:52 PM Bug #802: osd: failing to send heartbeats (btrfs hang?)
Fixed a few different bugs in this area, although we haven't specifically figured out why Jim was seeing that weird h... Sage Weil
04:47 PM Revision 866b161b (ceph): osd: enable cpu_profiler
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
04:38 PM Feature #609 (Resolved): osd: query pool/pg for objects with given xattr
Sage Weil
04:34 PM Bug #632: init script won't stop an instance that's been removed from config
The way to fix this would be to kill anything that has a pid file in /var/run/ceph, without looking at the ceph.conf.... Sage Weil
04:33 PM Bug #645 (Closed): intermittent failure of snap ioctl
Sam tracked this down to a incorrectly closed file descriptor in the filestore init or some such. Phew! Sage Weil
04:32 PM Bug #704 (Closed): it hang both in client and osd
the ceph -s output shows the mds in state 'up:replay'.. that's why the client couldn't mount. Sage Weil
04:30 PM Bug #749 (Can't reproduce): test pipe queue if is empty??V0.24.2
Sage Weil
04:30 PM Messengers Bug #798 (Can't reproduce): should have a empty() test on list<Messegger *>
Sage Weil
04:15 PM Revision 35c4a9ff (ceph): Thread: don't mask signals except in library code
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
04:11 PM Bug #847: OSD: Recovery does not complete, PG's stay active
Pushed an osd_recovery branch that should continuing recovering, skipping over the missing objects. If there are oth... Sage Weil
01:41 PM Bug #847: OSD: Recovery does not complete, PG's stay active
Oh, I see the problem:
2011-03-01 22:39:59.563426 log 2011-03-01 22:27:18.519821 osd1 [2a00:f10:113:1:230:48ff...
Sage Weil
05:06 AM Bug #847: OSD: Recovery does not complete, PG's stay active
I've tried your patch, but unfortunately it did not work out.
Did a little digging and out:...
Wido den Hollander
03:51 PM Bug #836: atomic-ops error on Debian arm
__arm__ is not the problem, according to the debian arm port people. tv helped me get a qemu arm setup going, which I... Greg Farnum
03:50 PM Tasks #834 (Resolved): Investigate heap usage via tcmalloc's extensions
Ugh, so after entirely too much time looking at all kinds of things: tcmalloc had a lot of resident memory used up as... Greg Farnum
03:10 PM Revision d7dea8ea (ceph): Merge branch 'profiler'
Colin Patrick McCabe
03:04 PM Revision f3ff51f4 (ceph): librados:rados_ioctx_stat -> rados_ioctx_pool_stat
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
02:45 PM Revision 7a429d91 (ceph): profiler: move perftools glue into perfglue/
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
02:44 PM Revision 18e9b66e (ceph): do_autogen: add -P (--with-profiler)
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
02:44 PM Revision 9f95489a (ceph): mds: cpu profiler hooks
Sage Weil
02:44 PM Revision 86363131 (ceph): add --with-profiler to link in google perftools libprofiler
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
02:21 PM Revision a4668008 (ceph): librados: use atomic_t for reference count
Use an use atomic_t for the reference count in IoCtxImpl.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
12:20 PM Revision 0290074b (ceph): librados: fix IoCtx::from_rados_ioctx_t
IoCtx::from_rados_ioctx_t creates an IoCtx out of a rados_ioctx_t.
However, this IoCtx must share ownership of the Io...
Colin Patrick McCabe
11:38 AM Revision 1f5fca85 (ceph): Rename radios_ioctx_{open,close} to create/destroy
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:33 AM Revision d134915f (ceph): librados: remove IoCtx::close()
We decided we don't want IoCtx::close(), since IoCtx::~IoCtx() exists.
Signed-off-by: Colin McCabe <colin.mccabe@dre...
Colin Patrick McCabe
01:07 AM Revision f1911758 (ceph): PG: unify scrub_received_maps and peer_scrub_maps
Previously, incoming maps were placed into peer_scrub_maps and merged
into scrub_received_maps during scrub_gather_re...
Samuel Just
12:05 AM Revision 19bcd747 (ceph): osd: trigger discover_all_missing after replay delay
We were calling discover_all_missing only when we went immediately active,
not after we were in the replay state (whi...
Sage Weil
12:03 AM Revision 7a2bb8dc (ceph): Make git ignore core files.
Tommi Virtanen
12:03 AM Revision adb67509 (ceph): Make git ignore python generated files.
Tommi Virtanen
12:00 AM Revision d372c50f (ceph): librados: Crashed on shutdown if connect was never called.
Add a trivial unit test to trigger this. Tommi Virtanen

02/28/2011

11:43 PM Revision 03135a3e (ceph): OSD: activate_map should not do_peer on a replaying pg
Signed-off-by: Samuel Just <samuel.just@dreamhost.com> Samuel Just
11:43 PM Revision 2adb670c (ceph): OSD: add scrub_finalize_wq
Scrub currently blocks while waiting on replica maps and for
last_update_applied==last_update. Also, the subsequent ...
Samuel Just
11:43 PM Revision 88ced090 (ceph): PG: make scrub non-blocking
Previously, scrub would block using wait until
1. last_update_applied==last_update and
2. all replica scrub maps are ...
Samuel Just
11:43 PM Revision d03bd60c (ceph): PG: replica_scrub also should not block
As with scrub, replica scrub wait()ed for last_update_complete to catch
up to last_update. Now, it will requeue the ...
Samuel Just
11:43 PM Revision dd1bd2c4 (ceph): PG: refactor scrubmap comparison and repair logic
The previous version gave erroneous results. This version seems simpler
and can be more easily unit tested as the er...
Samuel Just
10:15 PM Revision ee534522 (ceph): osd: handle osd_ping (and ack requests) while !active
In particular, we may start getting ping requests before getting (or while
processing) our first map that makes us go...
Sage Weil
09:11 PM Revision 399032cc (ceph): osd: share osd->osdmap with map cache
Make OSD::osdmap just a shortcut map pointer to the most recent OSDMap, the
same one that's in the map cache.
Signed...
Sage Weil
09:04 PM Revision 5a18f988 (ceph): Merge branch 'next'
Sage Weil
08:57 PM Revision c76a4b75 (ceph): Revert "move g_default_file_layout into ceph_fs.cc"
This reverts commit 1dc12e3e1de1ee6aeb3ef11bb3faafa4757b1a65.
The headers and ceph_fs.cc are written such that they ...
Sage Weil
08:51 PM Linux kernel client Bug #851 (Resolved): make dcache readdir with I_COMPLETE work
Sage Weil
08:51 PM Linux kernel client Bug #850 (Resolved): make NULL lookup using I_COMPLETE work
Sage Weil
07:19 PM Revision a2ffef9d (ceph): Merge branch 'next'
Conflicts:
src/pybind/rados.py
Sage Weil
05:29 PM Feature #812: switch up crypto library (again)
I think it has what we need (mainly sha1, md5). The pkl11test.c from
the source package can be a good starting point...
Sage Weil
04:35 PM Bug #847: OSD: Recovery does not complete, PG's stay active
Sage Weil
04:06 PM Bug #847: OSD: Recovery does not complete, PG's stay active
I believe this will fix it: commit:19bcd747b452b79c80744620e635f036bfc1b738 Sage Weil
11:58 AM Bug #847: OSD: Recovery does not complete, PG's stay active
osd4 started printing some more lines after it's restart:... Wido den Hollander
11:51 AM Bug #847 (Resolved): OSD: Recovery does not complete, PG's stay active
After I've expanded my cluster from 4 to 8 OSD's the recovery would not complete.
The state right now:...
Wido den Hollander
04:06 PM Revision 8d877abc (ceph): Add comment to ceph_fs.cc
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
03:52 PM rgw Cleanup #320 (Resolved): Remove some duplicates and unused declarations
applied everything that was still relevant. Yehuda Sadeh
03:44 PM rgw Bug #768 (Resolved): eliminate any read/modify/write races
bucket creation is being done now via tmap update on a rados backed gateway. Yehuda Sadeh
02:20 PM Feature #849 (Resolved): include rbd udev rules in packages
Sage Weil
02:00 PM Revision 70564eb5 (ceph): libradoshpp: put ceph stuff in namespace librados
Try a little bit harder to avoid polluting the user's global namespace
with our stuff.
Signed-off-by: Colin McCabe <...
Colin Patrick McCabe
01:59 PM Revision a66fd3bb (ceph): librados: don't create unused SnapContext objs
There were some unused temporary variables hanging around.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
01:49 PM Bug #848 (Resolved): limited commit_partial probably broke mds recovery
When I set up the MDS to limit the size of commits it sends to the OSDs, Sage points out that I probably broke safety... Greg Farnum
01:32 PM Revision 13f6223f (ceph): librados: fix copy ctor of ObjectIterator
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
01:12 PM Bug #821 (Resolved): osd: fix osdmap caching
This is fixed without shared_ptr<>. See commit:399032cca53c37dca08713818621a24b924fd4a6 and commit:96c2cb5b986d6e7fc... Sage Weil
12:31 PM Bug #833: rbd wiki documentation uses old sysfs /sys/class interface
The way to list snaps now is to list the device directory and pick up all the entries that start with 'snap_'.
The...
Yehuda Sadeh
12:07 PM Bug #833: rbd wiki documentation uses old sysfs /sys/class interface
Fixed the docs a bit, but I'm missing "list_snaps" in the current RBD sysfs tree. Is there still a away to list snaps... Wido den Hollander
12:03 PM Revision e7f2972d (ceph): cconf: fix clitest
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
11:50 AM Revision 3011349a (ceph): unittests: remember to use AM_LDFLAGS
remember to use AM_LDFLAGS when setting _LDFLAGS. Otherwise, the global
flags will be lost.
Signed-off-by: Colin McC...
Colin Patrick McCabe
11:50 AM Bug #838 (Duplicate): librados should not write to stderr or ceph logs, touch pid files, silently...
Good observations. These are being addressed in the next release by #840 and #842, which are subtasks of #815
Comm...
Colin McCabe
10:18 AM Bug #838: librados should not write to stderr or ceph logs, touch pid files, silently read config...
The log to stderr part was meant to complain about logging a "greeting". Logging on an actual error is more acceptabl... Anonymous
10:15 AM Bug #838 (Duplicate): librados should not write to stderr or ceph logs, touch pid files, silently...
Using the Python bindings just as an easy way to init librados, the bug does not reside in the bindings.
proof of ...
Anonymous
11:47 AM Subtask #846 (Resolved): De-globalize SimpleMessenger, etc.
In librados, and other library code, we need an instance of SimpleMessenger for each active rados_cluster_t.
We pr...
Colin McCabe
11:46 AM Subtask #845 (Resolved): g_conf should not be defined in library code.
g_conf should live in cmon, cosd, and other daemons. Attempts to refer to it in a library should create an undefined ... Colin McCabe
11:45 AM Subtask #844 (Resolved): g_conf should become a pointer
g_conf should become a pointer. It should not be initialized or used during global constructor time. Colin McCabe
11:45 AM Subtask #843 (Resolved): Decouple dout from g_conf
Decouple dout from g_conf
Create DoutConfig to represent dout configuration state.
Colin McCabe
11:44 AM Subtask #842 (Resolved): initialization: have appropriate library-specific defaults
initialization: have appropriate library-specific defaults
For example, don't default to using a pid file in libra...
Colin McCabe
11:43 AM Subtask #841 (Resolved): don't call daemon_init in library code
Common init should not be called by libraries. We don't want to register signal handlers, call openlog(), or really d... Colin McCabe
11:41 AM Subtask #840 (Resolved): Clean separation between different components of initialization
We want to have three different components:
1. argument parsing
2. reading the ceph configuration file
3. common_i...
Colin McCabe
11:39 AM Subtask #839 (Resolved): Globals cleanup. Replace g_conf.name with g_conf.entity_name.to_str(). R...
Globals cleanup. Replace g_conf.name with g_conf.entity_name.to_str(). Remove g_conf.type.
In some cases, use progra...
Colin McCabe
09:57 AM Revision f7e5e868 (ceph): Merge branch 'librados_api' into next
Colin Patrick McCabe
09:46 AM Feature #820 (Closed): bufferlist memory pool
So, tried this out and it looked like maybe it helped a little bit, but it wasn't clear. After running more tests wit... Greg Farnum
09:23 AM Bug #735 (Resolved): Manual drive pull testing hangs filesystem
Colin McCabe

02/27/2011

09:01 PM Tasks #834: Investigate heap usage via tcmalloc's extensions
I've spent some time on this and so far I've gotten into situations where tcmalloc is keeping around a couple hundred... Greg Farnum
07:42 PM Bug #698 (Resolved): cosd memory usage with large number of pools
I'm closing this since it's become apparent that the actual memory use issues are less related to the in-memory objec... Greg Farnum
07:37 PM Bug #836 (In Progress): atomic-ops error on Debian arm
Only thing that makes any sense to me so far is the possibility that the preprocessor macros are incorrect for the sy... Greg Farnum
07:04 PM Bug #836 (Rejected): atomic-ops error on Debian arm
From Lazslo:... Greg Farnum
07:08 PM Bug #837 (Resolved): AuthAuthorizeHandler fails to build on s390
Also from Laszlo:... Greg Farnum

02/26/2011

11:51 PM Bug #835 (Resolved): osd: avoid the sync in handle_osd_map
May not be easy (or even possible), but at the very least need to document what the dependencies are. Sage Weil
04:40 PM Feature #820 (In Progress): bufferlist memory pool
I did a prototype of this, and in brief testing it reduced resident memory usage a little bit, but not by enough. Mor... Greg Farnum
04:40 PM Tasks #834 (Resolved): Investigate heap usage via tcmalloc's extensions
tcmalloc has a lot of knobs we can fiddle with programmatically to get information out (and to change behavior). Impl... Greg Farnum
11:31 AM Bug #833 (Resolved): rbd wiki documentation uses old sysfs /sys/class interface
http://ceph.newdream.net/wiki/Rbd Sage Weil
02:05 AM Revision 78ba46ad (ceph): testlibrbd: call rados_connect
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
01:02 AM Revision 141509c0 (ceph): Rename PoolHandle to IoContext: part 2
The previous change changed all PoolHandle uses to IoContext. This
change also renames the variable names.
Also fix ...
Colin Patrick McCabe
12:27 AM Revision 454854ed (ceph): testlibrbdpp: convert to new APIs
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
12:27 AM Revision 8903ea34 (ceph): testradospp: update for new librados API
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin

02/25/2011

11:45 PM Revision b6547875 (ceph): librbd, librados: fix my last commits to use the new librados API
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:33 PM Revision 2641a693 (ceph): librados: add snap_get_stamp to C API
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:32 PM Revision 2cb86f71 (ceph): librados, librbd: remove selfmanaged_snap_rollback_object
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:32 PM Revision 15260473 (ceph): testlibrbdpp: initialize pointers
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
11:29 PM Revision 040e5460 (ceph): pybind/rados: Fix invalid variable references in error paths.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
11:28 PM Revision 8c2d5729 (ceph): pybind/rados: Remove unused variable.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
11:26 PM Revision 9591729a (ceph): pybind/rados: version call return type is void.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com> Tommi Virtanen
10:43 PM Revision 32cf5ac4 (ceph): FileStore.h: reorder queue operations in _journaled_ahead
In writeahead mode, an op could dissappear from jq without immediately
reappearing in q. Thus, q can be empty before...
Samuel Just
10:43 PM Revision afe2d81b (ceph): Revert "FileStore: fix OpSequencer::flush error"
This reverts commit c78b29a47d7211a4b8b1585112ac22b8435a82c7.
This commit introduced an error in parallel journaling...
Samuel Just
09:41 PM Revision 96c2cb5b (ceph): osd: simplify handle_osd_map flushing and map caching
Extend the map_cache somewhat. Avoid one flush in handle_osd_map by
putting new maps in the cache.
There is still a...
Sage Weil
09:39 PM Revision 9758af7d (ceph): testlibrbdpp: use new librbd api
Josh Durgin
06:58 PM Revision f9fe949e (ceph): rbd: update for librbd api changes
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
06:58 PM Revision f54ba07b (ceph): librbd: tweak C++ API
- rename image_open to open and make it return an int
- remove Image::close, replace with destructor
- make Image con...
Josh Durgin
06:52 PM Revision 74aa6841 (ceph): librados: Rename rados_pool_t to rados_ioctx_t
rados_pool_t -> rados_ioctx_t
class PoolCtx -> class IoCtxImpl
class PoolHandle -> class IoCtx
PoolHandle::name() ...
Colin Patrick McCabe
05:08 PM Revision bde6dac2 (ceph): test_common.sh: should rm objects before adding
rados_write doesn't replace the whole object, but that's what we want in
these old tests. So just rm it first.
Signe...
Colin Patrick McCabe
04:42 PM Revision 4937854b (ceph): rbd: de-globalize rbd, rados, Image
Use RAII for rbd, rados, and Image. Their destructors will be called
when main exits, thus doing the cleanup for us. ...
Colin Patrick McCabe
04:17 PM Revision 1d2c5f35 (ceph): Merge branch 'librados_api_cpp' into librados_api
Conflicts:
src/include/rbd/librbd.hpp
src/librbd.cc
src/rbd.cc
Colin Patrick McCabe
04:06 PM Revision 06bf77e1 (ceph): librados: C++ API rework
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
12:46 PM rgw Feature #832 (Resolved): Create fastcgi repository
created the mod_fastcgi git repository. Yehuda Sadeh
10:22 AM rgw Feature #832 (Resolved): Create fastcgi repository
Yehuda Sadeh
10:39 AM rgw Bug #343: Bad 100-Continue handling
Yehuda Sadeh
10:14 AM Bug #793: osd: avoid blocking in scrub_wq
Pushed a branch (scrub_noblock) which should prevent scrub (and replica scrub) from blocking. Samuel Just
09:54 AM rgw Feature #831 (Resolved): self signed tokens for the openstack requests
We need that so that we wouldn't need the extra step to authorize the user on the auth server.
Yehuda Sadeh
09:41 AM rgw Feature #830 (Resolved): rgw: swift per-object ACLs
We need to translate between the openstack acls to the current acls, both in requests that update the acls and in req... Yehuda Sadeh
09:37 AM rgw Feature #829 (Resolved): rgw: support swift POST
Yehuda Sadeh
09:07 AM Feature #828 (Resolved): make cpu profiler work
The google-perftools cpu profiler isn't collecting any samples. I think it's because of the signal masks on our thre... Sage Weil
09:04 AM Bug #826: autoconf: don't autodect fuse, tcmalloc, etc.
If we do this we'll need to put some magic somewhere so that the debian packages will build happily on architectures ... Greg Farnum
01:20 AM Revision e3f3177f (ceph): rbd: use new librbd C++ api
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin

02/24/2011

09:50 PM Revision 037d6620 (ceph): Update Debian packaging for 0.26~rc.
Make ceph x86 and x64 only because of build dependency on architecture related
google-perftools.
Put library packages...
Laszlo Boszormenyi
09:41 PM Revision 154a21f3 (ceph): librbd: make C++ api nicer
Adds Image class and replaces aio_create_completion with a constructor.
Signed-off-by: Josh Durgin <josh.durgin@drea...
Josh Durgin
09:40 PM Revision 9570d6e2 (ceph): Revert "FileStore: fix OpSequencer::flush error"
This reverts commit c78b29a47d7211a4b8b1585112ac22b8435a82c7.
This commit introduced an error in parallel journaling...
Samuel Just
09:40 PM Revision 8dfffd00 (ceph): FileStore.h: reorder queue operations in _journaled_ahead
In writeahead mode, an op could dissappear from jq without immediately
reappearing in q. Thus, q can be empty before...
Samuel Just
07:24 PM Revision fa3dee1f (ceph): librbd, rbd: fill in the rest of image_info_t
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
07:14 PM Revision d15fe7f9 (ceph): rollback rename
Colin Patrick McCabe
03:50 PM Revision 813ae598 (ceph): mds: add 'exit' command
Tell a cmds process to suicide/exit immediately.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
03:50 PM Revision 0f3fe7f8 (ceph): mds: fix frag string rendering
Was mostly gibberish from df7c7bd79237d2a8b691f4e59433b0b39a9721a2
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
03:41 PM Revision 827c950b (ceph): v0.26~rc
Modernize configure.ac macros, set bug report address to ML. Sage Weil
03:36 PM Revision 18305fc3 (ceph): mds: strengthen assertions in rejoin ack
The ACK only contains items we asked for with a WEAK request. Assert as
much. (The old continue bits were from ~200...
Sage Weil
03:35 PM Revision 7abf87a5 (ceph): mds: fix gratuitous map lookup
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
03:35 PM Revision d8446023 (ceph): mds: mark_down connections to any failed peers
This cleans up messenger state, prevents log spam, and saves a small amount
of memory.
Signed-off-by: Sage Weil <sag...
Sage Weil
03:35 PM Revision 3e691d31 (ceph): mds: fix export cancellation vs nested freezes
Prevent freezes from completing while we are canceling exports. Otherwise
if we are freezing /a/b and /a, and cancel...
Sage Weil
02:12 PM Revision 7c66adf1 (ceph): filejournal: fix type punning warning, drop unneeded cast
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
02:02 PM Revision 32c913a2 (ceph): Some tweaks for the librados C API
rados_reopen_log: should take a cluster parameter.
Add rados_pool_list, rados_pool_list_free.
rados_snap_set_read -...
Colin Patrick McCabe
01:49 PM Revision 71bbd554 (ceph): Makefile: fix libatomic_ops linking
LDADD seems to have no effect on the final link command. Switching this
back to AM_LDFLAGS. This was changed as in ...
Sage Weil
08:34 AM Revision 92870d7a (ceph): mds: remove "N stopped" from short mdsmap summary
It's confusing because it sounds like we're talking about daemons, when we
really just mean there are some ranks that...
Sage Weil
08:31 AM Revision f027b082 (ceph): mon: include mds gid in logs
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
08:20 AM Revision 9eb35324 (ceph): mds,osd: print 'starting ...' message to stdout
The timestamp/threadid prefix is unnecessary, and stdout seems more
appropriate. Now matches cmon.
Signed-off-by: S...
Sage Weil
08:19 AM Revision 298916b1 (ceph): common: only print version to stdout for daemons
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil

02/23/2011

11:09 PM Revision c78b29a4 (ceph): FileStore: fix OpSequencer::flush error
In writeahead mode, an op will dissappear from jq without immediately
reappearing in q. Thus, q can be empty before ...
Samuel Just
09:45 PM Revision 15fa05d8 (ceph): mds: print waiter tag in hex
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:36 PM Revision df7c7bd7 (ceph): mds: make frag string rendering simpler
Show actual bit prefix when rendering a frag_t. That is,
$value/$numbits -> bits*
So,
0/0 -> *
000000/1 -> 0...
Sage Weil
09:34 PM Revision 3b1fa97c (ceph): mon: fix dup mds takeover
Allow a standby to take over for a single MDS only by consistently looking
at the pending_mdsmap and not mdsmap. Mix...
Sage Weil
09:18 PM Revision 8d370026 (ceph): mds: print msg when fragtree updates from journal
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:17 PM Revision 436153e6 (ceph): mds: verify frags in more approrpiate places
Not in inner helpers, which may be called on multiple frags to get things
in sync.
Signed-off-by: Sage Weil <sage.we...
Sage Weil
09:01 PM Revision f13e6a4b (ceph): mds: refragment dirs when inode dirfragtree updates from journal
Force dir fragmentation specified by dirfragtree when replayed from
the journal.
Example:
mds0 is auth for /foo, md...
Sage Weil
07:55 PM Revision f6a92610 (ceph): mds: fix CDir::take_waiting() on dentry waiters
Using take_dentry_waiting() means we double-put the DNWAITER pin. It's
also way slower.
Signed-off-by: Sage Weil <s...
Sage Weil
06:17 PM Revision efc20c67 (ceph): Update testrados, rename functions in librados.cc
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 0fb83f17 (ceph): More fixes, additions for config API
Add test of the librados configuration API to testrados.c
rados_reopen_log should return void since it can't encount...
Colin Patrick McCabe
06:17 PM Revision f2e3d838 (ceph): config.cc: doesn't depend on ceph_ver.h
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 431a5bf7 (ceph): Rename config.h -> common/config.h
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 29b64391 (ceph): ceph_common.sh: remove get_val, get_val_bool
get_val and get_val_bool are unused.
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
Colin Patrick McCabe
06:17 PM Revision 713f9a11 (ceph): cconf: remove second argument to cconf --lookup
Everyone uses get_conf to get configuration values. So the logic for
defaulting to some value if we can't find the re...
Colin Patrick McCabe
06:17 PM Revision ebc9dbc1 (ceph): common: Fix some missing includes, copyrights
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 21544fdc (ceph): common: more include and copyright fixes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 0d54e311 (ceph): md_config_t::set_val/get_val
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 871fa1b3 (ceph): Add rados_conf_apply, comments
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 5f730868 (ceph): Splt rados_init into rados_create + rados_connect
Splt rados_init into rados_create and rados_connect. The pattern will
be for users to call create, set configuration...
Colin Patrick McCabe
06:17 PM Revision 0f90d156 (ceph): Fold common_set_defaults into common_init
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 3c6736d6 (ceph): rados_create: add id parameter
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
06:17 PM Revision 96edddea (ceph): testlibrbdpp: update for new librados and librbd APIs
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
05:31 PM Revision b2ceebf4 (ceph): librbd: stack on top of librados
Sage Weil
05:31 PM Revision 15f20f5b (ceph): librados: switch to noun_verb function names
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
05:31 PM Revision b1d6e30e (ceph): librados: add constructor to allow client re-use
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
05:31 PM Revision 134f261a (ceph): librbd: implement stacking on top of librados
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
05:31 PM Revision c5bb7350 (ceph): rbd: update for new librados and librbd APIs
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin
03:38 PM Feature #709: nagios plugin
The issue for the nagios machine upgrade: https://dev.newdream.net/issues/8978 Dallas Kashuba
12:36 PM Tasks #827 (Resolved): Make i386 build cleanly in gitbuilder
We're getting an Internal Compiler Error!
Two tasks:
1) Package this up for the gcc folks.
2) Implement a workar...
Greg Farnum
12:01 PM Bug #826 (Closed): autoconf: don't autodect fuse, tcmalloc, etc.
Any library that isn't present should make configure fail. This forces the user to do --without-foo and realize what... Sage Weil
09:07 AM Subtask #825 (Resolved): osd: remove pg map updating from handle_osd_map
Currently handle_osd_map flushes worker threads before applying an update. Ideally we should advance pgs individuall... Sage Weil

02/22/2011

11:09 PM Revision 74346592 (ceph): ReplicatedPG: snap_trimmer should bail out while finalizing_scrub
Check to make sure !finalizing_scrub when relocking.
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
Samuel Just
11:09 PM Revision 4ddc5db6 (ceph): OSD,PG: fix race between processing scrub and dequeueing scrub
Previously, a second scrub could be scheduled between when the first is
dequeued and processed resulting in two scrub...
Samuel Just
08:45 PM Revision 89b743c4 (ceph): osd: fix recovery pointer when pulling head before snapid
If recovery wants to pull a snapped object and needs the head first, pull()
does that, but the caller doesn't ++skipp...
Sage Weil
08:20 PM Revision 48f69894 (ceph): osd: verify object version during push
Fail to push if the ondisk version doesn't match the version we want to
send.
This isn't supposed to happen. If it d...
Sage Weil
05:40 PM Revision e4b82742 (ceph): osd: improve up_thru request behavior
There is some epoch the OSD wants for up_thru, based on when the PG mapping
last changed. However, once the monitor ...
Sage Weil
05:27 PM Revision 4df36436 (ceph): pybind: update rados python bindings for new API
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe
05:11 PM Revision 158889b2 (ceph): PGMap: make osd_full and nearfull ratios configurable.
These were previously set by #defines. Pretty stupid
when we have a nice config system already!
Signed-off-by: Greg ...
Greg Farnum
05:10 PM Revision 0e4e5a5b (ceph): osd: set correct epoch for up_thru osd->mon request
Put the epoch we need for up_thru in the request. Putting the most recent
epoch causes incorrect osdmap churn.
Fixe...
Sage Weil
04:09 PM Revision 2de8b7b8 (ceph): librados: add cluster handle to C API
Had to add a layer of indirection to the list context handles.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Sage Weil
04:09 PM Revision 1dc12e3e (ceph): move g_default_file_layout into ceph_fs.cc
It's defined in ceph_fs.h.
Fix a bunch of headers that use types without including the headers that
define those typ...
Colin Patrick McCabe
04:09 PM Revision 950e8c3e (ceph): librados: more API cleanup; rados_conf_ stubs
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
09:14 AM Bug #817: Implement custom propose logic for OSDMap/PGMap
This is less important since Sage figured out #824. Greg Farnum
09:07 AM Bug #824 (Resolved): Map churn with lots of PGs
commit:0e4e5a5b26c1027cfb99edce869fecc4a5a2d487 Sage Weil
07:46 AM Bug #824 (Resolved): Map churn with lots of PGs
Like the title says. This may be related to #817 but Sage seems to think there's also an issue with the OSD code prom... Greg Farnum
08:53 AM Bug #810 (Duplicate): 1). PG bits don't get recognized and 2). Takes too long for OSDs to boot up.
Setting pg bits is working properly, but you're using the wrong config name. :) Underscores should only be used on th... Greg Farnum
08:51 AM Feature #823 (Resolved): osd: make FULL and NEAR_FULL configurable
Made these configurable via mon_osd_full_ratio and mon_osd_nearfull_ratio in commit:158889b2e4089db2361b7f61d6e2e2c13... Greg Farnum
08:41 AM Bug #816: fs size underflowed
First step here is to figure out how to reproduce, and/or find/generate full osd logs of it happening. Sage Weil
08:34 AM Bug #752 (Resolved): High I/O wait when writing data
That's good news. I'm not really sure what was going wrong here before either. Let's see if this comes back. Sage Weil
06:09 AM Bug #752: High I/O wait when writing data
I've spent a lot of time testing and finding out where this could come from, but it seems to be done now for no good ... Wido den Hollander

02/21/2011

05:00 AM Revision 0a96e6a7 (ceph): Makefile: include ceph_argsparse.h in dist tarball
Signed-off-by: Sage Weil <sage.weil@dreamhost.com> Sage Weil
04:58 AM Revision 4ffe0698 (ceph): filestore: fix clone_range
This was broken by the safe_write() switchover; the success return value
is now 0, not the number of bytes written.
...
Sage Weil
04:36 AM Feature #823 (Resolved): osd: make FULL and NEAR_FULL configurable
FULL and NEAR_FULL are set in osd/osd_types.h:... Wido den Hollander

02/20/2011

09:54 PM Revision 349cb128 (ceph): keyring_init: don't print error when explicit key/keyfile is specified
e.g. when I am non-root and specify a key explicitly, no need to complain
about not being able to read root's /etc/ce...
Sage Weil
09:52 PM Revision 859aaf78 (ceph): Revert "keyring_init: g_conf.keyring is not a list"
This reverts commit 2fb6036aa53f5eb3173b80fd17b7240bd3daf156. Sage Weil
06:17 PM Revision 2a59b213 (ceph): common: Split argument parsing into ceph_argparse
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com> Colin Patrick McCabe

02/19/2011

12:01 AM Revision b96f1642 (ceph): Revert "Makefile.am: remove unused libs from linking with librbd tests ...
Same problem as 38f38a99149e88f18072fcbdbee316ac21f6f30f.
This reverts commit e5db46cea0997f3f959b2ae896c980585f079ac0.
Josh Durgin
 

Also available in: Atom