Ceph

To play with cache tiering for the first time, I created two pools, test1 and test2.

I set each to be a writeback cache for my data pool, more or less picking a pool to run rados bench on at random, not realizing any possibly cephfs interactions. I never set either as an overlay for data.

When I try to undo this though, I can set the cache mode to forward, but removing the test pools results in:
[root@ceph1 ~]ceph osd tier remove data test1
Error EBUSY: pool 'data' is in use by CephFS via its tier
[root@ceph1 ~]# ceph osd tier remove data test2
Error EBUSY: pool 'data' is in use by CephFS via its tier

Neither pool has any objects in it. Unfortunately the turning on of the tiering is preventing some of my machines with older kernels from reading cephfs, and at this point I just want to remove the cache tiers.