Ceph » mgr

On Wed, Aug 18, 2021 at 12:19 AM Prayank Saxena <pr31189@gmail.com> wrote:

Hello everyone,

We have a ceph cluster with version Pacific v16.2.4

We are trying to implement the ceph module snap-schedule from this document
https://docs.ceph.com/en/latest/cephfs/snap-schedule/

It works if you have say, hourly and retention is h 3

ceph fs snap-schedule add /volumes/user1/vol7 1h <time>
ceph fs snap-schedule retention add /volumes/user1/vol7 h 6

But we tried the following retention configuration, it did not quite
make the result we are expecting:

ceph fs snap-schedule add /volumes/user1/vol7 1h 2021-08-12T23:41:00
ceph fs snap-schedule retention add /volumes/user1/vol7 d 2
ceph fs snap-schedule retention add /volumes/user1/vol7 h 6

by definition this should : take a snapshot every one hour, then retain 6
snapshots with an hour apart and 2 snapshot days apart.

ceph fs snap-schedule status /volumes/user1/vol7

{"fs": "cephfs", "subvol": null, "path": "/volumes/user1/vol7", "rel_path":
"/volumes/user1/vol7", "schedule": "1h", "retention": {"d": 2, "h": 6},
"start": "2021-08-12T23:41:00", "created": "2021-08-12T23:41:07", "first":
"2021-08-13T00:41:00", "last": "2021-08-17T09:41:00", "last_pruned":
"2021-08-17T09:41:00", "created_count": 106, "pruned_count": 96, "active":
true}

ceph fs subvolume snapshot ls cephfs vol7 --group_name user1 | grep name

"name": "scheduled-2021-08-13-23_41_00" <--- this should be
deleted based on retention
"name": "scheduled-2021-08-14-23_41_00" <--- this too
"name": "scheduled-2021-08-15-23_41_00"
"name": "scheduled-2021-08-16-23_41_00"
"name": "scheduled-2021-08-17-04_41_00"
"name": "scheduled-2021-08-17-05_41_00"
"name": "scheduled-2021-08-17-06_41_00"
"name": "scheduled-2021-08-17-07_41_00"
"name": "scheduled-2021-08-17-08_41_00"
"name": "scheduled-2021-08-17-09_41_00"

this is what we get in the log
--- start log ----
... truncated ...
2021-08-17 08:41:00,271 [Thread-3194] [INFO]
[snap_schedule.fs.schedule_client] created scheduled snapshot of
/volumes/user1/vol7
2021-08-17 08:41:00,271 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] created scheduled snapshot
/volumes/user1/vol7/.snap/scheduled-2021-08-17-08_41_00
2021-08-17 08:41:00,271 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] SnapDB on cephfs changed for
/volumes/user1/vol7, updating next Timer
2021-08-17 08:41:00,271 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] Creating new snapshot timer for
/volumes/user1/vol7
2021-08-17 08:41:00,272 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] Will snapshot /volumes/user1/vol7 in fs
cephfs in 3600s
2021-08-17 08:41:00,272 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] Pruning snapshots
2021-08-17 08:41:00,272 [Thread-3194] [DEBUG] [mgr_util] self.fs_id=1,
fs_id=1
2021-08-17 08:41:00,273 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] skipping dir entry b'.'
2021-08-17 08:41:00,274 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] skipping dir entry b'..'
2021-08-17 08:41:00,275 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-13-23_41_00' to
pruning
2021-08-17 08:41:00,275 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-14-23_41_00' to
pruning
2021-08-17 08:41:00,276 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-15-23_41_00' to
pruning
2021-08-17 08:41:00,276 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-16-23_41_00' to
pruning
2021-08-17 08:41:00,277 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-02_41_00' to
pruning
2021-08-17 08:41:00,278 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-03_41_00' to
pruning
2021-08-17 08:41:00,278 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-04_41_00' to
pruning
2021-08-17 08:41:00,279 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-05_41_00' to
pruning
2021-08-17 08:41:00,279 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-06_41_00' to
pruning
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-07_41_00' to
pruning
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] add b'scheduled-2021-08-17-08_41_00' to
pruning
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period n
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period M
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-17-08_41_00'
due to 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-17-07_41_00'
due to 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-17-06_41_00'
due to 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-17-05_41_00'
due to 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-17-04_41_00'
due to 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-17-03_41_00'
due to 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] found enough snapshots for 6h
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period d
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-16-23_41_00'
due to 2d
2021-08-17 08:41:00,280 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-15-23_41_00'
due to 2d
2021-08-17 08:41:00,281 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-14-23_41_00'
due to 2d
2021-08-17 08:41:00,281 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] keeping b'scheduled-2021-08-13-23_41_00'
due to 2d
2021-08-17 08:41:00,281 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period w
2021-08-17 08:41:00,281 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period m
2021-08-17 08:41:00,281 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] compiling keep set for period y
2021-08-17 08:41:00,281 [Thread-3194] [DEBUG]
[snap_schedule.fs.schedule_client] rmdir on scheduled-2021-08-17-02_41_00
... truncated ...
--- end log ----

On the log the 'due to 2d' is mentioned but it still did not prune the two
old ones scheduled-2021-08-14-23_41_00 and scheduled-2021-08-13-23_41_00