Deactivating filestore xattr use omap creates inconsistent PG
As discussed with Sam, this is not yet handled by Ceph.
Steps to reproduce:
- Deploy an OSD with filestore xattr use omap = true
- write to that OSD
- set filestore xattr use map to false
- restart the OSD
This will result in inconsistent PGs for all PGs this OSD is part of.
[ERR] 1.1b0 osd.15: soid c2e541b0/600.00000000/head//1 missing attr _, missing attr snapset