Ceph » RADOS

2017-11-14 00:37:04.496 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7810 3.0 3:0b332f33:::smithi1441403-241 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [sparse-read 0~2033680,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected e95) v8) prio 63 cost 32 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7812 3.0 3:0b332f33:::smithi1441403-241 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [read 0~2033680,checksum] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected e95) v8) prio 63 cost 4 e115)
2017-11-14 00:37:04.496 7f251983e700 10 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] cancel_proxy_ops 3:1288273c:::smithi1441403-126:head requeuing 1 requests
2017-11-14 00:37:04.496 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c7800
2017-11-14 00:37:04.496 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7827 3.0 3:1288273c:::smithi1441403-126:head [stat,delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 0 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7811 3.0 3:0b332f33:::smithi1441403-241 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [read 0~2033680,checksum] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected e95) v8) prio 63 cost 4 e115)
2017-11-14 00:37:04.496 7f251983e700 10 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] cancel_proxy_ops 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head requeuing 4 requests
2017-11-14 00:37:04.496 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c9d80
2017-11-14 00:37:04.496 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7826 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [read 0~1] snapc 0=[] RETRY=3 ondisk+retry+read+rwordered+known_if_redirected e95) v8) prio 63 cost 0 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7810 3.0 3:0b332f33:::smithi1441403-241 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [sparse-read 0~2033680,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected e95) v8) prio 63 cost 32 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c7b00
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7825 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [setxattr _header (356),truncate 3193660] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 363 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7827 3.0 3:1288273c:::smithi1441403-126:head [stat,delete] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 0 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c8b80
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7824 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [write 2037739~583136] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 583136 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7826 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [read 0~1] snapc 0=[] RETRY=3 ondisk+retry+read+rwordered+known_if_redirected e95) v8) prio 63 cost 0 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c9c00
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7823 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [write 793660~503513,stat] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 503513 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7825 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [setxattr _header (356),truncate 3193660] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 363 e115)
2017-11-14 00:37:04.497 7f251983e700 10 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] cancel_proxy_ops 3:27587c4d:::smithi1441403-404:head requeuing 4 requests
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c9480
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7809 3.0 3:27587c4d:::smithi1441403-404:head [read 0~1] snapc 0=[] RETRY=3 ondisk+retry+read+rwordered+known_if_redirected e95) v8) prio 63 cost 0 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7824 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [write 2037739~583136] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 583136 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c8580
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7808 3.0 3:27587c4d:::smithi1441403-404:head [setxattr _header (56),truncate 3160046] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 63 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7823 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [write 793660~503513,stat] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 503513 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea9a9aa80
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7807 3.0 3:27587c4d:::smithi1441403-404:head [write 2037128~695820] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 695820 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7809 3.0 3:27587c4d:::smithi1441403-404:head [read 0~1] snapc 0=[] RETRY=3 ondisk+retry+read+rwordered+known_if_redirected e95) v8) prio 63 cost 0 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea9a9a780
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7806 3.0 3:27587c4d:::smithi1441403-404:head [write 760046~753015,stat] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 753015 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7808 3.0 3:27587c4d:::smithi1441403-404:head [setxattr _header (56),truncate 3160046] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 63 e115)
2017-11-14 00:37:04.497 7f251983e700 10 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] cancel_proxy_ops 3:3d6e4248:::smithi1441403-422:head requeuing 5 requests
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c6c00
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7822 3.0 3:3d6e4248:::smithi1441403-422:head [read 0~1] snapc 0=[] RETRY=3 ondisk+retry+read+rwordered+known_if_redirected e95) v8) prio 63 cost 0 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7807 3.0 3:27587c4d:::smithi1441403-404:head [write 2037128~695820] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 695820 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c8e80
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7821 3.0 3:3d6e4248:::smithi1441403-422:head [setxattr _header (56),truncate 3176853] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 63 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7806 3.0 3:27587c4d:::smithi1441403-404:head [write 760046~753015,stat] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 753015 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c8a00
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7820 3.0 3:3d6e4248:::smithi1441403-422:head [write 2836307~340546] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 340546 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7822 3.0 3:3d6e4248:::smithi1441403-422:head [read 0~1] snapc 0=[] RETRY=3 ondisk+retry+read+rwordered+known_if_redirected e95) v8) prio 63 cost 0 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c7c80
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7819 3.0 3:3d6e4248:::smithi1441403-422:head [write 1979257~439478] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 439478 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7821 3.0 3:3d6e4248:::smithi1441403-422:head [setxattr _header (56),truncate 3176853] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 63 e115)
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 pg_epoch: 115 pg[3.0( v 97'367 (0'0,97'367] local-lis/les=96/97 n=51 ec=20/20 lis/c 96/96 les/c/f 97/97/0 115/115/95) [7]/[2,7] r=0 lpr=115 pi=[96,115)/1 crt=97'367 mlcod 0'0 remapped] requeue_op 0x55fea90c9600
2017-11-14 00:37:04.497 7f251983e700 20 osd.2 op_wq(0) _enqueue_front OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7818 3.0 3:3d6e4248:::smithi1441403-422:head [write 776853~428264,stat] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 428264 e115) shuffled w/ OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7820 3.0 3:3d6e4248:::smithi1441403-422:head [write 2836307~340546] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 340546 e115)
...
2017-11-14 00:37:04.499 7f2514834700 20 osd.2 op_wq(0) _process OpQueueItem(3.0 PGOpItem(op=osd_op(client.4264.0:7823 3.0 3:14993ae1:::smithi1441403-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [write 793660~503513,stat] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e95) v8) prio 63 cost 503513 e115) queued