https://tracker.ceph.com/https://tracker.ceph.com/favicon.ico2017-05-25T22:18:37ZCeph Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=916932017-05-25T22:18:37ZVikhyat Umrao
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/91693/diff?detail_id=88541">diff</a>)</li></ul> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=917002017-05-26T03:08:54ZVikhyat Umrao
<ul></ul><p>We have another feature request: <a class="external" href="http://tracker.ceph.com/issues/18438">http://tracker.ceph.com/issues/18438</a> for Configurable OSD Heartbeat packet size (MTU) for same issue.</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=917022017-05-26T03:29:51ZVikhyat Umrao
<ul><li><strong>Subject</strong> changed from <i>OSD: Add heartbeat message for Jumbo Frames(MTU 900)</i> to <i>OSD: Add heartbeat message for Jumbo Frames(MTU 9000)</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/journals/91702/diff?detail_id=88546">diff</a>)</li></ul> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=917282017-05-26T20:33:29ZGreg Farnumgfarnum@redhat.com
<ul><li><strong>Duplicates</strong> <i><a class="issue tracker-2 status-1 priority-4 priority-default" href="/issues/18438">Feature #18438</a>: Configurable OSD Heartbeat packet size (MTU)</i> added</li></ul> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=917302017-05-26T20:36:39ZGreg Farnumgfarnum@redhat.com
<ul></ul><p>I've seen stuff about this before but not been entirely clear on what's happening. Is the issue that the local box is configured for jumbo frames but the switch silently drops them? I'm wondering if there's something Ceph can query to know if it needs to do this validation.</p>
<p>I suppose we can inflate the heartbeat packets with a zero-filled bufferlist or something. Should we do that for every heartbeat? I suppose a 9KB packet that gets thrown away isn't <strong>that</strong> much wasted network bandwidth...</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=917412017-05-26T22:12:43ZVikhyat Umrao
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/91741/diff?detail_id=88575">diff</a>)</li></ul><p>Greg Farnum wrote:</p>
<p>Thanks Greg for your inputs.</p>
<blockquote>
<p>I've seen stuff about this before but not been entirely clear on what's happening. Is the issue that the local box is configured for jumbo frames but the switch silently drops them? I'm wondering if there's something Ceph can query to know if it needs to do this validation.</p>
</blockquote>
<p>Yes. This was the case. Local was having MTU configured as 9000 and there was some issue at switch layer configuration for 9000 MTU and osd does not log about heartbeat failures.</p>
<blockquote>
<p>I suppose we can inflate the heartbeat packets with a zero-filled bufferlist or something. Should we do that for every heartbeat? I suppose a 9KB packet that gets thrown away isn't <strong>that</strong> much wasted network bandwidth...</p>
</blockquote>
<p>Yep. Yesterday I had a quick discussion with Josh before creating this feature request and we agreed that <strong>a feature for periodically sending a larger request to detect that MTU issue would be great</strong>. Maybe we can choose periodically? `osd_heartbeat_interval` default is 6 seconds maybe we can choose even number packets?</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=922832017-06-06T20:11:42ZGreg Farnumgfarnum@redhat.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>7</i></li><li><strong>Assignee</strong> set to <i>Greg Farnum</i></li></ul><p><a class="external" href="https://trello.com/c/CYMJXbY8/32-osd-make-osd-ping-messages-large">https://trello.com/c/CYMJXbY8/32-osd-make-osd-ping-messages-large</a></p>
<p><a class="external" href="https://github.com/ceph/ceph/pull/15422">https://github.com/ceph/ceph/pull/15422</a></p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=923882017-06-07T16:39:33ZVikhyat Umrao
<ul></ul><p>Greg Farnum wrote:</p>
<blockquote>
<p><a class="external" href="https://trello.com/c/CYMJXbY8/32-osd-make-osd-ping-messages-large">https://trello.com/c/CYMJXbY8/32-osd-make-osd-ping-messages-large</a></p>
<p><a class="external" href="https://github.com/ceph/ceph/pull/15422">https://github.com/ceph/ceph/pull/15422</a></p>
</blockquote>
<p>Thanks Greg. I think the PR link is wrong the correct one is this one: <a class="external" href="https://github.com/ceph/ceph/pull/15535">https://github.com/ceph/ceph/pull/15535</a> :)</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=929132017-06-14T20:10:31ZYuri Weinsteinyweinste@redhat.com
<ul></ul><p><a class="external" href="https://github.com/ceph/ceph/pull/15535">https://github.com/ceph/ceph/pull/15535</a> merged</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=929192017-06-14T20:32:47ZVikhyat Umrao
<ul><li><strong>Backport</strong> set to <i>jewel</i></li></ul> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=930382017-06-17T01:48:23ZGreg Farnumgfarnum@redhat.com
<ul><li><strong>Status</strong> changed from <i>7</i> to <i>Pending Backport</i></li></ul><p>Note to backporters: consider whatever happens with <a class="external" href="https://github.com/ceph/ceph/pull/15727">https://github.com/ceph/ceph/pull/15727</a> !</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=933572017-06-19T20:52:47ZNathan Cutlerncutler@suse.cz
<ul><li><strong>Copied to</strong> <i><a class="issue tracker-9 status-3 priority-4 priority-default closed" href="/issues/20353">Backport #20353</a>: jewel: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)</i> added</li></ul> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=934282017-06-20T14:38:24ZVikhyat Umrao
<ul></ul><p>Greg Farnum wrote:</p>
<blockquote>
<p>Note to backporters: consider whatever happens with <a class="external" href="https://github.com/ceph/ceph/pull/15727">https://github.com/ceph/ceph/pull/15727</a> !</p>
</blockquote>
<p>Thanks Greg. I have assigned the backport to myself. I will keep tracking of 15727 and will take action according to that.</p> Ceph - Feature #20087: OSD: Add heartbeat message for Jumbo Frames(MTU 9000)https://tracker.ceph.com/issues/20087?journal_id=980112017-08-31T08:24:57ZNathan Cutlerncutler@suse.cz
<ul><li><strong>Status</strong> changed from <i>Pending Backport</i> to <i>Resolved</i></li></ul>