Bug #10297: missing attr hinfo, error: "extra attr hinfo_key" error in upgrade:firefly-x-next-distro-basic-multi run - Ceph - Ceph

Bug #10297

missing attr hinfo, error: "extra attr hinfo_key" error in upgrade:firefly-x-next-distro-basic-multi run

Added by Yuri Weinstein almost 9 years ago. Updated over 8 years ago.

Status:

Duplicate

Priority:

Urgent

Assignee:

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-10_17:13:01-upgrade:firefly-x-next-distro-basic-multi/647031/

failure_reason: '"2014-12-10
    18:45:56.955169 osd.8 10.214.131.28:6800/2506 51 : cluster [ERR] 3.59s0 shard
    2(3): soid 593f7fd9/plana3432085-22/270//3 extra attr hinfo_key" in cluster log'

Related issues

History

#1 Updated by Loïc Dachary almost 9 years ago

I'm not sure how that's possible. All objects in an erasure coded pool (3.59s0 shard shows it is one because of the trailing s0) are supposed to have hinfo_key attributes. Could this come from a newly added tests that is over zealous ?

#2 Updated by Loïc Dachary almost 9 years ago

description: upgrade:firefly-x/stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml
  2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml
  6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml
  distros/ubuntu_12.04.yaml}

#3 Updated by Yuri Weinstein almost 9 years ago

Loic Dachary wrote:

I'm not sure how that's possible. All objects in an erasure coded pool (3.59s0 shard shows it is one because of the trailing s0) are supposed to have hinfo_key attributes. Could this come from a newly added tests that is over zealous ?

This suite is new in part that it runs all workloads in parallel with upgrade.

#4 Updated by Loïc Dachary almost 9 years ago

Ok. Then I guess the problem is to find which workload is walking all objects and complaining about "hinfo_key". In http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-10_17:13:01-upgrade:firefly-x-next-distro-basic-multi/647031/teuthology.log there only is one occurrence of the "hinfo" keyword. That's weird.

#5 Updated by Loïc Dachary almost 9 years ago

Any idea ?

#6 Updated by Samuel Just almost 9 years ago

Actually, the problem is likely that the hinfo_key was missing on whatever osd ended up as the "authoritative" osd. So, it's not an extra attr, it's a missing attr.

#7 Updated by Samuel Just almost 9 years ago

Priority changed from Normal to Urgent

#8 Updated by Samuel Just almost 9 years ago

Subject changed from "extra attr hinfo_key" error in upgrade:firefly-x-next-distro-basic-multi run to missing attr hinfo, error: "extra attr hinfo_key" error in upgrade:firefly-x-next-distro-basic-multi run