Project

General

Profile

Actions
Copy link

Bug #40663

closed

bugs in list objects v1

Added by Casey Bodley almost 5 years ago. Updated about 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Albin Antony
Target version:
-
% Done:

0%

Source:
Tags:
listv2
Backport:
nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
28873
Crash signature (v1):
Crash signature (v2):

Description

the changes to list-objects are causing multisite test failures. multisite sync fails to decode the json format of v1 bucket listings. the json result is missing the final } and the fields KeyMarker and VersionIdMarker are duplicated:

{
  "Name": "pugjvw-7",
  "Prefix": "",
  "KeyMarker": "",
  "VersionIdMarker": "",
  "MaxKeys": 1000,
  "IsTruncated": "false",
  "KeyMarker": "",
  "VersionIdMarker": "",
  "Entries": [
    {
      "IsDeleteMarker": false,
      "Key": "&",
      "RgwxTag": "37ea426c-fc46-4941-8c27-76fde0dbb85e.4144.90",
      "RgwxMtime": "2019-07-03T17:58:03.464771791Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:58:03.464Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    },
    {
      "IsDeleteMarker": false,
      "Key": ":",
      "RgwxTag": "37ea426c-fc46-4941-8c27-76fde0dbb85e.4144.88",
      "RgwxMtime": "2019-07-03T17:58:03.379543693Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:58:03.379Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    },
    {
      "IsDeleteMarker": false,
      "Key": "_myobj",
      "RgwxTag": "37ea426c-fc46-4941-8c27-76fde0dbb85e.4144.85",
      "RgwxMtime": "2019-07-03T17:58:03.323513787Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:58:03.323Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    },
    {
      "IsDeleteMarker": false,
      "Key": "myobj",
      "RgwxTag": "37ea426c-fc46-4941-8c27-76fde0dbb85e.4144.77",
      "RgwxMtime": "2019-07-03T17:58:03.149433055Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:58:03.149Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    }
  ]

reverting the list-v2 changes produces this correct output:

{
  "Name": "jyiuuu-7",
  "Prefix": "",
  "KeyMarker": "",
  "VersionIdMarker": "",
  "MaxKeys": 1000,
  "IsTruncated": "false",
  "Entries": [
    {
      "IsDeleteMarker": false,
      "Key": "&",
      "RgwxTag": "cf3245e5-4075-4b64-9e67-56028766e1b6.4144.93",
      "RgwxMtime": "2019-07-03T17:36:36.613123217Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:36:36.613Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    },
    {
      "IsDeleteMarker": false,
      "Key": ":",
      "RgwxTag": "cf3245e5-4075-4b64-9e67-56028766e1b6.4144.91",
      "RgwxMtime": "2019-07-03T17:36:36.493952731Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:36:36.493Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    },
    {
      "IsDeleteMarker": false,
      "Key": "_myobj",
      "RgwxTag": "cf3245e5-4075-4b64-9e67-56028766e1b6.4144.89",
      "RgwxMtime": "2019-07-03T17:36:36.421685020Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:36:36.421Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    },
    {
      "IsDeleteMarker": false,
      "Key": "myobj",
      "RgwxTag": "cf3245e5-4075-4b64-9e67-56028766e1b6.4144.80",
      "RgwxMtime": "2019-07-03T17:36:36.268098478Z",
      "VersionId": "null",
      "IsLatest": true,
      "LastModified": "2019-07-03T17:36:36.268Z",
      "ETag": "\"a8f5f167f44f4964e6c998dee827110c\"",
      "Size": 6,
      "StorageClass": "STANDARD",
      "Owner": {
        "ID": "tester",
        "DisplayName": "Test User" 
      },
      "Type": "Normal" 
    }
  ]
}

Related issues 1 (0 open — 1 closed)

Copied to rgw - Backport #43300: nautilus: bugs in list objects v1ResolvedNathan CutlerActions
Actions
Copy link
 #1

Updated by Albin Antony almost 5 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #2

Updated by Casey Bodley almost 5 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link
 #3

Updated by Ilsoo Byun over 4 years ago

I have the same error in nautilus. I think it needs to be backported.

Actions
Copy link
 #4

Updated by Nathan Cutler over 4 years ago

  • Status changed from Resolved to Pending Backport
  • Backport set to nautilus
Actions
Copy link
 #5

Updated by Nathan Cutler over 4 years ago

Actions
Copy link
 #6

Updated by Nathan Cutler over 4 years ago

  • Pull request ID set to 28873
Actions
Copy link
 #7

Updated by Nathan Cutler about 4 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions
Copy link

Also available in: Atom PDF