Tasks #21727: asking for 7.4 vps nodes - sepia - Ceph

Actions

Copy link

Tasks #21727

closed

asking for 7.4 vps nodes

Added by Kefu Chai over 6 years ago. Updated over 6 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

David Galloway

Category:

Infrastructure Service

Target version:

% Done:

Tags:

Reviewed:

Affected Versions:

Description

2017-10-09T11:11:41.702 ERROR:teuthology.lock.util:os-version '7.4' is invalid for os-type 'centos'. Try one of: 6.3, 6.4, 6.5, 7.0, 7.1, 7.2, 7.3
2017-10-09T11:11:41.702 ERROR:teuthology.lock.ops:Invalid os-type or version detected -- lock failed
2017-10-09T11:11:41.702 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/lock_machines.py", line 84, in lock_machines
    all_locked.update(newly_locked)
TypeError: 'NoneType' object is not iterable
2017-10-09T11:11:41.721 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=9ddb33f79ef547f38dbf0b6acf27d30a
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/lock_machines.py", line 84, in lock_machines
    all_locked.update(newly_locked)
TypeError: 'NoneType' object is not iterable

see http://pulpito.ceph.com/kchai-2017-10-09_11:11:32-ceph-disk-wip-bz1494543-jewel-kefu-distro-basic-vps/1717324/

Actions

Copy link

Updated by David Galloway over 6 years ago

Category changed from Test Node to Infrastructure Service
Assignee changed from David Disseldorp to David Galloway

We're struggling with the newer version of cloud-init that is shipped in the CentOS 7.4 cloud image. It's not playing nicely with the user-data cloud-init script that gets generated by teuthology/downburst.

cloud-init 0.7.9-9 interprets the top half of our user-data script to be an octet-stream now instead of cloud-config.

Correct user-data.txt.i file

[root@vpm099 instance]# cat user-data.txt.i 
From nobody Fri Sep 22 17:15:21 2017
Content-Type: multipart/mixed; boundary="===============0467500636575941152==" 
MIME-Version: 1.0
Number-Attachments: 2

--===============0467500636575941152==
Content-Type: text/cloud-config; charset="us-ascii" 
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment; filename="part-001" 

packages: [git, wget, redhat-lsb-core]
runcmd:
- [passwd, -d, ubuntu]
- [sed, -ie, 's/HWADDR=".*"/HWADDR="52:54:00:46:7b:2b"/', /etc/sysconfig/network-scripts/ifcfg-eth0]
user: ubuntu

--===============0467500636575941152==
Content-Type: text/x-shellscript; charset="us-ascii" 
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment; filename="part-002" 

#!/bin/sh
# eject the cdrom (containing the cloud-init metadata)
# as a signal that we've reached full functionality;
# this is used by ``downburst create --wait``
exec eject /dev/cdrom

--===============0467500636575941152==--

Incorrect user-data.txt.i file (CentOS 7.4)

[root@vpm041 instance]# cat user-data.txt.i 
From nobody Mon Oct  9 20:25:32 2017
Content-Type: multipart/mixed; boundary="===============1199150956588714874==" 
MIME-Version: 1.0
Number-Attachments: 2

--===============1199150956588714874==
Content-Type: application/octet-stream
MIME-Version: 1.0
Content-Disposition: attachment; filename="part-001" 

packages: [git, wget, redhat-lsb-core]
runcmd:
- [passwd, -d, ubuntu]
- [sed, -ie, 's/HWADDR=".*"/HWADDR="52:54:00:8e:8e:ea"/', /etc/sysconfig/network-scripts/ifcfg-eth0]
user: ubuntu

--===============1199150956588714874==
Content-Type: text/x-shellscript; charset="us-ascii" 
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment; filename="part-002" 

#!/bin/sh
# eject the cdrom (containing the cloud-init metadata)
# as a signal that we've reached full functionality;
# this is used by ``downburst create --wait``
exec eject /dev/cdrom

--===============1199150956588714874==--

In /var/log/messages on CentOS 7.4:

Oct  9 20:25:32 localhost cloud-init: 2017-10-09 20:25:32,233 - __init__.py[WARNING]: Unhandled unknown content-type (application/octet-stream) userdata: 'packages: [git, wget, re...'

Actions

Copy link

Updated by David Galloway over 6 years ago

In all cases, the user-data.txt is formatted the same:

#cloud-config-archive
- 'packages: [git, wget, redhat-lsb-core]

  runcmd:

  - [passwd, -d, ubuntu]

  - [sed, -ie, ''s/HWADDR=".*"/HWADDR="52:54:00:8e:8e:ea"/'', /etc/sysconfig/network-scripts/ifcfg-eth0]

  user: ubuntu

  '
- '#!/bin/sh

  # eject the cdrom (containing the cloud-init metadata)

  # as a signal that we''ve reached full functionality;

  # this is used by ``downburst create --wait``

  exec eject /dev/cdrom

  '

I suspect maybe this commit has something to do with it: https://github.com/cloud-init/cloud-init/commit/341a805fca9a06ce12e9f4bbbe15b3dded9eb6a4#diff-a543026d533dadf4f39b57d1f65dc1b7

Actions

Copy link