sdake 1:29 2m 2m 4 {default-scheduler } Warning FailedScheduling [SchedulerPredicates failed due to PersistentVolumeClaim is not bound: "rabbitmq", which is unexpected., SchedulerPredicates failed due to Pe 1:29 rsistentVolumeClaim is not bound: "rabbitmq", which is unexpected., SchedulerPredicates failed due to PersistentVolumeClaim is not bound: "ra 1:29 bbitmq", which is unexpected.] inc0 1:29 Reepicheep: yml;) reepicheep 1:29 lol.. yeah .. since I was point that out to you a few weeks back 1:29 *hangs his head but laughs* inc0 1:30 karma sdake 1:30 pv and pvc insepction looks good reepicheep 1:30 i'm sure I will do it again sdake 1:30 kfox1111 ^ ? kbaegis 1:31 If I write up a guide for setting kolla up on gentoo, who do I submit it to? 1:31 There are kernel config requirements, tricks, etc just like the other oses 1:34 Anyone know of an alternative to py-sysctl? 1:37 This was the blocker breaking haproxy for me: https://paste.pound-python.org/show/wdmihGbbXgOtlcOK3VMH/ reepicheep 1:38 so it apears that if I override network_interfaces in the inventory file it does not apply to the other interfaces from globals.yml like api_interface: "{{ network_interface }}" 1:39 is that to be expected? ^ 1:39 It works when I set each of the interface options in the inventory file kbaegis 1:40 Reepicheep: Separate per-host definitions for neutron_external_interface, api_interface, and storage_interface 1:40 Also tunnel_interface reepicheep 1:41 yeah.. that is what I ended up doing to make it work inc0 1:42 if you specify this in globals, it will override inventory changes egonzalez 1:44 Reepicheep yep, or each in the inventory or the most common at group_vars, but not globals reepicheep 1:45 ok.. thanks.. see I still have a lot to learn about ansible ;) kbaegis 1:47 sweet :D ok=601 changed=289 unreachable=0 failed=0 inc0 1:48 kolla on gentoo 1:48 that's golden reepicheep 1:55 kbaegis: so yeah had me curious .. here is one of my old gentoo box uptimes "14:51:51 up 1256 days, 23:39" kbaegis 1:56 inc0: You actually mentioned that at the summit ;) 1:56 I'll write a guide if it's helpful 1:56 Reepicheep: That's awesome 1:57 Yeah, on the span of 10 years power failures start to become the key factor inc0 1:57 kbaegis: that would make a great blogpost;) kbaegis 1:57 Their competition ended when one of their basements flooded reepicheep 1:57 I think the only reason that it even rebooted then was because that is when we had a guy doing mainanace on the UPS and killed the entire server room :| kbaegis 1:57 Reepicheep: Sounds like gentoo alright :) reepicheep 1:57 we didn't have anyone in there at the time I pretty sure pushed the lever the wrong way 1:58 now we always have someone with them when they are doing the yearly maintenace 1:59 lol the kernel is 2.6.23-hardened-r4 kba 2:00 Yeah, I never learned how to live patch or ksplice kbaegis 2:00 kexec is awesome though reepicheep 2:02 since I'm looking at the interface definitions .. what exactly is the dns_interface used for? openstackgerrit 2:04 Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multi-scenerio gates https://review.openstack.org/466815 inc0 2:05 Reepicheep: I believe it was sth to do with designate reepicheep 2:05 that makes sense egonzalez 2:07 Reepicheep is the interface used by mDNS (designate) inc0 2:08 egonzalez: mind checking it up? https://review.openstack.org/#/c/466007/ reepicheep 2:09 egonzalez: I was looking at designate the other day.. I saw your blog. I remember something about the interface needs to be public is that because haproxy doesn't do udp? egonzalez 2:09 Reepicheep yes, haproxy only handle tcp load balancing 2:10 thats why a dns_interface is needed, to publish mDNS to instances or public network reepicheep 2:11 so since it by default is using the controller nodes they then would need to have a public IP like the network nodes if you need pubic access? 2:11 all my testing the network nodes where the only hosts with access to the public networks 2:12 but I never went beyond just reading about designate egonzalez 2:13 hrm, maybe mdns containers need to go on network node... 2:13 never though about that inc0 2:13 egonzalez: that would be good 2:14 in fact, network nodes can be only ones exposed to external network egonzalez 2:14 i have a working change for designate, probably include the group change reepicheep 2:15 inc0: I hope that's the case because that is how I have been testing for the last month.. and I'm now working on a production deployment ;) inc0 2:16 Reepicheep: worst case scenerio that would be simple chagne in inventory reepicheep 2:16 true inc0 2:16 Reepicheep: https://github.com/openstack/kolla-ansible/blob/master/ansible/inventory/multinode#L542 just change this line to network and that's it reepicheep 2:18 thanks, I will give that a try.. I have been interested in the designate project but have yet to really try it because of the public IP stuff openstackgerrit 2:20 Eduardo Gonzalez proposed openstack/kolla-ansible master: Move mDNS to network nodes https://review.openstack.org/468534 reepicheep 2:23 that was quick ^ ^ thanks egonzalez 2:23 Reepicheep ^^ the "fix', didn't tested yet, but by designate architecture should work just changing the group, will verify after the weekend 2:25 Reepicheep won't work :( , another change is needed, templates wont work unless is the same interface inc0 2:31 egonzalez: btw http://logs.openstack.org/07/466007/72/experimental/gate-kolla-ansible-dsvm-deploy-ceph-oraclelinux-binary-centos-7-2-node-nv/7ab7921/logs/kolla/nova/nova-compute.log this issue appears every now and then 2:32 did you notice it? it's quite undeterministic openstackgerrit 2:32 Eduardo Gonzalez proposed openstack/kolla-ansible master: Move mDNS to network nodes https://review.openstack.org/468534 inc0 2:38 I'm thinking this might be race condition between scheduler starting up and deployment of nova-compute 2:38 we deploy too fast;) kfox1111 2:38 heh. there are races all over the place. inc0 2:38 yeah kfox1111 2:38 90% percent of the kolla-kubernetes gate work was all just figuring out how to get rid of them. :/ inc0 2:39 I've seen this one in particular several times during my gate work 2:40 brb need to do some grocery shopping 2:40 kfox1111: I'd appreciate your review too https://review.openstack.org/#/c/466007/ 2:41 I know it's heavy on ansible, but your gate expetise might help picking something I might've missed kfox1111 2:41 I'll have a quick look. inc0 2:41 thanks kfox1111 2:42 can't say I will understand it all. ;) inc0 2:42 no worries, I don't 2:42 ;) kfox1111 2:43 are you using ansible to run ansible? inc0 2:43 no kfox1111 2:43 self modifying run? 2:43 or one instantiation followed by another maybe... inc0 2:43 which lines are you referring to? kbaegis 2:44 inc0 thanks for the help earlier! I owe you one kfox1111 2:44 just looking through. nothing in particular yet. inc0 2:44 I run localhost ansible to lay down configs that I'll use later with non-local ansible inc0 2:44 kbaegis: np, happy to help kfox1111 2:44 k inc0 2:45 if you, or anyone here feeling that you owe me, feels like returning a favor, I'll accept payment in a writing something to docs;) 2:46 cheat sheet entry, use case description, anything is appreciated kbaegis 2:46 I'll write up a gentoo install guide kfox1111 2:46 inc0: any reason to support non systemd ubuntu anymore? inc0 2:46 that would be awesome:) thank you! kbaegis 2:46 Including all the kernel parameters that are required for kolla 2:47 np ;) 6:12 You have connected 6:12 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 6:12 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 kbaegis 6:12 Hey guys. What was the haproxy buy associated with solum? 6:16 manheim left the room (quit: Ping timeout: 255 seconds). 6:20 unicell left the room (quit: Quit: Leaving.). 6:21 itlinux [~textual@2602:30a:c0aa:3fb0:1d1:7037:4792:5183] entered the room. 6:23 salv-orlando [~salv_orla@94.166.106.219] entered the room. 6:25 manheim [~manheim@92.87.237.3] entered the room. 6:27 salv-orlando left the room (quit: Ping timeout: 246 seconds). 6:30 manheim left the room (quit: Ping timeout: 255 seconds). 6:39 manheim [~manheim@92.87.237.3] entered the room. 6:41 harlowja left the room (quit: Ping timeout: 240 seconds). 6:48 manheim left the room (quit: Ping timeout: 255 seconds). 6:51 emccormick [~emcco@2601:98b:300:2c90:ece2:e2a:9078:b906] entered the room. 6:54 srwilkers left the room (quit: Ping timeout: 260 seconds). 6:54 Pavo [~brockback@75.76.204.44] entered the room. 6:56 ddyer2 left the room (quit: Quit: Nettalk6 - www.ntalk.de). 6:57 manheim [~manheim@92.87.237.3] entered the room. 7:02 manheim left the room (quit: Ping timeout: 255 seconds). 7:10 itlinux left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 7:11 manheim [~manheim@92.87.237.3] entered the room. 7:14 Pavo left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 7:20 manheim left the room (quit: Ping timeout: 255 seconds). 7:24 salv-orlando [~salv_orla@94.161.156.6] entered the room. 7:28 salv-orlando left the room (quit: Ping timeout: 240 seconds). 7:29 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 7:29 harlowja [~harlowja@107-194-154-154.lightspeed.sntcca.sbcglobal.net] entered the room. sdake 7:32 dmsimard has rdo ocata undergone some kind of change in mariadb? 7:32 hrw left the room (quit: Ping timeout: 260 seconds). 7:34 manheim [~manheim@92.87.237.3] entered the room. 7:34 hrw [~hrw@redhat/hrw] entered the room. 7:36 emccormick left the room (quit: Read error: Connection reset by peer). 7:38 manheim left the room (quit: Ping timeout: 255 seconds). 7:39 emccormick [~emcco@2601:98b:300:2c90:ece2:e2a:9078:b906] entered the room. 7:41 stefan_bo [~quassel@014136139232.ctinets.com] entered the room. 7:47 manheim [~manheim@92.87.237.3] entered the room. sdake 7:49 inc0 we may be forced to eject xtradbbackup 7:49 inc0 can you confirm if it is needed 7:52 eanylin left the room (quit: Ping timeout: 240 seconds). 7:53 rhallisey [~rhallisey@209-6-78-26.c3-0.abr-ubr1.sbo-abr.ma.cable.rcn.com] entered the room. 7:56 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 8:00 manheim left the room (quit: Remote host closed the connection). 8:01 harlowja left the room (quit: Quit: My Mac has gone to sleep. ZZZzzz…). 8:01 rhallisey left the room (quit: Quit: Leaving). 8:04 hieulq left the room (quit: Remote host closed the connection). 8:04 caowei [~Thunderbi@210.74.5.8] entered the room. 8:04 manheim [~manheim@92.87.237.3] entered the room. 8:09 manheim left the room (quit: Ping timeout: 255 seconds). 8:14 emccormick left the room (quit: Read error: Connection reset by peer). 8:17 eaguilar [~eaguilar@186.22.108.116] entered the room. 8:18 emccormick [~emcco@2601:98b:300:2c90:ece2:e2a:9078:b906] entered the room. 8:22 eanylin [~eanylin@cpe-72-180-77-40.tx.res.rr.com] entered the room. 8:24 emccormick left the room (quit: Read error: Connection reset by peer). 8:24 hieulq [~hieulq@p31007-ipngnfx01hodogaya.kanagawa.ocn.ne.jp] entered the room. 8:25 emccormick [~emcco@2601:98b:300:2c90:ece2:e2a:9078:b906] entered the room. 8:27 hieulq left the room (quit: Remote host closed the connection). 8:29 You have disconnected 8:32 You have connected 8:32 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 8:32 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 8:40 manheim [~manheim@92.87.237.3] entered the room. 8:43 hieulq [~hieulq@p31007-ipngnfx01hodogaya.kanagawa.ocn.ne.jp] entered the room. 8:45 manheim left the room (quit: Ping timeout: 255 seconds). 8:48 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 8:56 itlinux [~textual@2602:30a:c0aa:3fb0:1d1:7037:4792:5183] entered the room. 8:58 itlinux left the room (quit: Client Quit). 9:14 lucasxu [~lucas@209-6-213-131.c3-0.bkl-ubr1.sbo-bkl.ma.cable.rcn.com] entered the room. 9:17 manheim [~manheim@92.87.237.3] entered the room. 9:18 emccormick left the room (quit: Ping timeout: 240 seconds). openstackgerrit 9:19 Li Yingjun proposed openstack/kolla master: Add os-brick to glance container https://review.openstack.org/468604 9:20 itlinux [~textual@2602:30a:c0aa:3fb0:1d1:7037:4792:5183] entered the room. 9:21 manheim left the room (quit: Ping timeout: 255 seconds). 9:25 salv-orlando [~salv_orla@94.161.254.53] entered the room. 9:30 salv-orlando left the room (quit: Ping timeout: 240 seconds). 9:33 unicell [~unicell@unaffiliated/unicell] entered the room. 9:33 stefan_bo left the room (quit: Ping timeout: 246 seconds). 9:35 lucasxu left the room (quit: Quit: My Mac has gone to sleep. ZZZzzz…). sdake 9:41 sbezverk that cell integration is broken 9:41 sbezverk placement must register prior to cells 9:42 cell0 enters restart loop openstackgerrit 9:45 shaofeng cheng proposed openstack/kolla-ansible master: Enabled pxe_ssh driver in ironic https://review.openstack.org/468606 9:53 manheim [~manheim@92.87.237.3] entered the room. 9:57 manheim left the room (quit: Ping timeout: 255 seconds). 10:15 stefan_bo [~quassel@014136139232.ctinets.com] entered the room. 10:26 salv-orlando [~salv_orla@94.161.254.53] entered the room. 10:29 manheim [~manheim@92.87.237.3] entered the room. 10:30 salv-orlando left the room (quit: Ping timeout: 240 seconds). 10:31 stefan_bo left the room (quit: Ping timeout: 240 seconds). 10:32 salv-orlando [~salv_orla@94.161.254.53] entered the room. 10:34 manheim left the room (quit: Ping timeout: 255 seconds). 10:34 You have disconnected 7:41 Saturday, May 27, 2017 7:41 You have connected 7:41 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 7:41 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 7:42 manheim left the room (quit: Ping timeout: 255 seconds). 7:47 manheim [~manheim@92.87.237.3] entered the room. 7:51 manheim left the room (quit: Ping timeout: 255 seconds). 7:52 manheim [~manheim@92.87.237.3] entered the room. openstackgerrit 7:56 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 7:56 manheim left the room (quit: Ping timeout: 255 seconds). 8:18 jgriffith [~jgriffith@ec2-54-146-182-136.compute-1.amazonaws.com] entered the room. 8:21 manheim [~manheim@92.87.237.3] entered the room. 8:23 sbezverk_ [~sbezverk@modemcable085.149-22-96.mc.videotron.ca] entered the room. openstackgerrit 8:23 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 sdake 8:24 berendt you around? 8:25 pbourke ? 8:26 sbezverk left the room (quit: Ping timeout: 240 seconds). 8:30 salv-orlando [~salv_orla@5.87.164.175] entered the room. 8:35 salv-orlando left the room (quit: Ping timeout: 260 seconds). 8:40 manheim left the room (quit: Ping timeout: 255 seconds). openstackgerrit 8:48 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 kbaegis 9:02 Hey sdake? If I wanted to prevent the ovs-vswitchd daemon from insmodding 9:03 How would I patch that? 9:03 (I have ovs built-in, not as a module) 9:12 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 9:16 manheim [~manheim@92.87.237.3] entered the room. 9:21 manheim left the room (quit: Ping timeout: 255 seconds). sdake 9:21 kbaegis no idea 9:21 kbaegis would require custom code i think kbaegis 9:23 sdake: Thanks 9:31 salv-orlando [~salv_orla@5.87.130.68] entered the room. 9:35 salv-orlando left the room (quit: Ping timeout: 246 seconds). inc0 9:37 good morning 9:37 sdake: what's up with mariadb? sdake 9:37 there are 3 repositories with mariadb in it 9:38 percona, mariadb, and rdo 9:38 that change chooses rdo 9:38 currently stable/ocata doesn't work inc0 9:38 careful with that, last time we did that for ubuntu we broke multinode sdake 9:38 i understand 9:39 however everything is broken atm inc0 9:40 for centos? sdake 9:41 inc0 can you review this plz: https://review.openstack.org/#/c/468607/ 9:42 yes centos mariadb doesn't ubild 9:42 my change builds and works (for kolla-kubernetes) 9:42 not sure about ansible galera inc0 9:42 it already has 2*+2, someone forgot to tag +w;) 9:42 I'll review it 9:43 sdake: what are steps to reproduce? just build stable/ocata and deploy? 9:43 with centos? sdake 9:43 build stable/ocata 9:43 watch for the error "package mariadb can't be installed" 9:43 or somethign like that 9:44 percona has a deprecation on mariadb-libs 9:44 yum can't resolve with percona in the repo mix 9:45 the solution is to exclude percona during mariadb galera install, then to install xtradb after galera is installed from rdo 9:45 xtradbbackup is just a slew of shell scripts and stuff that get called externally 9:46 the bad result is we can't tag 4.0.1 9:46 as 4.0.1 is unbuildable 9:47 (tag in dockerhub) 9:52 manheim [~manheim@92.87.237.3] entered the room. 9:57 manheim left the room (quit: Ping timeout: 255 seconds). openstackgerrit 9:59 Steven Dake proposed openstack/kolla stable/ocata: Remove sudo operations that are no longer necessary https://review.openstack.org/468655 inc0 10:05 sdake: I just ran pip install kolla and build 10:06 and worked sdake 10:06 it doesn't error 10:06 it just doesn't work 10:06 read the fine rpint :) inc0 10:06 ok, so deploy will break right? sdake 10:06 pip install kolla will install 4.0.1 10:06 you need to git clone - git checkout stable/ocata, sudo pip install . 10:07 then build inc0 10:07 well, if it's upstream change (repo messed up) that shouldn't matter 10:07 if it's something we did, we should revert that kbaegis 10:07 Do either of you remember what I had done months back to solve this? https://hastebin.com/benoveteji.py 10:08 I had to disable qos or fwaas or something? sdake 10:12 inc0 https://da.gd/rqJmH -> https://paste.fedoraproject.org/paste/fwE5xdH4cJrGeDOIMZGDxF5M1UNdIGYhyRLivL9gydE=/ 10:13 INFO:kolla.image.build.mariadb:No package MariaDB-Galera-server available. 10:13 MariaDB-Galera-server was renamed mariadb-server-galera 10:14 which is the same name of the same package in 3 different repositories Reepicheep 10:18 I'm still having trouble with my override of interfaces in the inventory file, can have help verifying my settings? 10:18 http://paste.openstack.org/show/610788/ 10:19 it completes the bootstrap-servers and prechecks fine but is failing on ceph kbaegis 10:19 Reepicheep: Huh, curious. bond0/team0.821? Reepicheep 10:19 on the two servers that don't have team0.821 as interface_storage 10:20 all the other nodes use team0.821 so that is what is set in the globals kbaegis 10:20 Reepicheep: inc0 covered this yesterday, globals.yml overrides the node-specific. It has precedence 10:21 Reepicheep: I don't like that, but it's how it's set up Reepicheep 10:21 hmm. I read that backwards then yesterday 10:21 caoyuan left the room (quit: Remote host closed the connection). 10:21 eaguilar [~eaguilar@186.22.108.116] entered the room. kbaegis 10:22 Reepicheep: I'd use vim and visual block edit to just copy and alter the config per set of nodes 10:22 But unset it in globals.yml and set it per node in inventory inc0 10:23 kbaegis: you can also create new group of nodes and use vars Reepicheep 10:23 interestingly it does use the interfaces file for some because the bootstrap-servers would not even run until I set each of the *_interfaces in the inventory file inc0 10:23 kbaegis: http://docs.ansible.com/ansible/intro_inventory.html#groups-of-groups-and-group-variables inc0 10:24 yeah, bootstrap servers needs api_interface to prep hostfile 10:26 mewald [~Adium@p4FC8183B.dip0.t-ipconnect.de] entered the room. Reepicheep 10:27 i guess yesterday i was thinking the issue was with I was just setting the network_interface in the inventory which is what the globals overwrote with it value for the api with 'api_interface: "{{ network_interface }}' kbaegis 10:28 Reepicheep: That would be intuitive, but it won't work inc0 10:28 I think that if you set up network interface in globals and override api_interface in inventory that works kbaegis 10:29 Yeah, ideally it would follow the most-specific-config principle with overrides 10:29 manheim [~manheim@92.87.237.3] entered the room. Reepicheep 10:32 inc0: I believe that is how I have it set .. unless I'm missing something? http://paste.openstack.org/show/610789/ sdake 10:33 inc0 did you see the problem in the past eabove inc0 10:33 here's caveat 10:33 Reepicheep: 10:33 manheim left the room (quit: Ping timeout: 255 seconds). inc0 10:34 globals override inventory, so you *can't* set up iface name in globals if you do it in inventory 10:34 I'd suggest setting all of interfaces in inventory 10:35 you don't need to do it inline 10:35 you can create host groups with grouped with same iface naming Reepicheep 10:35 inc0 I think I got that now, I will do that and learn to use the host groups ;) 10:35 Pavo [~brockback@75.76.204.44] entered the room. inc0 10:35 and then use [control:children] group1 kind of stuff Reepicheep 10:36 sorry I miss understood the scope of that comment yesterday.. inc0 10:36 yeah it's hard to convey on irc I guess 10:36 and not really intuitive 10:36 anyhow, globals.yml can be entirely replaced with inventory if you know what you're doing 10:37 another thing - if you run kolla-ansible deploy 10:37 first line of output is ansible-playbook ... command 10:37 these are equivalent 10:38 so if you really want to modify how your ansible runs, just use ansible native CLI Reepicheep 10:38 yeah.. and I have years of overwriting node variables in puppet where that is how it works.. the more precise the scope gets precedence 10:38 Pavo left the room (quit: Read error: Connection reset by peer). inc0 10:38 that's kind of case with ansible too 10:38 reason it's not like that is with kolla 10:38 manheim [~manheim@92.87.237.3] entered the room. inc0 10:38 we use -e @/etc/kolla/globals.yml 10:39 Pavo [~brockback@75.76.204.44] entered the room. inc0 10:39 as in - top level overrides provided manually 10:39 so it's our fault rather than ansible Reepicheep 10:39 oh.. that is helpful and now I know why we call kolla-ansible instead of ansible directly inc0 10:40 kolla-ansible is glorified alias Reepicheep 10:41 sweet.. well at least for this issue I can quit pulling my hair out.. if I know what's going I can work around it ;) 10:41 thanks again 10:43 manheim left the room (quit: Ping timeout: 255 seconds). inc0 10:43 sdake: I'll work on it later today sdake 10:43 inc0 i already have a patch up 10:43 inc0 although could use multinode testing inc0 10:43 well I want to see the issue for myself, it's important 10:44 can do that 10:44 and yes, we need multinode testing for that sdake 10:44 i've spent about 12 hours working on it thus far 10:45 i dont think it is necessary to duplicate that effort 10:45 what woudl help is if someone else could do multinode testing - as I don't have a way to do that inc0 10:46 I'll do multinode testing sdake 10:46 https://review.openstack.org/#/c/468632/ 10:46 cool 10:47 openstackgerrit left the room (quit: Remote host closed the connection). 10:48 openstackgerrit [~openstack@review.openstack.org] entered the room. openstackgerrit 10:48 Merged openstack/kolla master: Remove sudo operations that are no longer necessary https://review.openstack.org/468607 sdake 10:51 Jeffrey4l around? 10:51 Jeffrey4l inc0 can you ack this backport please: https://review.openstack.org/468655 10:52 manheim [~manheim@92.87.237.3] entered the room. 10:56 jascott1 left the room (quit: Remote host closed the connection). 10:56 jascott1 [~jascott1@static-50-43-45-215.bvtn.or.frontiernet.net] entered the room. 11:01 jascott1 left the room (quit: Ping timeout: 246 seconds). 11:01 manheim left the room (quit: Ping timeout: 255 seconds). Reepicheep 11:09 kbaegis: inc0 I now have no interfaces defined in globals.yml and two host groups [team0] and [bond0] to allow me to use the two odd ball nodes that I'm using a "bond" interface on instead of a "team" to do link aggregation.. and I'm holding my tongue in that right place .. so it's going to work 11:10 manheim [~manheim@92.87.237.3] entered the room. openstackgerrit 11:12 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 11:15 manheim left the room (quit: Ping timeout: 255 seconds). 11:24 manheim [~manheim@92.87.237.3] entered the room. 11:32 salv-orlando [~salv_orla@5.87.130.68] entered the room. 11:33 manheim left the room (quit: Ping timeout: 255 seconds). 11:37 salv-orlando left the room (quit: Ping timeout: 240 seconds). 11:38 manheim [~manheim@92.87.237.3] entered the room. 11:42 manheim left the room (quit: Ping timeout: 255 seconds). 11:56 manheim [~manheim@92.87.237.3] entered the room. kbaegis 11:57 Reepicheep: Sure. There are also a lot of bond/teamed packet schedulers worth investigating 11:58 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 12:00 manheim left the room (quit: Ping timeout: 240 seconds). Reepicheep 12:02 I like to use the teamed interfaces over the old bonded interfaces but of course I'm having an issue with two old nodes so it's simpler for me just to leave them as bonded interfaces 12:04 I probably could figure out how to make it work on the system level and make it use team0 as the interface but I really need to understand the ansible magic to over ride stuff from the inventories so I am attempting to solve it there 12:05 btw, my trick of holding my tongue just right didn't work so I'm still learning :| 12:05 jamesPR [~James@24.41.224.164] entered the room. 12:12 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 12:14 manheim [~manheim@92.87.237.3] entered the room. 12:18 manheim left the room (quit: Ping timeout: 246 seconds). kbaegis 12:20 Reepicheep: I'm a fan of lacp, but there are good alternatives. round robin is perfectly acceptable 12:20 I only have a 2 node deployment :) 12:21 Well, technically 4, but two of those are atom based routers 12:22 kbyrne left the room (quit: Quit: ZNC 1.6.3 - http://znc.in). 12:31 Pavo [~brockback@75.76.204.44] entered the room. 12:32 manheim [~manheim@92.87.237.3] entered the room. 12:33 salv-orlando [~salv_orla@5.87.173.118] entered the room. kbaegis 12:35 Can you specify more than one virt_type in nova? 12:35 Pavo left the room (quit: Client Quit). 12:36 manheim left the room (quit: Ping timeout: 246 seconds). 12:38 salv-orlando left the room (quit: Ping timeout: 240 seconds). 12:38 Pavo [~brockback@75.76.204.44] entered the room. 12:50 manheim [~manheim@92.87.237.3] entered the room. 12:55 manheim left the room (quit: Ping timeout: 260 seconds). Reepicheep 1:09 kbaegis: part of my issue is probably my own complexity.. my aggregated interfaces are actually mlag to a pair of tor switches which does add great resistance but at the expense of complexity 1:09 manheim [~manheim@92.87.237.3] entered the room. Reepicheep 1:09 especially I have heterogeneous nodes 1:10 It's always nice to have consistent hardware.. but sometimes we don't get that option ;) kbaegis 1:12 Reepicheep: Best way to do it in a lab environment :) Get to learn more 1:13 But then, I'm just the crazy gentoo guy 1:13 manheim left the room (quit: Ping timeout: 246 seconds). kbaegis 1:15 omg! The ovs firewall works, even though the poorly scripted hybrid iptables/ovs one doesn't :DD 1:17 You have disconnected 2:21 You have connected 2:21 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 2:21 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 2:22 manheim [~manheim@92.87.237.3] entered the room. openstackgerrit 2:24 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 2:26 manheim left the room (quit: Ping timeout: 255 seconds). sdake 2:28 kfox1111 re search path - i can do that - not sure what you mean by it tho openstackgerrit 2:29 Merged openstack/kolla-kubernetes master: Script to Deploy Kolla Kubernetes AIO https://review.openstack.org/464312 kolla-slack1 2:30 Related to my earlier comment. Make it overridable at the more individual levels too. See the helm docs on conditional reqs 2:35 manheim [~manheim@92.87.237.3] entered the room. sdake 2:36 kfox1111 thanks kbaegis 2:38 Anyone know what services collide with iscsid? 2:38 getting iscsid: can not create NETLINK_ISCSI socket from the iscsi container openstackgerrit 2:38 Steven Dake proposed openstack/kolla-kubernetes master: Simple configmap to raw kubectl https://review.openstack.org/449262 2:40 manheim left the room (quit: Ping timeout: 240 seconds). openstackgerrit 2:42 Merged openstack/kolla-kubernetes master: Remove useless modules in ansible/library https://review.openstack.org/450662 2:42 Steven Dake proposed openstack/kolla-kubernetes master: Remove pathfinder from call path of secret-generator https://review.openstack.org/464273 kbaegis 2:49 Not typically an issue, but when I create a volume from an image I get ImageCopyFailure: Failed to copy image to volume: Could not login to any iSCSI portal sdake 2:49 Jeffrey4l any idea what triggers this ansible error: http://logs.openstack.org/31/464031/40/check/gate-kolla-kubernetes-deploy-centos-source-4-ironic-nv/55495a1/console.html in review: https://review.openstack.org/#/c/464031/40 sdake 2:50 kbaegis no idea what would cause that - other then you may have iscsi running on your host 2:50 kbaegis or iscsi is not enabled in your kernel is another possibility kbaegis 2:54 sdake: I'll double check the kernel 2:54 "iscsid: can not create NETLINK_ISCSI socket" 2:54 manheim [~manheim@92.87.237.3] entered the room. kbaegis 2:54 Yup, good call sdake! 2:55 TARGET_CORE was hiding the setting from me 2:56 jamesPR [~James@24.41.224.164] entered the room. 2:58 caoyuan [~caoyuan@171.8.131.67] entered the room. 2:58 eaguilar [~eaguilar@186.22.108.116] entered the room. 2:58 caoyuan left the room (quit: Remote host closed the connection). 2:59 manheim left the room (quit: Ping timeout: 268 seconds). 3:07 manheim [~manheim@92.87.237.3] entered the room. sdake 3:07 kbaegis so it was a lack of kernel config then? kbaegis 3:10 sdake: Yeah, one of the things necessary for gentoo is to document all the necessary kernel flags. iscsid was the last one 3:11 Here's the config I have working on gentoo: https://hastebin.com/gaxosevuyu.coffeescript 3:12 Turns out it still doesn't like it when I create a volume from image on an encrypted drive 3:12 Not working on my setup. But they work independently, copy from image and encrypt 3:12 Also, the hybridovs driver decidedly doesn't work. Don't know why openstackgerrit 3:17 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 3:17 Steven Dake proposed openstack/kolla-kubernetes master: Remove pin on ansible<2.1 https://review.openstack.org/468672 openstackgerrit 3:25 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 3:28 powerd left the room (quit: Ping timeout: 245 seconds). 3:31 mewald left the room (quit: Quit: Leaving.). 3:34 kbyrne left the room (quit: Quit: ZNC 1.6.3 - http://znc.in). 3:37 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). Reepicheep 3:39 kbaegis: I would not call you the crazy gentoo guy.. I can relate ;) 3:40 manheim left the room (quit: Ping timeout: 260 seconds). Reepicheep 3:40 I used to strip everything out of my kernels except the bare minimum but then I found my self recompiling the kernel every time I wanted stuff like iSCSI ;) 3:41 manheim [~manheim@92.87.237.3] entered the room. 3:42 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). Reepicheep 3:42 I finally got tired of it and decided to take the route of "you know those Red Hat guys, they probably know what they are doing, they may have most of the kitchen in there but at least it doesn't include the kitchen sink" 3:43 kbyrne [~kbyrne@79.97.60.146] entered the room. 3:44 Pavo [~brockback@75.76.204.44] entered the room. Reepicheep 3:45 but when people ask what my favorite distro is after I say "that depends" usually Gentoo is near the top of the list.. using gentoo always seems to may me happy 3:46 manheim left the room (quit: Ping timeout: 268 seconds). Reepicheep 3:47 and because you have shared .. when I get time I will try it.. so thanks ;) 3:53 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 3:53 manheim [~manheim@92.87.237.3] entered the room. 3:56 manheim left the room (quit: Remote host closed the connection). 3:56 manheim [~manheim@92.87.237.3] entered the room. sdake 3:57 kfox1111 quick Q - trying to get a list of all the pvc names in the kolla namespace and using this: 3:57 kubectl get pvc -n kolla -o jsonpath={.metadata.name} 3:57 Error executing template: name is not found. Printing more information for debugging the template: 3:57 hwoever kuectl get pvc -n kolla -o yaml prints em out 3:58 rcrit left the room (quit: Remote host closed the connection). 3:58 manheim left the room (quit: Remote host closed the connection). 3:59 manheim [~manheim@92.87.237.3] entered the room. sbezverk_ 4:00 sdake:check carefully returned json 4:01 it gives you back list 4:01 and you try to access individual element of item of that list sdake 4:01 is there a way to print out al items in the lsit? 4:02 powerd [~powerd@79.97.29.167] entered the room. sdake 4:02 related to that jsonpath? 4:03 kbyrne left the room (quit: Quit: ZNC 1.6.3 - http://znc.in). sbezverk_ 4:05 sdake: kubectl get pvc -n kolla -o jsonpath={.items[*].metadata.name} sdake 4:05 thanks i'll try that openstackgerrit 4:15 Steven Dake proposed openstack/kolla-kubernetes master: Remove pin on ansible<2.1 https://review.openstack.org/468672 4:15 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 sdake 4:16 sbezverk_ thanks dude ! 4:21 manheim left the room (quit: Remote host closed the connection). openstackgerrit 4:23 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 kbaegis 4:25 Reepicheep: :) Well, I'll be writing a community guide to kolla on gentoo 4:25 Reepicheep: kolla-ansible only so far. I'll let you know if I get around to kolla-mesos or kolla-k8s 4:26 Seen zero decent guides for k8s on gentoo 4:26 manheim [~manheim@92.87.237.3] entered the room. kbaegis 4:26 Really makes more sense for 5+ node clusters 4:26 imo Reepicheep 4:29 kbaegis: lol.. since it will be there and it's gentoo and kolla I will probably end up trying just so I can say I tried Reepicheep 4:30 thanks for eating up my future time ;) kbaegis 4:30 Reepicheep: That's what gentoo is good for! ;) 4:31 manheim left the room (quit: Ping timeout: 260 seconds). 4:32 powerd left the room (quit: Ping timeout: 255 seconds). 4:35 powerd [~powerd@79.97.29.167] entered the room. jamesPR 4:36 nice to see ppl using gentoo ;) was my second linux OS back in 2001 4:36 salv-orlando [~salv_orla@5.87.215.94] entered the room. 4:40 salv-orlando left the room (quit: Ping timeout: 240 seconds). 4:51 glycerine left the room (quit: Ping timeout: 246 seconds). 4:54 SaMnCo left the room (quit: Ping timeout: 245 seconds). 4:54 SaMnCo [sid162594@gateway/web/irccloud.com/x-bflyarbmhmqolede] entered the room. 4:54 ediardo left the room (quit: Ping timeout: 245 seconds). 4:54 nanliu left the room (quit: Ping timeout: 245 seconds). 4:55 harmw_ left the room (quit: Ping timeout: 245 seconds). 4:55 wirehead_ left the room (quit: Ping timeout: 245 seconds). 4:56 nanliu [sid131162@gateway/web/irccloud.com/x-ozdovwnuzutbwttx] entered the room. 4:57 ediardo [sid156931@gateway/web/irccloud.com/x-scrprjujljltuevz] entered the room. 4:57 dgonzalez left the room (quit: Ping timeout: 260 seconds). 4:58 harmw [~harmw@2a01:1b0:7999:446:9001::c] entered the room. 4:58 You have disconnected 5:23 You have connected 5:23 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 5:23 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 5:25 kbyrne [~kbyrne@79.97.60.146] entered the room. sdake 5:27 kfox1111 what do you maek of htis: http://logs.openstack.org/72/468672/2/check/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/4a0e541/console.html#_2017-05-27_22_38_10_490151 5:27 it looks to me like there is a new cloud infra 2017-05-27 22:16:04.075501 | [Zuul] Building remotely on centos-7-citycloud-sto2-9023263 in workspace /home/jenkins/workspace/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv 5:27 i'm curious if it works with our gating 5:33 powerd left the room (quit: Ping timeout: 255 seconds). 5:37 salv-orlando [~salv_orla@5.87.207.96] entered the room. 5:38 manheim [~manheim@92.87.237.3] entered the room. 5:42 salv-orlando left the room (quit: Ping timeout: 245 seconds). 5:42 manheim left the room (quit: Ping timeout: 240 seconds). sdake 5:52 gate implodes even on a gatecheck 5:52 http://logs.openstack.org/80/422380/1/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/7023dc3/console.html#_2017-05-27_20_58_07_049655 5:53 selenium among other things kbaegis 5:59 anyone else having issues with murano? 6:03 glycerine [~nate@137.103.134.22] entered the room. 6:06 itlinux [~textual@ip-64-134-238-186.public.wayport.net] entered the room. 6:07 itlinux left the room (quit: Client Quit). 6:10 Pavo [~brockback@75.76.204.44] entered the room. 6:14 manheim [~manheim@92.87.237.3] entered the room. 6:19 manheim left the room (quit: Ping timeout: 268 seconds). sdake 6:22 sbezverk_ looks like some cleanup jobs are consinstely failing with tis error: http://logs.openstack.org/72/468672/2/check/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/8bb4f5a/console.html#_2017-05-27_23_57_01_060947 6:22 selenium is imploding 6:22 kfox1111 sbezverk_ ^^ 6:22 http://logs.openstack.org/72/468672/2/check/gate-kolla-kubernetes-deploy-centos-binary-2-helm-entrypoint-nv/8bb4f5a/console.html#_2017-05-27_23_54_56_082455 6:23 happens on all cloud providers sbezverk_ 6:28 sdake: it is not code issue, it looks something with devicemapper. There was update for centos recently, maybe it is collaterral.. how about Ubuntu job? openstackgerrit 6:31 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 6:33 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 sdake 6:36 the reason ceph gates fail is because of cleanup_tests.sh 6:37 that integration merged in february - so YMMV 6:38 salv-orlando [~salv_orla@5.87.230.29] entered the room. sbezverk_ 6:39 sdake: the gate was fine until recently, but recently kernel got changed and 3.10.0-514.21.1.el7.x86_64 now used at gate sdake 6:40 this problem is already known then? 6:42 salv-orlando left the room (quit: Ping timeout: 260 seconds). openstackgerrit 6:43 Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Do Not Merge, kolla-kubernetes gate tests https://review.openstack.org/461063 sbezverk_ 6:44 sdake: similar error was reported on another version of kernel sdake 6:44 the cleanup failure of the selenium backtrace? 6:44 of/or sbezverk_ 6:45 sdake: no nova delete getting stuck in init sdake 6:46 what type of images do those cleanup jobs use? sbezverk_ 6:46 sdake: the same nova regular containers are using.. sdake 6:49 is there a global describe output in the capture logs? 6:51 manheim [~manheim@92.87.237.3] entered the room. sdake 6:52 looks like entrypoint is the first thing it hits 6:52 http://logs.openstack.org/80/422380/1/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/7023dc3/console.html 6:53 nova cleanup jobs, but no nova jobs 6:53 emccormick [~emcco@2601:98b:300:2c90:bdd6:b1d4:67d5:76e2] entered the room. 6:55 manheim left the room (quit: Ping timeout: 268 seconds). sdake 6:57 sbezverk_ cleanup waits on keystone 6:57 is this a keystone service: http://logs.openstack.org/80/422380/1/check/gate-kolla-kubernetes-deploy-centos-binary-2-ceph-nv/7023dc3/console.html#_2017-05-27_21_02_22_396152 6:57 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 6:59 Pavo [~brockback@75.76.204.44] entered the room. 7:10 emccormick left the room (quit: Read error: Connection reset by peer). openstackgerrit 7:10 Steven Dake proposed openstack/kolla-kubernetes master: Test removal of selenium from ceph gates https://review.openstack.org/468700 7:10 emccormick [~emcco@2601:98b:300:2c90:bdd6:b1d4:67d5:76e2] entered the room. 7:14 emccormick left the room (quit: Read error: Connection reset by peer). sdake 7:14 sbezverk_ clarkb said the images are rebiult daily from latest upstream 7:14 sbezverk_ but he isn't sure when new kernels come in - its whenever upstream releases a new kernel 7:14 the kernel and syscall interface has all kinds of interactions between different versions 7:15 although red hat is pretty strict about not modifying the syscall ABI 7:15 and by pretyt, I mean super :) 7:20 emccormick [~emcco@2601:98b:300:2c90:bdd6:b1d4:67d5:76e2] entered the room. 7:26 manheim [~manheim@92.87.237.3] entered the room. 7:31 manheim left the room (quit: Ping timeout: 245 seconds). openstackgerrit 7:31 Steven Dake proposed openstack/kolla-kubernetes master: Add a destroy workflow for kolla-kubernetes https://review.openstack.org/464031 7:32 hrw left the room (quit: Ping timeout: 268 seconds). 7:34 hrw [~hrw@redhat/hrw] entered the room. 7:35 manheim [~manheim@92.87.237.3] entered the room. 7:39 yingjun [~yingjun@220.168.77.234] entered the room. 7:39 yingjun left the room (quit: Client Quit). 7:40 manheim left the room (quit: Ping timeout: 246 seconds). openstackgerrit 7:46 Steven Dake proposed openstack/kolla-kubernetes master: Test of more gate output https://review.openstack.org/468701 7:49 manheim [~manheim@92.87.237.3] entered the room. kbaegis 7:53 Anyone running into this? https://hastebin.com/womunobomi.sql 7:54 manheim left the room (quit: Ping timeout: 245 seconds). 7:54 glycerine left the room (quit: Ping timeout: 268 seconds). 8:02 You have disconnected 9:02 You have connected 9:02 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 9:02 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 9:07 manheim left the room (quit: Ping timeout: 260 seconds). 9:16 manheim [~manheim@92.87.237.3] entered the room. 9:20 manheim left the room (quit: Ping timeout: 240 seconds). 9:30 manheim [~manheim@92.87.237.3] entered the room. 9:31 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 9:34 manheim left the room (quit: Ping timeout: 240 seconds). 9:36 You have disconnected 9:36 You have connected 9:36 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 9:36 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 9:40 You have disconnected 9:42 You have connected 9:42 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 9:42 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 9:45 emccormick left the room (quit: Ping timeout: 260 seconds). 9:48 manheim [~manheim@92.87.237.3] entered the room. 9:51 You have disconnected 9:51 You have connected 9:51 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 9:51 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 9:52 manheim left the room (quit: Ping timeout: 268 seconds). 10:06 manheim [~manheim@92.87.237.3] entered the room. 10:11 manheim left the room (quit: Ping timeout: 260 seconds). 10:24 manheim [~manheim@92.87.237.3] entered the room. 10:28 You have disconnected 8:14 Sunday, May 28, 2017 8:14 You have connected 8:14 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 8:14 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 8:17 Mannheim [~dan@79.113.87.37] entered the room. 8:17 Manheim left the room (quit: Read error: Connection reset by peer). 8:23 manheim [~manheim@79.113.87.37] entered the room. 8:24 emccormick left the room (quit: Remote host closed the connection). 8:24 emccormick [~emcco@2601:98b:300:2c90:349f:a147:3e18:6d80] entered the room. openstackgerrit 8:27 Serguei Bezverkhi proposed openstack/kolla-kubernetes master: cell0's should be deleted only when cell0 is enabled https://review.openstack.org/468720 8:27 manheim left the room (quit: Ping timeout: 245 seconds). sbezverk_ 8:28 kolla-k8s latest docker update broke come gate jobs, when I pin docker to the previous version, those jobs pass.. 8:28 s/come/some/ jamesPR 8:40 sbezverk_, kolla-k8s is kubernetes? kbaegis 8:41 Hey guys. Seem to be having some trouble with tgtd and the iscsi initiators. Anyone have experience with the LVM/iscsi setup? 8:41 Here's boot from vol: https://hastebin.com/womunobomi.sql, and attach volume on booted: https://hastebin.com/xeqoruhoqi.sql 8:42 Should we be setting iscsi_initiator_list in cinder.conf? 8:42 emccormick left the room (quit: Ping timeout: 246 seconds). sbezverk_ 8:43 jamesPR : yep sbezverk_ 8:43 kbaegis : what is up with iscsid/tgtd? 8:46 kbaegis : check cinder.conf make sure lvm section has all required values set sbezverk_ 8:46 it looks like it is missing at least ip address of the host acting as tgtd server 8:47 itlinux left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 8:54 jamesPR left the room (quit: Ping timeout: 240 seconds). 8:59 japestinho [uid215357@gateway/web/irccloud.com/x-aqvbeoqndjvuzwxi] entered the room. kbaegis 9:02 sbezverk_: Thanks, will do 9:02 I think it's set in there 9:02 but the fqdn isn't 9:04 Here's the backend that kolla configures for cinder.conf: https://hastebin.com/uragehegac.ini @sbezverk_ 9:04 So I can create volumes, but when I go to attach them to a nova instance it fails sbezverk_ 9:05 kbaegis : yep it is missing ip address for sure kbaegis 9:05 Pertinent error ostensibly being FailedISCSITargetPortalLogin: Could not login to any iSCSI portal 9:05 sbezverk_: Well we'll need to patch this :) sbezverk_ 9:05 at one point kolla-ansible folks decided to remove default config for cinder-volume-lvm 9:05 eaguilar [~eaguilar@186.22.108.116] entered the room. kbaegis 9:05 sbezverk_: Oh. I'd rather use ceph honestly, but I only have 2 nodes, so it'd be a waste sbezverk_ 9:06 so it has to be done with "custom" config or reconfiguration kbaegis 9:06 Sure. So I'll figure out where I need to set that 9:06 Is the IP declared in iscsi_initiator_list? 9:07 And will I set that in cinder.conf or nova.conf? sbezverk_ 9:07 kbaegis: all config shoulkd go into cender.conf 9:08 kbaegis you need to setup iscsi_ip_address kbaegis 9:10 sbezverk_: Confusing. So what do I set that to? The local node IP? sbezverk_ 9:10 kolla-k8s: https://review.openstack.org/468720 will restore the gates jobs kbaegis 9:10 sbezverk_: What if it's a group of multiple iscsi hosts? How do I reference them? sbezverk_ 9:11 kbaegis : ip of the host where you run tgtd sbezverk_ 9:11 you need to create separate section kbaegis 9:11 sbezverk_: Gotcha. Thanks. I can set that in the conf/ directory, but how should we patch that to pull it from the ansible scripts? sbezverk_ 9:11 for each host kbaegis 9:11 sbezverk_: That's awful 9:12 kludgy sbezverk_ 9:12 kbaegis you cannot, what you should do is to prepare custom cinder.conf before you install sbezverk_ 9:13 then installation will detect it and add merge it with generic cinder.conf kbaegis 9:13 sbezverk_: Sure. I get the custom config piece. I'm saying that this will break every deployment using lvm by default 9:13 And we have to use a kludge to fix 9:13 so for an AIO install, it would be /etc/kolla/conf/cinder/localhost/cinder.conf, correct? 9:14 otherwise it's the inventory name of the host in lieu of localhost? 9:14 Just verifying before I run reconfigure openstackgerrit 9:21 Serguei Bezverkhi proposed openstack/kolla-kubernetes master: cell0's should be deleted only when cell0 is enabled https://review.openstack.org/468720 kbaegis 9:22 Yeah, setting that in cinder-volume doesn't work sdake 9:24 sbezverk_ regresssion? 9:25 sbezverk morning btw 9:25 iniazi left the room (quit: Ping timeout: 240 seconds). sdake 9:25 oh pinning 9:26 emccormick [~emcco@2601:98b:300:2c90:349f:a147:3e18:6d80] entered the room. kbaegis 9:29 Morning sdake :) 9:30 emccormick left the room (quit: Ping timeout: 260 seconds). kbaegis 9:31 So it would be helpful if someone could explain which daemons are responsible for what here. If nova doesn't care about (and gets passed the iscsi target info from cinder), then the pertinent config is exclusively with cinder-volume, correct? 9:31 Should I need to touch iscsid or tgtd configs? 9:32 Am I misunderstanding anything there? 9:34 The only thing cinder-volume's logs see is the connection created and then immediately terminated. 9:42 iniazi [~iniazi@47.150.5.220] entered the room. kbaegis 9:42 Alright guys, here's the full config for cinder.conf: https://hastebin.com/jefocoloyu.ini 9:43 I've manually set all the available options for iscsi to the appropriate settings from the config guide 9:44 I can't seem to figure out how to read tgtd or iscsid logs, but they appear to see the attachment request 9:45 The only openstack service that appears to complain is nova-compute, which returns "FailedISCSITargetPortalLogin: Could not login to any iSCSI portal" and a traceback 9:48 which should match tgtd: tgtd -d 1 -f --iscsi portal=192.168.254.3:3260 10:09 itlinux [~textual@ip-64-134-238-186.public.wayport.net] entered the room. sdake 10:20 inc0 kfox1111 gates are blocked -can this be reviewed please: https://review.openstack.org/#/c/468720/9 10:32 salv-orlando [~salv_orla@151.75.72.192] entered the room. inc0 10:32 done sdake openstackgerrit 10:36 Merged openstack/kolla-kubernetes master: cell0's should be deleted only when cell0 is enabled https://review.openstack.org/468720 10:36 salv-orlando left the room (quit: Ping timeout: 240 seconds). 10:45 salv-orlando [~salv_orla@151.75.72.192] entered the room. 10:46 jamesPR [~James@24.41.224.164] entered the room. sdake 11:14 thanks inc0 11:15 You have disconnected 1:37 You have connected 1:37 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 1:37 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 1:43 Pavo [~brockback@75.76.204.44] entered the room. 1:43 jamesPR left the room (quit: Ping timeout: 255 seconds). 1:47 iniazi left the room (quit: Ping timeout: 245 seconds). 1:53 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 1:53 iniazi [~iniazi@47.150.5.220] entered the room. 1:56 Pavo [~brockback@75.76.204.44] entered the room. 2:07 manheim [~manheim@79.113.87.37] entered the room. 2:09 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 2:21 Mannheim left the room (quit: Quit: Leaving). 2:35 salv-orlando [~salv_orla@94.161.52.82] entered the room. openstackgerrit 2:51 Merged openstack/kolla-kubernetes master: Conditionalize pv creation https://review.openstack.org/468264 2:59 mgoddard left the room (quit: Ping timeout: 246 seconds). 3:43 salv-orlando left the room (quit: Remote host closed the connection). 4:14 manheim left the room (quit: Remote host closed the connection). 4:21 powerd [~powerd@79.97.29.167] entered the room. openstackgerrit 4:26 Merged openstack/kolla-kubernetes master: Make sure pathfinder can find passwords.yml in etc/kolla https://review.openstack.org/467276 4:38 jamesPR [~James@24.41.224.164] entered the room. 4:45 Pavo [~brockback@75.76.204.44] entered the room. 4:50 Mech422 left the room (quit: Quit: Konversation terminated!). 4:57 powerd left the room (quit: Ping timeout: 245 seconds). jamesPR 5:08 anyone? 5:08 :) 5:08 /usr/local/bin/kolla_extend_start: line 54: mysql_install_db: command not found 5:09 got this error 5:09 any ideas? 5:14 salv-orlando [~salv_orla@94.161.52.82] entered the room. 5:19 salv-orlando left the room (quit: Ping timeout: 245 seconds). 5:48 masuberu [~masber@129.94.15.152] entered the room. 5:55 manheim [~manheim@79.113.87.37] entered the room. 6:00 manheim left the room (quit: Ping timeout: 260 seconds). 6:02 masuberu left the room (quit: Read error: Connection reset by peer). 6:15 salv-orlando [~salv_orla@94.161.52.82] entered the room. 6:20 salv-orlando left the room (quit: Ping timeout: 260 seconds). 6:29 You have disconnected 8:45 You have connected 8:45 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 8:45 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 9:14 itlinux [~textual@184.48.86.81] entered the room. 9:25 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 9:44 janki [~janki@125.16.97.120] entered the room. 9:57 itlinux left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 9:58 Pavo [~brockback@75.76.204.44] entered the room. 10:01 itlinux [~textual@184.48.86.81] entered the room. 10:04 itlinux left the room (quit: Client Quit). openstackgerrit 10:09 Duong Ha-Quang proposed openstack/kolla-ansible master: Optimize reconfiguration for mariadb https://review.openstack.org/433480 10:10 emccormick left the room (quit: Remote host closed the connection). 10:10 emccormick [~emcco@2601:98b:300:2c90:3946:7fda:5493:7b0b] entered the room. 10:13 itlinux [~textual@184.48.86.81] entered the room. 10:17 itlinux left the room (quit: Client Quit). 10:23 itlinux [~textual@184.48.86.81] entered the room. 10:28 itlinux left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 10:29 salv-orlando [~salv_orla@5.87.111.216] entered the room. 10:29 emccormick left the room (quit: Ping timeout: 245 seconds). 10:37 jamesbenson [~jamesbens@185.20.99.141] entered the room. 10:45 jaosorior [~jaosorior@mobile-access-5d6a0f-215.dhcp.inet.fi] entered the room. 10:45 itlinux [~textual@184.48.86.81] entered the room. 10:46 Pavo left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 10:47 Pavo [~brockback@75.76.204.44] entered the room. 10:52 jamesbenson left the room (quit: Remote host closed the connection). 10:52 jamesbenson [~jamesbens@185.20.99.141] entered the room. 10:54 jamesbenson left the room (quit: Remote host closed the connection). 10:54 jamesbenson [~jamesbens@185.20.99.141] entered the room. 10:59 jamesbenson left the room (quit: Ping timeout: 245 seconds). 11:04 masber left the room (quit: Read error: Connection reset by peer). 11:04 masber [~masber@129.94.15.152] entered the room. 11:12 jamesbenson [~jamesbens@185.20.99.141] entered the room. 11:18 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 11:33 itlinux left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 11:55 skramaja [saravanan@nat/redhat/x-wuyzuitzexzypjqa] entered the room. 12:08 Monday, May 29, 2017 12:08 ahonda [~ahonda@p31007-ipngnfx01hodogaya.kanagawa.ocn.ne.jp] entered the room. 12:09 sbezverk_ left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 12:22 magicboiz [~magicboiz@alhproxy.alhsys.es] entered the room. 12:24 tvignaud_pto is now known as tvignaud 12:27 magicboiz left the room (quit: Ping timeout: 260 seconds). 12:27 magicboiz [~magicboiz@90.77.212.211] entered the room. 12:32 jamesbenson left the room (quit: Remote host closed the connection). 12:32 jamesbenson [~jamesbens@185.20.99.141] entered the room. 12:36 jamesbenson left the room (quit: Ping timeout: 240 seconds). 12:46 jamesbenson [~jamesbens@185.20.99.141] entered the room. 12:48 jamesbenson left the room (quit: Remote host closed the connection). 12:48 jamesbenson [~jamesbens@185.20.99.141] entered the room. 12:49 jamesbenson left the room (quit: Remote host closed the connection). 12:49 jamesbenson [~jamesbens@185.20.99.141] entered the room. 12:54 jamesbenson left the room (quit: Ping timeout: 240 seconds). 1:04 salv-orl_ [~salv_orla@94.163.118.88] entered the room. 1:07 magicboiz left the room (quit: Remote host closed the connection). 1:07 salv-orlando left the room (quit: Ping timeout: 246 seconds). 1:09 korzen [Artur@nat/intel/x-gfzsmncgcighfvcm] entered the room. 1:11 cristicalin [~cristical@109.166.154.150] entered the room. 1:15 chas [~chas@109.56.109.31.mobile.3.dk] entered the room. 1:21 cristicalin left the room (quit: Quit: Leaving...). 1:26 magicboiz [~magicboiz@alhproxy.alhsys.es] entered the room. 1:26 ahonda left the room (quit: Quit: Leaving...). 1:30 magicboiz left the room (quit: Remote host closed the connection). 1:36 dasTor_ left the room (quit: Quit: Leaving). 1:37 dasTor [~d@tripwire.cms.hu-berlin.de] entered the room. 1:38 magicboiz [~magicboiz@alhproxy.alhsys.es] entered the room. 1:38 magicboiz left the room (quit: Remote host closed the connection). 1:40 sgrasley left the room (quit: Ping timeout: 240 seconds). 1:40 sgrasley1 [~sgrasley@72-160-77-112.dyn.centurytel.net] entered the room. 1:43 egonzalez [egonzalez@nat/ibm/x-srpasjcokfksfxdx] entered the room. 1:44 matrohon [~matrohon@161.105.225.194] entered the room. 1:52 manheim [~manheim@89.46.161.178] entered the room. openstackgerrit 1:53 Merged openstack/kolla-ansible master: Add jinja2-py version check in pre_checks https://review.openstack.org/454590 2:02 tvignaud left the room (quit: Ping timeout: 240 seconds). openstackgerrit 2:10 Merged openstack/kolla-ansible master: Enabled pxe_ssh driver in ironic https://review.openstack.org/468606 2:15 tvignaud [~tvignaud@225.181.8.109.rev.sfr.net] entered the room. berendt 2:22 sdake: ping openstackgerrit 2:23 Christian Berendt proposed openstack/kolla-ansible master: Fix "key_repository is world readable: /etc/keystone/fernet-keys/" warning https://review.openstack.org/468452 2:25 Eduardo Gonzalez proposed openstack/kolla-ansible master: Move mDNS to network nodes https://review.openstack.org/468534 2:30 lpetrut [~Lucian@89.46.161.178] entered the room. 2:33 pbourke left the room (quit: Remote host closed the connection). 2:34 pbourke [~pbourke@141.143.213.51] entered the room. mandre 3:03 egonzalez: hi Eduardo, do we have a hard rule about 4 space indenting in Dockerfile? egonzalez 3:04 mandre, I dont think so, but is common jinja style 3:04 most dockefiles follows 4 space indents mandre 3:04 egonzalez: I mean if that's something we expect from new contributors, it should be documented somewhere 3:04 and potentially enforced in CI 3:08 magicboiz [~magicboiz@alhproxy.alhsys.es] entered the room. mandre 3:08 I'm personally for not nitpicking on the formatting, but if you guys think it's better for consistency for instance, it should be done by a computer IMO 3:08 bjolo [~bjolo@sessfw99-sesbfw99-84.ericsson.net] entered the room. 3:12 magicboiz left the room (quit: Ping timeout: 246 seconds). 3:13 magicboiz [~magicboiz@90.77.212.211] entered the room. bjolo 3:25 morning hrw 3:27 morning openstackgerrit 3:29 Duong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only necessary tasks (default roles) https://review.openstack.org/398684 openstackgerrit 3:39 Merged openstack/kolla master: Add short README file for contrib/template-override directory https://review.openstack.org/422552 openstackgerrit 4:17 Merged openstack/kolla-ansible master: Change default permissions in jinja templates. https://review.openstack.org/445797 4:22 cuongnv left the room (quit: Quit: Leaving). 4:24 tovin07_ left the room (quit: Quit: Leaving). openstackgerrit 4:24 Eduardo Gonzalez proposed openstack/kolla-ansible master: Remove deprecated options designate https://review.openstack.org/450715 openstackgerrit 4:36 Eduardo Gonzalez proposed openstack/kolla-ansible master: Remove deprecated options designate https://review.openstack.org/450715 hrw 4:37 egonzalez: can you +2 https://review.openstack.org/#/c/467568/ one? it makes dragonflow buildable for debian/source combo 4:38 https://review.openstack.org/#/c/468348/ (fix gnocchi for centos/source non-x86 combo) and https://review.openstack.org/#/c/464045/ (let build kubernetes stuff also for aarch64) are also easy pickups egonzalez 4:38 hrw, why using developer files instead of main? hrw 4:45 egonzalez: my golden rule is to not depend on library packages. 4:45 I consider it a bad practise 4:46 bmaltais left the room (quit: Quit: Page closed). hrw 4:47 but doing check with libzmq5 now 4:48 MarginHu [~Margin@45.62.103.220.16clouds.com] entered the room. 4:51 jamesPR [~James@24.41.224.164] entered the room. Seyong 4:58 Hello guys, I created an instance and gave a float ip address to it, I can log in via SSH from compute node to the instance. However in the instance, I can not access internet(external network). Anyone have any idea on this? jamesPR 4:59 Seyong, can you ping an external ip from instance? 4:59 for example ping 8.8.8.8 manheim 5:05 i have a docker question, which is the best way to run commands in a container after it's creation? i used docker exec from outside the container, but what if i want to automate it in a more elegent way 5:05 CMD from the dockerdile? egonzalez 5:05 MarginHu, around? Seyong 5:06 jamesPR: ping does not pong any of external ip address. jamesPR 5:06 sup egonzalez egonzalez 5:06 hey jamesPR Seyong 5:06 jamesPR: ping reached to compute host ip addr only jamesPR 5:08 Seyong, maybe a routing issue 5:08 can you ping the gateway from instance? Seyong 5:09 jamesPR: hmm I have one NIC, then should network_interface and neutron_external_interface are the NIC what I have? is it correct..? 5:09 ping doent work to gw also 5:09 both configuration is of /etc/kolla/global.yml egonzalez 5:10 Seyong, nope, unless you create sub interfaces neutron_external_interface cannot be network_interface 5:10 actually now you should not be able to ping outside from the host itself Seyong 5:11 egonzalez: from host(compute) not an instance? from host I can access outside as well.. egonzalez 5:12 hrm, weird, usually networking is lost while applying ovs role when using single interface jamesPR 5:12 egonzalez, recently I update all my images then now mariadb give an error when Running MariaDB bootstrap 5:12 jtriley left the room (quit: Ping timeout: 240 seconds). egonzalez 5:12 jamesPR, how recently? jamesPR 5:12 yesterday egonzalez 5:12 which vesion? 5:13 circ-user-TeTGj [~circuser-@cpe-173-95-163-123.nc.res.rr.com] entered the room. Seyong 5:13 egonzalez: well, I tried add my nic to br-ex bridge then host can not access external.... is it your saying..? jamesPR 5:13 latest from git egonzalez 5:14 jamesPR, let me try with centos source 5:14 Seyong, yep, that's what happen while applying ovs role because the interface is added into br-ex MarginHu 5:20 hi, is it necessary that br-ex is existed in compute node ? sdake 5:27 eglute this needs work: https://review.openstack.org/#/c/468632/ 5:27 egonzalez ^^ manheim 5:33 egonzalez did you see my question/ egonzalez 5:34 sdake, what question? 5:35 MarginHu, nope, br-ex should not exists on compute nodes unless dvr is enabled, was fixed upstream and backported to ocata MarginHu 5:36 do you know which commit id ? egonzalez 5:37 MarginHu, sorry, is not merged on ocata https://review.openstack.org/#/c/465865/ MarginHu 5:38 thank you very much. egonzalez 5:40 MarginHu, regarding the memcached reconfigure bug, it worked for me, what ansible and kolla version are you using? 5:40 salv-orl_ left the room (quit: Remote host closed the connection). MarginHu 5:41 ansible 2.3.0.0, kolla 4.0.0.1 5:42 what ansible version are you using? egonzalez 5:43 2.3 too 5:44 can you check the contents of ansible/roles/memcached/tasks/reconfigure.yml ? 5:44 is a symbolic link to depoy.yml MarginHu 5:44 no , it's content is one line: deploy.yml , not a symbolic link egonzalez 5:45 ok, thats fine 5:45 jamesPR, mariadb bootstrap wfm 5:46 built 2 hours ago MarginHu 5:46 my kolla version is older than latest kolla upstream sdake 5:48 egonzalez stable/ocat is broken 5:48 egonzalez the soltuion is to fix that review above 5:48 egonzalez that review above works for me on kolla-kubernetes, but not kolla-ansible 5:48 egonzalez any chance you can take al ook? egonzalez 5:49 sdake, ooo, we fixed it pining version to 10.0.30 instead of 10.0 until mariadb packages are fixed (mariadb missed build galera packages) sdake 5:49 that is the wrong solution egonzalez 5:50 but, yes. we talked about removing mariadb repos and use rdo 5:52 chandankumar is now known as chkumar|hackersp MarginHu 5:54 egonzalez, I test my ansible think that is syntax error 5:57 I remember old version is symblic 5:57 bmaltais [4344e925@gateway/web/freenode/ip.67.68.233.37] entered the room. jamesPR 5:58 egonzalez, how can I fix the mariadb issue? sdake 6:05 egonzalez mariadb didn't miss building galera packages 6:05 janki left the room (quit: Ping timeout: 240 seconds). sdake 6:05 egonzalez they are in the repository under a different name 6:06 egonzalez anyway imo we need to eject mariadb.org as a repo dep and just use rdo 6:06 egonzalez any chance you can take on that activity? egonzalez 6:06 sdake, galera packages were merged into mariadb-server in mariadb 10.1, in 10.0 remain being different packages 6:06 10.0.30 have the package but with the release of 10.0.31 missed jamesPR 6:09 There are no longer separate MariaDB Galera Cluster releases for MariaDB 10.1 and above. Simply download MariaDB (10.1 or above) and configure your cluster as normal. sdake 6:10 rdo uses maridb 10.1 6:10 and it has a mariadb-server-galera pacakkge 6:10 no idea what is in it 6:10 sbezverk [sbezverk@nat/cisco/x-wohyrdtqjrcfyfxt] entered the room. sdake 6:10 maradb 10.1 from mariadb.org ALSO HAS a mariadb-server-galera package 6:11 egonzalez what I want to know is if you will tkae over that review i started 6:11 or not egonzalez 6:12 sdake, im looking into it, but im not a mariadb expert bmaltais 6:12 egonzalez: Morning. Do you run your openstack environment with LDAP Domain integration? sdake 6:12 https://review.openstack.org/#/c/468632/ bmaltais 6:13 egonzalez: I am not sure what is going on but I think there might be an issue with ldap domain integration with the current 4.0.0 kolla-ansible builds 6:14 egonzalez: I can configure ldap domain, list ldap users using "openstack user list --domain ducourrier" 6:14 egonzalez: Validate that keystone is indeed validating credentials of users in ldap 6:15 egonzalez: But when I login with one of them I keep getting "An error occurred authenticating. Please try again later." sdake 6:15 egonzalez the fact that stable/ocata is unbuildable is a critical issue - need some help in resolving it bmaltais 6:18 egonzalez:: And I see a bunch of errors in keystone logs: "ERROR keystone.common.wsgi result = method(req, **params)" 6:18 Anyone that successfully run LDAP Domain authentication with kolla-ansible in the channel? 6:20 salv-orlando [~salv_orla@94.163.118.88] entered the room. 6:20 pcaruana [~pcaruana@ip-94-112-189-30.net.upcbroadband.cz] entered the room. sdake 6:20 jamesPR is percona integrated into mariadb10..1? 6:35 caoyuan [~caoyuan@112.2.4.133] entered the room. jamesPR 6:39 sdake, ? I think that percona is like another fork of mysql ;) sdake 6:43 jamesPR we use xtrabackup - for whatever godawful reason 6:52 janki [~janki@202.189.238.75] entered the room. 6:54 janki left the room (quit: Remote host closed the connection). 6:57 skramaja left the room (quit: Quit: Konversation terminated!). 6:58 goldyfruit [~gtrellu@199.91.185.156] entered the room. openstackgerrit 7:01 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 7:03 Mathieu Rohon proposed openstack/kolla master: Add skydive service https://review.openstack.org/459995 7:04 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 7:04 salv-orl_ [~salv_orla@5.87.59.138] entered the room. 7:07 salv-orlando left the room (quit: Ping timeout: 240 seconds). 7:08 jtriley left the room (quit: Ping timeout: 240 seconds). 7:09 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 7:14 jtriley left the room (quit: Ping timeout: 260 seconds). 7:17 Pavo [~brockback@75.76.204.44] entered the room. 7:35 manheim left the room (quit: Remote host closed the connection). 7:36 jamesPR left the room (quit: Ping timeout: 240 seconds). 8:03 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 8:04 MarginHu left the room (quit: Remote host closed the connection). openstackgerrit 8:07 Mathieu Rohon proposed openstack/kolla master: Add skydive service https://review.openstack.org/459995 8:08 jtriley left the room (quit: Ping timeout: 255 seconds). 8:08 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. kbaegis 8:11 Morning all! Still troubleshooting cinder/iscsi configs: https://hastebin.com/womunobomi.sql, https://hastebin.com/xeqoruhoqi.sql 8:12 jgriffith_ [~jgriffith@ec2-54-146-182-136.compute-1.amazonaws.com] entered the room. 8:14 jtriley left the room (quit: Ping timeout: 260 seconds). 8:14 magicboiz left the room (quit: Quit: Leaving). kbaegis 8:14 Here's my custom config; reconfiguring now https://hastebin.com/mikaweheso.makefile 8:16 Going to replicate my configuration inside an instance with gentoo installed- requirement for the gentoo deployment guide to make sure it all works 8:20 caoyuan_ [~caoyuan@112.2.4.133] entered the room. 8:20 caoyuan left the room (quit: Read error: Connection reset by peer). bmaltais 8:20 I think the LDAP Domain authentication issue is linked to this bug: https://bugs.launchpad.net/keystone/+bug/1662762 openstack 8:20 Launchpad bug 1662762 in OpenStack Identity (keystone) ocata "Authentication for LDAP user fails at MFA rule check" [High,Fix released] - Assigned to Matthew Edmonds (edmondsw) kbaegis 8:21 Anyone with experience with cinder/lvm/iscsi and kolla that can help would be greatly appreciated 8:24 zhubingbing [~zhubingbi@180.110.60.108] entered the room. zhubingbing 8:24 hi guys bmaltais 8:25 kbaegis: Sorry. Would help if I could but not much experience with that. kbaegis 8:26 bmaltais: Thanks anyways :) bmaltais 8:29 Is there a way to "login" to the keystone container to make manual changes to a file inside? 8:29 Tried "docker exec keystone bash" and I only get dead air 8:30 I want to apply a manual patch to it to make LDAP domain authentication work as the current 4.0.0 container has a bug pomac 8:32 docker exec -it keystone bash 8:32 jgriffith_ is now known as jgriffith pomac 8:32 bmaltais: but depending on the file you want to change, /etc/kolla/ might be where you want to look bmaltais 8:34 pomac: I did it with "docker cp t keystone:/usr/lib/python2.7/site-packages/keystone/identity/backends/ldap/core.py" hrw 8:35 egonzalez: with libzmq5 it builds too. which looks weird for me bmaltais 8:35 And I have proven that my LDAP Domain authentication issue was a bug in keystone 4.0.0 container all along! 8:35 Arrrrggggg openstackgerrit 8:35 zhubingbing proposed openstack/kolla master: Fix rally create verifier error https://review.openstack.org/467837 bmaltais 8:35 Spent 2 days debugging my config file when it was fine all along ;-) 8:36 manheim [~manheim@86.126.81.128] entered the room. 8:37 hongbin [~hongbin@206.16.17.148] entered the room. 8:41 faridda [~farid@199.91.185.156] entered the room. 8:43 eaguilar [~eaguilar@190.2.28.97] entered the room. kbaegis 8:44 Figured it out everyone! Another kernel dependency for CONFIG_ISCSI_TCP 8:45 All the stuff upstream ubuntu takes care of for you when they're not breaking stuff with systemd ;) 8:54 salv-orl_ left the room (quit: Remote host closed the connection). manheim 8:55 for linux, ansible_default_ipv4 will always take the IP of the interface I am connecting from? 8:55 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 8:55 salv-orlando [~salv_orla@5.87.59.138] entered the room. manheim 8:56 e.g. if I have multiple networks, and I want the IP of the interface which is in the subnet i run facts gather from 8:59 salv-orlando left the room (quit: Ping timeout: 255 seconds). 9:01 eaguilar [~eaguilar@190.2.28.97] entered the room. 9:03 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 9:07 jtriley left the room (quit: Ping timeout: 240 seconds). hrw 9:08 egonzalez: now I know why. 9:08 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. hrw 9:08 dragonflow is just broken on ALL distros 9:09 in funny way 9:13 jtriley left the room (quit: Ping timeout: 260 seconds). 9:14 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 9:15 manheim left the room (quit: Remote host closed the connection). 9:15 manheim [~manheim@86.126.81.128] entered the room. 9:16 salv-orlando [~salv_orla@5.87.59.138] entered the room. 9:16 jamesPR [~James@24.41.224.164] entered the room. hrw 9:18 ~curse developers openstackgerrit 9:18 Marcin Juszkiewicz proposed openstack/kolla master: dragonflow: install proper package on all distros https://review.openstack.org/467568 9:19 manheim left the room (quit: Ping timeout: 240 seconds). 9:19 You have disconnected 9:49 You have connected 9:49 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 9:49 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 9:50 lpetrut left the room (quit: Read error: Connection reset by peer). hrw 9:51 sdake: thx 9:57 Pavo [~brockback@75.76.204.44] entered the room. 10:01 pester left the room (quit: Quit: KVIrc 4.2.0 Equilibrium http://www.kvirc.net/). 10:02 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. dmsimard 10:06 I'm trying to understand what the skip_parents parameter does 10:06 It will make it so kolla-build will build missing parents if they don't exist but only build the children layers if the base layers are there ? 10:07 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). 10:07 jtriley left the room (quit: Ping timeout: 240 seconds). dmsimard 10:07 say I build centos-binary-nova-base -- it will not build centos-binary-base, centos-binary-openstack-base and then centos-binary-nova-base if they exist. Correct ? 10:07 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. dmsimard 10:08 er, take two: say I build centos-binary-nova-base -- it will not build centos-binary-base, centos-binary-openstack-base if they exist. Correct ? egonzalez 10:08 dmsimard, yep dmsimard 10:08 egonzalez: ok, thanks hrw 10:09 dmsimard: iirc, it will not try to build them at all. even if they not exist dmsimard 10:09 hrw: ah, see, that's what I was afraid of 10:09 hrw: I guess I need to try to find out hrw 10:09 but I can go wrong - too many rebuilds recently 10:10 most of my builds rebuild base as well ;( openstackgerrit 10:11 Mathieu Rohon proposed openstack/kolla-ansible master: Add skydive service https://review.openstack.org/460922 10:12 jtriley left the room (quit: Ping timeout: 245 seconds). hrw 10:14 dmsimard: ERROR:kolla.image.build.dragonflow-base:Error: image test2/ubuntu-source-openstack-base:4.0.0 not found egonzalez 10:14 dmsimard, just tested and not build the image if missing http://paste.openstack.org/show/610897/ hrw 10:14 dmsimard: so for --skip-parents you need to be sure that you have those parent images available dmsimard 10:15 damn... 10:15 that's not convenient 10:16 Basically I'm building each end image separately to have great granularity to properly profile/troubleshoot if need be hrw 10:16 dmsimard: I do './build-images.sh DISTRONAME BUILDTYPE' and wait few hours to have all images built dmsimard 10:17 hrw: that's not super convenient :) hrw 10:17 https://paste.fedoraproject.org/paste/GXzi5ihMOFGes~R7qYO2TF5M1UNdIGYhyRLivL9gydE=/ is my script 10:17 pcaruana left the room (quit: Ping timeout: 240 seconds). dmsimard 10:17 mandre: ^ skip_parents doesn't build the parents if they're not built, do you think we can do something ? hrw 10:17 dmsimard: if your work is making sure that images can be built it is handy dmsimard 10:17 hrw: it's for consumption 10:21 egonzalez left the room (quit: Quit: Leaving). 10:21 mgoddard left the room (quit: Ping timeout: 245 seconds). hrw 10:22 sdake: can you help me fix gnocchi centos/source? https://review.openstack.org/#/c/468348/ just needs +2+W ;d sdake 10:23 hrw i cannot merge that patch with the current state of the gate there hrw 10:23 ok 10:24 recheck sent 10:27 off for today 10:30 mgoddard [~mgoddard@46.80.147.147.dyn.plus.net] entered the room. 10:32 matrohon left the room (quit: Ping timeout: 240 seconds). mandre 10:35 dmsimard: what a bummer :) what you need really is a --skip-existing flag but I don't know how easy that would be to implement dmsimard 10:35 mandre: dang, you got my hopes up 10:35 but yeah --skip-existing makes sense 10:36 as in that's the desired behavior mandre 10:36 dmsimard: or you can try to play with the dependency tree and selectively build the new images you need with --skip-parent 10:40 Serlex [~asercan@141.143.213.41] entered the room. dmsimard 10:41 mandre: rather avoid doing that :p 10:42 mandre: so should I file a RFE in kolla launchpad or something ? mandre 10:44 dmsimard: yes please! 10:45 pcaruana [~pcaruana@ip-94-112-189-30.net.upcbroadband.cz] entered the room. mandre 10:46 looks like a fun task to work on, someone will likely pick it up, if not me sdake 10:48 hey mandre 10:48 long time no talk dude 10:48 whats up 10:50 manheim [~manheim@79.113.87.37] entered the room. dmsimard 10:50 mandre: https://bugs.launchpad.net/kolla/+bug/1694302 openstack 10:50 Launchpad bug 1694302 in kolla "RFE: Skip building images that have already been built" [Undecided,New] bmaltais 10:50 Hi, I have to proposed changes stuck at +1... Could someone help push them along? https://review.openstack.org/#/c/466881/ & https://review.openstack.org/#/c/467695/ 10:51 Or let me know if I should just abandon them sdake 10:51 bmaltais looking 10:52 bmaltais lots o doc chagnes 10:52 bmaltais reason its moving slowly bmaltais 10:52 OK sdake 10:52 mandre can you stamp https://review.openstack.org/#/c/467695/4 10:52 bmaltais that first change will require several hours to review bmaltais 10:54 sdake: I se. For sure, going through the exercise of building a test environment to validate time does indeed take time. 10:54 manheim left the room (quit: Ping timeout: 240 seconds). bmaltais 10:55 sdake: I am trying to add documentation to help others. I also want to add a section to get LDAP Domain authentication working against a MS AD backend. 10:56 sdake: All working now and I think it could help other users of kolla-ansible 11:02 lucasxu [~lucas@dhcp-wifi-8021x-168-122-205-226.bu.edu] entered the room. 11:02 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 11:02 lucasxu left the room (quit: Remote host closed the connection). kbaegis 11:05 Anyone else seeing this bug on stable/ocata? Didn't make the cut for the release by the looks: https://bugs.launchpad.net/neutron/+bug/1629484 openstackgerrit 11:05 Merged openstack/kolla master: dragonflow: install proper package on all distros https://review.openstack.org/467568 openstack 11:05 Launchpad bug 1629484 in neutron "Key error when try to assign a floating ip to a VM" [High,Fix released] - Assigned to Hao Chen (chenh1987) 11:06 jtriley left the room (quit: Ping timeout: 240 seconds). 11:07 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 11:12 jtriley left the room (quit: Ping timeout: 255 seconds). kbaegis 11:15 Sad :'( Have to disable designate because of that bug 11:16 Or a regression identical to it 11:18 salv-orlando left the room (quit: Remote host closed the connection). 11:21 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 11:24 jamesPR left the room (quit: Ping timeout: 246 seconds). 11:32 jamesPR [~james@24.41.224.164] entered the room. 11:32 Pavo [~brockback@75.76.204.44] entered the room. 11:37 eaguilar [~eaguilar@190.2.28.97] entered the room. 11:50 Manheim [~dan@79.113.87.37] entered the room. 11:53 fguillot [~fguillot@2607:f748:9:1678:d479:2ec8:5f9d:42ce] entered the room. 11:56 Manheim left the room (quit: Quit: Leaving). 11:56 Manheim [~dan@79.113.87.37] entered the room. 12:01 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 12:04 egonzalez [~egonzalez@89.101.73.88] entered the room. egonzalez 12:06 kbaegis how designate was deployed, followed post deployment steps to integrate with nova/neutron? https://github.com/openstack/kolla-ansible/blob/master/doc/designate-guide.rst#neutron-and-nova-integration egonzalez 12:06 designate is weird role, because need IDs in its config generated by designate itself:/ 12:06 jtriley left the room (quit: Ping timeout: 260 seconds). 12:06 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. kbaegis 12:10 egonzalez: Hey, I didn't see that! Thanks :) egonzalez 12:10 kbaegis probably thats why neutron is failing to allocate the floatingip kbaegis 12:10 Writing a step-by-step guide for the gentoo install w/ kolla 12:10 egonzalez: I needed the floatingip, but I don't need dns yet 12:11 Thanks for showing me the docs. 12:11 jtriley left the room (quit: Ping timeout: 240 seconds). Manheim 12:17 i have an issue if I run deploy on an existing env 12:18 "Access denied for user 'root'@'192.168.10.11' (using password: YES)\")"} 12:18 i enabled a role in globals, thus the second deploy 12:18 but i keep seeing this issue for mariadb 12:22 eaguilar left the room (quit: Quit: My MacBook has gone to sleep. ZZZzzz…). sdake 12:44 egonzalez i htink i have found the problem with mariadb 12:45 egonzalez ansibull looks for /usr/lib/galera.so while in fact it is now in /usr/lib64/galera.so 12:45 eaguilar [~eaguilar@190.2.28.97] entered the room. egonzalez 12:46 sdake cool, galera only or libgalera_smm.so? sdake 12:46 ya libgalera_smm.so 12:46 i was just being lazy egonzalez 12:47 is looking at the correct place https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/templates/galera.cnf.j2#L1 12:48 there is a check depending on the distro sdake 12:48 your correct i read that code wrong 12:48 groans 12:48 the good news is xtrabackup is integrated in 10.1 12:48 so we can eject percona onc ewe figure this crap out egonzalez 12:49 cool, also percona-xtrabackup package is in epel sdake 12:49 i wonder if htis OOMs the system: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/mariadb/templates/galera.cnf.j2#L45 12:49 we should remove epel too egonzalez 12:50 for mariadb 10.1 wsrep_on must be set to ON, was active by default before 10.1 but now is disabled sdake 12:51 egonzalez this consitently occurs: https://da.gd/kxW7 -> https://paste.fedoraproject.org/paste/xi5XeYO83-As8bg11XgkCl5M1UNdIGYhyRLivL9gydE=/ 12:51 requiring a reboot 12:52 any ideas how to avoid the reboot? egonzalez 12:53 bjolo have a similar issue in their env with libvirt, what docker storage driver, docker version and kernel are you using? sdake 12:58 rhel docker 12:58 latest centos kernel 12:58 rhel/centos docker 12:58 btrfs storage driver 12:58 mgoddard left the room (quit: Ping timeout: 272 seconds). sdake 12:59 wsrep_on is a new config option that you suggest setting? 12:59 chas left the room (quit: Remote host closed the connection). 12:59 chas [~chas@109.56.109.31.mobile.3.dk] entered the room. 1:01 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 1:04 chas left the room (quit: Ping timeout: 246 seconds). 1:05 eaguilar left the room (quit: Ping timeout: 240 seconds). 1:05 jtriley left the room (quit: Ping timeout: 240 seconds). sdake 1:06 this reboot every time is annoying :( 1:06 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. sdake 1:07 i don't understand how my system could possibly oom - i have 128gb ram 1:07 kolal uses 4gb 1:08 eaguilar [~eaguilar@190.2.28.97] entered the room. egonzalez 1:08 sdake here suggests to use docker community version instead of rhel to fix a similar issue https://bugs.launchpad.net/kolla/+bug/1668059/comments/8 openstack 1:08 Launchpad bug 1668059 in kolla "Failed to Starting kolla-toolbox container" [Critical,Triaged] 1:11 jtriley left the room (quit: Ping timeout: 245 seconds). sdake 1:14 setting wrap_on=on does nothing special egonzalez 1:15 bjolo_ [~bjolo@2.69.125.13.mobile.tre.se] entered the room. 1:15 bjolo left the room (quit: Read error: Connection reset by peer). openstackgerrit 1:15 Steven Dake proposed openstack/kolla master: Consume centos-pike-testing mariadb version https://review.openstack.org/468632 1:17 bjolo [~bjolo@sessfw99-sesbfw99-84.ericsson.net] entered the room. 1:19 manheim_ [~manheim@79.113.87.37] entered the room. 1:19 bjolo_ left the room (quit: Ping timeout: 245 seconds). 1:29 jaosorior is now known as jaosorior_away 1:41 eaguilar_ [~eaguilar@190.2.28.97] entered the room. 1:42 eaguilar left the room (quit: Ping timeout: 240 seconds). 1:48 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). 1:53 bmaltais left the room (quit: Ping timeout: 260 seconds). 2:00 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. kbaegis 2:03 Anyone know why rsync would be getting blocked? 2:03 I don't need to create a custom protocol security group do I? 2:05 jtriley left the room (quit: Ping timeout: 240 seconds). 2:05 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 2:07 manheim_ left the room (quit: Remote host closed the connection). 2:10 jtriley left the room (quit: Ping timeout: 240 seconds). 2:13 salv-orlando [~salv_orla@94.161.16.101] entered the room. Manheim 2:20 egonzalez you on? kbaegis 2:21 Anyone have a vm able to ping, but not to retrieve websites? 2:22 https://hastebin.com/apipoqujed.sql 2:23 capture from a compute node 2:23 on eth1 which is my networking interface 2:24 pcaruana left the room (quit: Ping timeout: 260 seconds). kbaegis 2:25 I'm betting this is DVR/SNAT related sdake 2:26 egonzalez check this out: 2:26 https://da.gd/6FHtA -> https://paste.fedoraproject.org/paste/IqhlsiTe71ZcMcn7cKLEfF5M1UNdIGYhyRLivL9gydE=/ 2:26 i turned on set -ex in extend_start.sh 2:26 I suspect but can't confirm extend_start.sh is exiting in some way egonzalez 2:31 kbaegis ping to domain or curl? kbaegis 2:32 egonzalez: ping works. Curl hangs egonzalez 2:32 hrm, maybe mtu? kbaegis 2:32 Just swapped the router out with a centralized one sdake 2:33 here is my extend_start output: https://da.gd/2uXL0 -> https://paste.fedoraproject.org/paste/JFSA-AYjE8iEC-h2~0cnCV5M1UNdIGYhyRLivL9gydE=/ kbaegis 2:34 egonzalez: Worked. I think it's double-nat or something. My compute nodes aren't accessible from my edge; they're in their own DMZ 2:34 Don't know why specifically, but dvr ports have never worked for me for snat 2:38 Serlex left the room (quit: Remote host closed the connection). 2:40 jamesPR left the room (quit: Quit: Leaving). sdake 2:44 egonzalez something is busted with extend_start.sh: https://da.gd/VMw9H -> https://paste.fedoraproject.org/paste/DtYwJZVHwn8-IYdSmK1a7F5M1UNdIGYhyRLivL9gydE=/ 2:45 egonzalez if that were working - it would instead finish and secure mysql 2:45 fguillot left the room (quit: Quit: My MacBook Air has gone to sleep. ZZZzzz…). 3:00 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 3:00 chas [~chas@109.56.109.31.mobile.3.dk] entered the room. openstackgerrit 3:02 Merged openstack/kolla-ansible master: Add a complete example of configuring a basic 3 nodes Ceph environment. https://review.openstack.org/467695 3:03 faridda left the room (quit: Read error: Connection reset by peer). sdake 3:04 egonzalez if I delete this: https://github.com/openstack/kolla/blob/master/docker/mariadb/extend_start.sh#L19-L33 - mariadb seems to bootstrap 3:05 chas left the room (quit: Ping timeout: 260 seconds). 3:08 eaguilar_ left the room (quit: Ping timeout: 240 seconds). 3:10 jtriley left the room (quit: Ping timeout: 260 seconds). 3:31 Manheim left the room (quit: Quit: Leaving). 3:31 goldyfruit left the room (quit: Ping timeout: 240 seconds). 3:33 circ-user-TeTGj left the room (quit: Ping timeout: 246 seconds). 3:38 manheim [~manheim@79.113.87.37] entered the room. sdake 3:43 from the grep man page 3:43 EXIT STATUS 3:43 Normally, the exit status is 0 if selected lines are found and 1 otherwise. 3:44 exit status of 1 will automatically trigger bash to exit 3:58 n0isyn0i1e [~pi@ARennes-156-1-3-42.w2-14.abo.wanadoo.fr] entered the room. 3:59 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 4:02 n0isyn0ise left the room (quit: Ping timeout: 258 seconds). 4:04 jtriley left the room (quit: Ping timeout: 246 seconds). 4:04 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. sdake 4:05 Jeffrey4l when your about would like to speak about commits 4417ffbfab77efd67eafe0d5ed57263c6a1b796c and ae8df40b - they are mutually incompatible imo 4:09 jtriley left the room (quit: Ping timeout: 246 seconds). 4:12 salv-orlando left the room (quit: Remote host closed the connection). openstackgerrit 4:15 Andy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends https://review.openstack.org/468966 4:24 jamesPR [~James@209.91.218.49] entered the room. 4:47 manheim left the room (quit: Remote host closed the connection). 4:48 powerd [~powerd@79.97.29.167] entered the room. 4:54 egonzalez left the room (quit: Quit: Leaving...). 4:59 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 5:01 chas [~chas@109.56.109.31.mobile.3.dk] entered the room. 5:03 jtriley left the room (quit: Ping timeout: 240 seconds). 5:04 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 5:06 chas left the room (quit: Ping timeout: 255 seconds). 5:09 jtriley left the room (quit: Ping timeout: 245 seconds). 5:24 bmaltais [4344e925@gateway/web/freenode/ip.67.68.233.37] entered the room. bmaltais 5:24 Hi, I am trying to specify different interfaces name for some physical servers 5:25 My globals.yml file specify ens160 and ens192... but those physical servers use enp4s0f0 & enp4s0f1 5:26 I tried using the inventory file to specify the right interface name for those nodes but it does not appear to work 5:27 TASK [common : Copying over fluentd input config files] keep failing with 5:27 failed: [compute1] (item=01-syslog) => {"failed": true, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: {{ hostvars[inventory_hostname]['ansible_' + api_interface]['ipv4']['address'] if orchestration_engine == 'ANSIBLE' else '0.0.0.0' }}: 'dict object' has no attribute u'ansible_ens160'"} failed: [compute2] (item=01-syslog) => {"failed": true, "item": "01-syslog", "msg": "AnsibleUndefinedVariable: {{ hostvars[inventor 5:27 ;-( 5:39 powerd left the room (quit: Ping timeout: 268 seconds). 5:43 Pavo [~brockback@75.76.204.44] entered the room. bmaltais 5:57 So it appear as if customization for network interface passed in the inventory files are not properly applied 5:57 You have disconnected 6:50 You have connected 6:50 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 6:50 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 6:58 jtriley [~jtriley@209-6-38-104.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com] entered the room. 7:02 chas [~chas@109.56.109.31.mobile.3.dk] entered the room. 7:06 masber left the room (quit: Quit: Leaving). 7:06 chas left the room (quit: Ping timeout: 245 seconds). 7:06 tovin07_ [~Tovin@p31007-ipngnfx01hodogaya.kanagawa.ocn.ne.jp] entered the room. 7:06 masber [~masber@129.94.15.152] entered the room. 7:11 You have disconnected 5:07 Tuesday, May 30, 2017 5:07 You have connected 5:07 The topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ http://docs.openstack.org/developer/kolla/ | | Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b 5:07 Topic for #openstack-kolla set by openstackstatus at 22:07:10 on 05/23/17 openstackgerrit 5:10 Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add dev mode for Murano https://review.openstack.org/467608 5:10 powerd left the room (quit: Read error: Connection reset by peer). 5:10 powerd [~powerd@79.97.29.167] entered the room. 5:11 dims [~dims@c-71-192-249-191.hsd1.ma.comcast.net] entered the room. 5:11 bmaltais [4344e925@gateway/web/freenode/ip.67.68.233.37] entered the room. 5:13 rwellum [uid219501@gateway/web/irccloud.com/x-mnwessxzjdxdotdi] entered the room. 5:13 ashishb [d25e2959@gateway/web/freenode/ip.210.94.41.89] entered the room. ashishb 5:13 Hello Everyone! 5:14 I am trying Kolla and along side magnum and Kuryr 5:14 wondering if there are Kolla docker images for Kuryr? mickt 5:14 Hi, did anyone try upgrading nova yet? chandankumar 5:15 ashishb: https://github.com/openstack/kolla/tree/master/docker/kuryr openstackgerrit 5:17 Dan Ardelean proposed openstack/kolla-ansible master: Add Hyper-V role https://review.openstack.org/455684 ashishb 5:17 chandankumar: awesome! thanks, I'll surely try it out.. just checking if it creates both Kuryr controller and agent ..? chandankumar 5:18 ashishb: sorry never tried that ashishb 5:19 chandankumar: to be more specific, I am trying to get and deploy dockerize kuryr-controller and kuryr-cni driver 5:20 ok, in anycase, I'll give this a try thanks chandankumar for pointers kbaegis 5:25 Morning all rwellum 5:26 Morning kbaegis kbaegis 5:26 ashishb: I roll my own. The build scripts certainly allow for kuryr 5:26 ashishb: They should be pullable ashishb 5:29 kbaegis: Thanks for the info, I see some like this on docker hub: https://hub.docker.com/r/kolla/ubuntu-source-kuryr-libnetwork/ ashishb 5:29 and https://hub.docker.com/r/kolla/ubuntu-source-kuryr-base/ 5:29 hope I am looking at right place to pull those openstackgerrit 5:31 Martin Mágr proposed openstack/kolla master: Sensu images https://review.openstack.org/463593 5:37 Serlex left the room (quit: Quit: Leaving.). openstackgerrit 5:44 Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a new 'outward' rabbitmq instance https://review.openstack.org/453738 5:45 jamesbenson [~jamesbens@76-210-199-16.lightspeed.snantx.sbcglobal.net] entered the room. 5:46 bjolo [~bjolo@sessfw99-sesbfw99-88.ericsson.net] entered the room. bjolo 5:47 howdy 5:49 bmaltais, i have also tried that i dont get it to work 5:49 reidrac [~jmartinez@chippewa-nat.cray.com] entered the room. bjolo 5:49 supposedly you need to override it for each machine in the inventory file, but... does not seem to work for me 5:49 jamesbenson left the room (quit: Ping timeout: 240 seconds). 5:50 jtriley left the room (quit: Ping timeout: 268 seconds). bjolo 5:50 what we do is to create bond interfaces even for machines that only have 1 nic egonzalez 5:50 bjolo, need to override but cannot be any reference to the var in globals.yml, globals override everything bjolo 5:51 so i have to remove it from globals totaly? 5:51 and only have it in inventory? egonzalez 5:52 bjolo, yes, is a limitation bjolo 5:52 ok gotcha 5:52 tnx for the info 5:53 egonzalez, on another note. egonzalez 5:53 can group variables at inventory, or let the most common used at group_vars/all 5:53 instead of globals bjolo 5:53 think it was yesterday you said something about creating subinterfaces when only having one nic. 5:53 it was in br-ext context 5:54 since br-ext needs to "own" the interface right egonzalez 5:54 yep bjolo 5:54 what type of subinterfaces do you use? 5:56 to me, subinterface means eth0:0, eth0:1, etc egonzalez 5:56 never done that before, I use VMs with as much virtual interfaces as needed, but saw some blogs about that bjolo 5:57 aha ok 5:57 cause i got a litte thrown off by that 5:57 in our setup we usually have 2 nics bonded to bond0 5:57 then we create vlan interfaces on the bonds egonzalez 5:57 http://mattinaction.blogspot.co.uk/2014/04/a-working-openstack-configuration-for.html example bjolo 5:57 i.e. bond0.101, bond0.102, etc openstackgerrit 5:57 Juan J. Martínez proposed openstack/kolla-ansible master: Fix vagrant development environment https://review.openstack.org/469068 hrw 5:58 https://review.openstack.org/#/c/468348/ - can someone +w it? bjolo 5:58 mmm need to read thru that bmaltais 5:58 bjolo: Yes, comment all reference to network interface out and define them in the inventory file on the 1st appearance of the node name hrw 5:59 so gnocchi will build for centos/source reidrac 5:59 chandankumar: you have it; see PR 469068 bjolo 5:59 the problem we ran into when using vlan interfaces is that they all get the same MAC address by default 5:59 that does not work with neutron openvswitch since they use MAC addresses in the openflow rules bmaltais 6:00 bjolo: Like in: http://paste.openstack.org/show/610955/ egonzalez 6:00 hrm, have you tried changing the mac? bjolo 6:00 so we create unique MACs for each vlan interface chandankumar 6:01 reidrac: thanks, let me try that bmaltais 6:01 bjolo: Never tried eth0:0 interface syntax in inventory file. I am not sure how it would work... bjolo 6:02 so egonzalez when you said subinterface like eth0:0 it would not work in my mind, since subinterfaces share MAC 6:02 dont think you can change that afaik bmaltais 6:02 bjolo: In centos7 I saw that you can specify a MAC for a VLAN interface using nmtui bjolo 6:02 just wanted to check if we had missunderstood something, but it seems we all agree on this :) bmaltais 6:03 bjolo: Did you try that? bjolo 6:03 yes for vlan interface no problem 6:03 but for subinterface... no bmaltais 6:03 bjolo: I see. 6:03 Got to go. Be back 6:06 skramaja is now known as skramaja|afk 6:06 skramaja|afk is now known as skramaja_afk 6:06 janki left the room (quit: Ping timeout: 255 seconds). 6:23 korzen left the room (quit: Ping timeout: 268 seconds). 6:24 Serlex [~asercan@141.143.213.53] entered the room. openstackgerrit 6:24 Eduardo Gonzalez proposed openstack/kolla-ansible master: DNM: test master branch https://review.openstack.org/456140 6:29 rmart04 left the room (quit: Ping timeout: 245 seconds). 6:30 fguillot [~fguillot@2607:f748:9:1678:3d81:1527:49f0:fd10] entered the room. 6:36 dave-mcc_ [~textual@173.38.117.65] entered the room. 6:36 fguillot left the room (quit: Ping timeout: 246 seconds). 6:44 chas left the room (quit: Remote host closed the connection). 6:45 Pavo [~brockback@75.76.204.44] entered the room. 6:45 chas [~chas@81-224-179-36-no272.tbcn.telia.com] entered the room. openstackgerrit 6:46 Eduardo Gonzalez proposed openstack/kolla master: Test fix rally build https://review.openstack.org/469077 6:49 chas left the room (quit: Ping timeout: 240 seconds). openstackgerrit 6:52 Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a new 'outward' rabbitmq instance https://review.openstack.org/453738 6:59 goldyfruit [~gtrellu@199.91.185.156] entered the room. 7:00 fguillot [~fguillot@2607:f748:9:1678:9025:5867:6c61:d36d] entered the room. openstackgerrit 7:05 Mathieu Rohon proposed openstack/kolla master: Add skydive service https://review.openstack.org/459995 7:05 Seyong left the room (quit: Ping timeout: 260 seconds). openstackgerrit 7:06 Mathieu Rohon proposed openstack/kolla-ansible master: Add skydive service https://review.openstack.org/460922 7:14 eanylin left the room (quit: Ping timeout: 240 seconds). 7:14 lucasxu [~lucas@dhcp-wifi-8021x-168-122-205-226.bu.edu] entered the room. 7:20 skramaja_afk is now known as skramaja 7:22 skramaja is now known as skramaja_ 7:27 salv-orlando [~salv_orla@94.161.197.67] entered the room. 7:27 rmart04 [~rnm@31.113.249.58] entered the room. 7:28 skramaja_ is now known as skramaja_afk chandankumar 7:28 reidrac: manheim still facing the same error after applying your patch https://paste.fedoraproject.org/paste/JaRDhYoNQzqoc7m~3I-qGF5M1UNdIGYhyRLivL9gydE= 7:28 jtriley [~jtriley@140.247.242.54] entered the room. chandankumar 7:28 tested on a clean env as well as previous env 7:29 it is coming with vagrant libvirt centos setup 7:29 s/centos/fedora 7:30 salv-orl_ left the room (quit: Ping timeout: 258 seconds). reidrac 7:31 chandankumar: that's a differnt issue, probably related to NFS not properly installed 7:31 rmart04 left the room (quit: Ping timeout: 246 seconds). reidrac 7:31 chandankumar: looks more related to your comment on the ticket; IMHO that should be dealt with in a different bug report chandankumar 7:32 reidrac: any help to debug that issue? reidrac 7:33 chandankumar: looks like the mount line explicitly uses nfs version 3 and is not supported by the NFS service openstackgerrit 7:33 Merged openstack/kolla master: Sensu images https://review.openstack.org/463593 reidrac 7:34 chandankumar: that mount line is generated by valgrant-libvirt plugin; which version is running? I'm on the latest one 7:35 chandankumar: docs say you need 0.0.31 or later (that's pretty much the latest one) chandankumar 7:36 reidrac: Installed the plugin 'vagrant-libvirt (0.0.40)'! reidrac 7:37 chandankumar: which host OS was that? may be there's a package you must install for NFS v3 support 7:37 rmart04 [~rnm@support.memset.com] entered the room. chandankumar 7:37 reidrac: i am on fedora 25 7:38 chas [chas@nat/ibm/x-bfnpvlkqppwkhxid] entered the room. reidrac 7:38 chandankumar: yum search nfs and search for version 3 support; my nfs package includes both nfs 3 and 4 7:39 chas_ [chas@nat/ibm/x-jmhaefxenxdtjezx] entered the room. chandankumar 7:41 reidrac: yup trying out reidrac 7:41 chandankumar: dnf rather yum :D 7:41 Pavo left the room (quit: Quit: Textual IRC Client: www.textualapp.com). Reepicheep 7:42 bjolo: is there a problem with a subinterface having the same mac address? They are all the same interface so frames should end up forwarded to the correct port 7:42 rmart04 left the room (quit: Ping timeout: 272 seconds). 7:43 chas left the room (quit: Ping timeout: 240 seconds). reidrac 7:43 chandankumar: you can also check the docs, Fedora 25 is very current, I wouldn't be surprised if they introduced a change on that openstackgerrit 7:46 Merged openstack/kolla master: gnocchi: take care of centos/source on non-x86 https://review.openstack.org/468348 7:47 coolsvap left the room (quit: Quit: Connection closed for inactivity). 7:48 jrist left the room (quit: Remote host closed the connection). 7:50 chas_ left the room (quit: Remote host closed the connection). 7:51 chas [chas@nat/ibm/x-pjcwpghwwkyzytkm] entered the room. 7:51 jrist [~jrist@redhat/jrist] entered the room. 7:52 chas_ [chas@nat/ibm/x-jkrpzrdjcdmrpnxk] entered the room. 7:55 chas left the room (quit: Ping timeout: 246 seconds). 8:00 GonZo2000 [~GonZo@97e0dfd6.skybroadband.com] entered the room. 8:00 GonZo2000 left the room (quit: Changing host). 8:00 GonZo2000 [~GonZo@unaffiliated/gonzo2000] entered the room. kbaegis 8:01 inc0: What was the string to set the ansible version on the target? 8:01 ansible_version or something? 8:02 looks like my inventory got overwritten :/ 8:02 salv-orlando left the room (quit: Ping timeout: 246 seconds). 8:02 jamesPR [~james@24.41.224.164] entered the room.