다음과 같이 14.04에서 실행되는 nova-Kilo에서 도커를 활성화하려고 합니다.https://wiki.openstack.org/wiki/Docker. nova-compute 참 내부의 "config-flags"에 추가되었으며 compute_driver = novadocker.virt.docker.DockerDriver, nova-cloud-controller의 nova.conf에서 Compute_driver에 주석을 달고 컴퓨팅, 컨트롤러 및 중성자 노드에서 nova 서비스를 다시 시작했습니다. 처음에는 컴퓨팅 노드에서 다음 오류가 발생했습니다.
2015-05-29 23:16:45.551 32936 ERROR nova.virt.libvirt.host [req-4aba1c34-9ac3-47bf-8b69-dd16d9a7f38c - - - - -] Connection to libvirt failed: Failed to connect socket to '/var/run/libvirt/libvirt-sock': Permission denied
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host Traceback (most recent call last):
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/host.py", line 524, in get_connection
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host conn = self._get_connection()
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/host.py", line 511, in _get_connection
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host wrapped_conn = self._get_new_connection()
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/host.py", line 463, in _get_new_connection
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host wrapped_conn = self._connect(self._uri, self._read_only)
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/host.py", line 314, in _connect
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host libvirt.openAuth, uri, auth, flags)
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 141, in proxy_call
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host rv = execute(f, *args, **kwargs)
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 122, in execute
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host six.reraise(c, e, tb)
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 80, in tworker
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host rv = meth(*args, **kwargs)
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host File "/usr/lib/python2.7/dist-packages/libvirt.py", line 105, in openAuth
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host if ret is None:raise libvirtError('virConnectOpenAuth() failed')
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host libvirtError: Failed to connect socket to '/var/run/libvirt/libvirt-sock': Permission denied
2015-05-29 23:16:45.551 32936 TRACE nova.virt.libvirt.host
2015-05-29 23:16:45.559 32936 ERROR nova.openstack.common.threadgroup [req-50db7bae-f838-4d3a-a5f6-f70d5ce00a45 - - - - -] Connection to the hypervisor is broken on host: lab-cn01
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/threadgroup.py", line 145, in wait
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup x.wait()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/threadgroup.py", line 47, in wait
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup return self.thread.wait()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 175, in wait
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup return self._exit_event.wait()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 121, in wait
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup return hubs.get_hub().switch()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 294, in switch
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup return self.greenlet.switch()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup result = function(*args, **kwargs)
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/service.py", line 497, in run_service
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup service.start()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/service.py", line 164, in start
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup self.manager.init_host()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1261, in init_host
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup self.driver.init_host(host=self.host)
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 529, in init_host
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup self._do_quality_warnings()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 507, in _do_quality_warnings
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup caps = self._host.get_capabilities()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/host.py", line 745, in get_capabilities
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup xmlstr = self.get_connection().getCapabilities()
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/host.py", line 533, in get_connection
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup raise exception.HypervisorUnavailable(host=CONF.host)
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup HypervisorUnavailable: Connection to the hypervisor is broken on host: lab-cn01
2015-05-29 23:16:45.559 32936 TRACE nova.openstack.common.threadgroup
그리고 chmod 777 /var/run/libvirt/libvirt-sock을 실행하여 주변을 둘러보았습니다. 이제 문제는 부팅 디스크가 없어 Horizon.Instances 종료에서 이미지를 시작할 수 없다는 것입니다.
Booting from Hard Disk...
Boot failed: not a bootable disk
No bootable device.
그러나 대상 컴퓨팅 노드에서 docker cli를 사용하여 인스턴스를 생성할 수 있습니다. 이상하게도 하이퍼바이저 유형은 여전히 QEMU입니다.
# nova hypervisor-show lab-cn01.maas17 | grep type
| hypervisor_type | QEMU
이견있는 사람?
건배,
편집 1: 제안을 따랐습니다.https://ask.openstack.org/en/question/52485/nova-compute-does-not-work-with-docker-hypervisor/그에 따라 nova-compute.conf를 업데이트했습니다. Nova 컴퓨팅 노드; 그러나 다시 시작하면 다음 오류가 보고됩니다.
2015-06-01 17:02:59.784 42703 ERROR nova.openstack.common.threadgroup [req-9f37298d-828c-4ac5-9834-320cc082f92b - - - - -] 'module' object has no attribute 'DOCKER'
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/threadgroup.py", line 145, in wait
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup x.wait()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/threadgroup.py", line 47, in wait
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup return self.thread.wait()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 175, in wait
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup return self._exit_event.wait()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 121, in wait
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup return hubs.get_hub().switch()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 294, in switch
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup return self.greenlet.switch()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 214, in main
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup result = function(*args, **kwargs)
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/service.py", line 497, in run_service
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup service.start()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/service.py", line 183, in start
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup self.manager.pre_start_hook()
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1291, in pre_start_hook
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup self.update_available_resource(nova.context.get_admin_context())
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6240, in update_available_resource
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup rt.update_available_resource(context)
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/compute/resource_tracker.py", line 376, in update_available_resource
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup resources = self.driver.get_available_resource(self.nodename)
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup File "/home/ubuntu/dockerdrv/src/novadocker/novadocker/virt/docker/driver.py", line 312, in get_available_resource
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup (arch.I686, hv_type.DOCKER, vm_mode.EXE),
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup AttributeError: 'module' object has no attribute 'DOCKER'
2015-06-01 17:02:59.784 42703 TRACE nova.openstack.common.threadgroup
편집 2: /usr/lib/python2.7/dist-packages/nova/compute/hv_type.py에 docker 항목을 추가했으며 하이퍼바이저 유형이 docker로 변경되었습니다.
# nova hypervisor-show lab-cn01 | grep type
| hypervisor_type | docker |
이제 문제는 nova Compute가 Docker 이미지에 액세스할 수 없다는 것입니다.
2015-06-01 23:06:22.641 7842 ERROR nova.compute.manager [-] [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] Instance failed to spawn
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] Traceback (most recent call last):
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2442, in _build_resources
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] yield resources
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2314, in _build_and_run_instance
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] block_device_info=block_device_info)
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/home/ubuntu/docker2/src/novadocker/novadocker/virt/docker/driver.py", line 436, in spawn
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] image = self._pull_missing_image(context, image_meta, instance)
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/home/ubuntu/docker2/src/novadocker/novadocker/virt/docker/driver.py", line 377, in _pull_missing_image
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] return self.docker.inspect_image(self._encode_utf8(image_meta['name']))
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/home/ubuntu/docker2/src/novadocker/novadocker/virt/docker/client.py", line 36, in wrapper
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] out = f(*args, **kwds)
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 15, in wrapped
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] return f(self, resource_id, *args, **kwargs)
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/usr/local/lib/python2.7/dist-packages/docker/client.py", line 752, in inspect_image
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] True
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/usr/local/lib/python2.7/dist-packages/docker/client.py", line 126, in _result
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] self._raise_for_status(response)
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] File "/usr/local/lib/python2.7/dist-packages/docker/client.py", line 122, in _raise_for_status
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] raise errors.APIError(e, response, explanation=explanation)
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92] APIError: 404 Client Error: Not Found ("No such image: ubuntu-14.04.2-docker")
2015-06-01 23:06:22.641 7842 TRACE nova.compute.manager [instance: ac234f55-1dc5-416e-85a2-a5b5dff37a92]
편집 3:
위의 문제는 여러 가지 문제로 인해 발생합니다.
- 버그 신고https://bugs.launchpad.net/nova/+bug/1461217
- 모든 일반적인 도커 이미지(예: ubuntu 최신 07f8e8c5e660 또는 cirros 최신 d8de71c04044)를 실행할 수 있는 것은 아닙니다. (지금까지는 rastasheep/ubuntu-sshd 14.04 063f5e7d07b3만 실행할 수 있습니다.)
편집 4:
Glance와 docker 이미지 이름은 동일해야 합니다! 그게 다입니다.