Jun 27 01:56:46.907229 np0000003818 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jun 27 01:56:48.458678 np0000003818 nova-compute[98971]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98971) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 27 01:56:48.459308 np0000003818 nova-compute[98971]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98971) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 27 01:56:48.459308 np0000003818 nova-compute[98971]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jun 27 01:56:48.583258 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:56:48.592142 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.009s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:56:48.636798 np0000003818 nova-compute[98971]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jun 27 01:56:49.375327 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jun 27 01:56:49.375462 np0000003818 nova-compute[98971]: INFO nova.utils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] The long task thread pool MainProcess.long_task is initialized Jun 27 01:56:49.375771 np0000003818 nova-compute[98971]: INFO nova.virt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Loading compute driver 'libvirt.LibvirtDriver' Jun 27 01:56:49.573092 np0000003818 nova-compute[98971]: INFO nova.compute.provider_config [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jun 27 01:56:50.075057 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Acquiring lock "singleton_lock" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:56:50.075163 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Acquired lock "singleton_lock" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:56:50.075391 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Releasing lock "singleton_lock" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:56:50.075778 np0000003818 nova-compute[98971]: WARNING oslo_service.backend._threading.service [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] no_fork=True: running service in main process Jun 27 01:56:50.075895 np0000003818 nova-compute[98971]: INFO nova.service [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Starting compute node (version 33.1.0) Jun 27 01:56:50.578744 np0000003818 nova-compute[98971]: INFO nova.utils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] The default thread pool MainProcess.default is initialized Jun 27 01:56:50.579147 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 01:56:50.579446 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Starting event thread {{(pid=98971) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jun 27 01:56:50.579847 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Starting connection event dispatch thread {{(pid=98971) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jun 27 01:56:50.580551 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Connecting to libvirt: qemu:///system {{(pid=98971) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jun 27 01:56:51.321006 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Registering for lifecycle events {{(pid=98971) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jun 27 01:56:51.321789 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Registering for connection events: {{(pid=98971) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jun 27 01:56:51.322430 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Connection event '1' reason 'None' Jun 27 01:56:51.826236 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Cannot update service status on host "np0000003818" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003818 could not be found. Jun 27 01:56:51.827039 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.mount [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Initialising _HostMountState generation 0 {{(pid=98971) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host capabilities Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: fee9c062-a71f-432f-96c4-918503668fcf Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: x86_64 Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: tcp Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: rdma Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.201170 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: 65844268 Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: 16461067 Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: 0 Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: 0 Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.203572 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: apparmor Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: 0 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: dac Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: 0 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: +64055:+993 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: +64055:+993 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-alpha Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: clipper Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-arm Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: qcom-dc-scm-v1-bmc Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: mori-bmc Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: ast2600-evb Jun 27 01:57:02.204784 np0000003818 nova-compute[98971]: borzoi Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: tiogapass-bmc Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: spitz Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-2.7 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: nuri Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: mcimx7d-sabre Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: romulus-bmc Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-3.0 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-5.0 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: npcm750-evb Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-2.10 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: rainier-bmc Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: mps3-an547 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: musca-b1 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: realview-pbx-a9 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: versatileab Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: kzm Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-2.8 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: fby35-bmc Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: musca-a Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-3.1 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: mcimx6ul-evk Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-5.1 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: smdkc210 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: sx1 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-2.11 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: imx25-pdk Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: stm32vldiscovery Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-2.9 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: orangepi-pc Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: quanta-q71l-bmc Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: z2 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-5.2 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: xilinx-zynq-a9 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: tosa Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: mps2-an500 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: virt-2.12 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: mps2-an521 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: sabrelite Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: mps2-an511 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: canon-a1100 Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: realview-eb Jun 27 01:57:02.206302 np0000003818 nova-compute[98971]: quanta-gbs-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: emcraft-sf2 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: realview-pb-a8 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: yosemitev2-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-7.0 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-4.0 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: raspi1ap Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: palmetto-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: sx1-v1 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: n810 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: g220a-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: n800 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: bletchley-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-7.1 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: tacoma-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-4.1 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: quanta-gsj Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: versatilepb Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: terrier Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: mainstone Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: realview-eb-mpcore Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: integratorcp Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-7.2 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: supermicrox11-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-4.2 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: witherspoon-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: qcom-firework-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: mps3-an524 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: kudo-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: vexpress-a9 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: midway Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: musicpal Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: lm3s811evb Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: lm3s6965evb Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: supermicro-x11spi-bmc Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: microbit Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: fby35 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: mps2-an505 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: mps2-an385 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-6.0 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: virt-8.0 Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: cubieboard Jun 27 01:57:02.207698 np0000003818 nova-compute[98971]: ast1030-evb Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: verdex Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: bpim2u Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: netduino2 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: mps2-an386 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: olimex-stm32-h405 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-6.1 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-8.1 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: raspi2b Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: vexpress-a15 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: fuji-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-6.2 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: sonorapass-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: cheetah Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-2.6 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: ast2500-evb Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: highbank Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: akita Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: connex Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: netduinoplus2 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: collie Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: raspi0 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: fp5280g2-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-arm Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: qcom-dc-scm-v1-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: mori-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: ast2600-evb Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: borzoi Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: tiogapass-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: spitz Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-2.7 Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: nuri Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: mcimx7d-sabre Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: romulus-bmc Jun 27 01:57:02.209136 np0000003818 nova-compute[98971]: virt-3.0 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-5.0 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: npcm750-evb Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-2.10 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: rainier-bmc Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: mps3-an547 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: musca-b1 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: realview-pbx-a9 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: versatileab Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: kzm Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-2.8 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: fby35-bmc Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: musca-a Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-3.1 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: mcimx6ul-evk Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-5.1 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: smdkc210 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: sx1 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-2.11 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: imx25-pdk Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: stm32vldiscovery Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-2.9 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: orangepi-pc Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: quanta-q71l-bmc Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: z2 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-5.2 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: xilinx-zynq-a9 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: tosa Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: mps2-an500 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-2.12 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: mps2-an521 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: sabrelite Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: mps2-an511 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: canon-a1100 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: realview-eb Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: quanta-gbs-bmc Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: emcraft-sf2 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: realview-pb-a8 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: yosemitev2-bmc Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-7.0 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: virt-4.0 Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: raspi1ap Jun 27 01:57:02.210674 np0000003818 nova-compute[98971]: palmetto-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: sx1-v1 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: n810 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: g220a-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: n800 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: bletchley-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-7.1 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: tacoma-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-4.1 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: quanta-gsj Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: versatilepb Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: terrier Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: mainstone Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: realview-eb-mpcore Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: integratorcp Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-7.2 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: supermicrox11-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-4.2 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: witherspoon-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: qcom-firework-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: mps3-an524 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: kudo-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: vexpress-a9 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: midway Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: musicpal Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: lm3s811evb Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: lm3s6965evb Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: supermicro-x11spi-bmc Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: microbit Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: fby35 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: mps2-an505 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: mps2-an385 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-6.0 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-8.0 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: cubieboard Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: ast1030-evb Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: verdex Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: bpim2u Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: netduino2 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: mps2-an386 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: olimex-stm32-h405 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-6.1 Jun 27 01:57:02.211941 np0000003818 nova-compute[98971]: virt-8.1 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: raspi2b Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: vexpress-a15 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: fuji-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-6.2 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: sonorapass-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: cheetah Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-2.6 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: ast2500-evb Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: highbank Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: akita Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: connex Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: netduinoplus2 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: collie Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: raspi0 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: fp5280g2-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-aarch64 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: qcom-dc-scm-v1-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: mori-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: ast2600-evb Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: borzoi Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: tiogapass-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: spitz Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-2.7 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: nuri Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: mcimx7d-sabre Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: romulus-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-3.0 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-5.0 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: npcm750-evb Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-2.10 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: rainier-bmc Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: mps3-an547 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: virt-2.8 Jun 27 01:57:02.213344 np0000003818 nova-compute[98971]: musca-b1 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: realview-pbx-a9 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: versatileab Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: kzm Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: fby35-bmc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: musca-a Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-3.1 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: mcimx6ul-evk Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-5.1 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: smdkc210 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: sx1 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-2.11 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: imx25-pdk Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: stm32vldiscovery Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-2.9 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: orangepi-pc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: quanta-q71l-bmc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: z2 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-5.2 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: xilinx-zynq-a9 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: xlnx-zcu102 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: tosa Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: mps2-an500 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-2.12 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: mps2-an521 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: sabrelite Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: mps2-an511 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: canon-a1100 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: realview-eb Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: quanta-gbs-bmc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: emcraft-sf2 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: realview-pb-a8 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: sbsa-ref Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: yosemitev2-bmc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-7.0 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: virt-4.0 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: raspi1ap Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: palmetto-bmc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: sx1-v1 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: n810 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: g220a-bmc Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: n800 Jun 27 01:57:02.214818 np0000003818 nova-compute[98971]: bletchley-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-7.1 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: tacoma-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-4.1 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: quanta-gsj Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: versatilepb Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: terrier Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: mainstone Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: realview-eb-mpcore Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: integratorcp Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-7.2 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: supermicrox11-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-4.2 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: witherspoon-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: qcom-firework-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: mps3-an524 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: kudo-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: vexpress-a9 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: midway Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: musicpal Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: lm3s811evb Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: lm3s6965evb Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: supermicro-x11spi-bmc Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: microbit Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: fby35 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: mps2-an505 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: mps2-an385 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-6.0 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-8.0 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: raspi3ap Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: cubieboard Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: ast1030-evb Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: verdex Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: bpim2u Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: netduino2 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: xlnx-versal-virt Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: mps2-an386 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: olimex-stm32-h405 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-6.1 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: virt-8.1 Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: raspi3b Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: raspi2b Jun 27 01:57:02.216088 np0000003818 nova-compute[98971]: vexpress-a15 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: fuji-bmc Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: virt-6.2 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: sonorapass-bmc Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: cheetah Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: virt-2.6 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: ast2500-evb Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: highbank Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: akita Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: connex Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: netduinoplus2 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: collie Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: raspi0 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: fp5280g2-bmc Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-cris Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: axis-dev88 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-i386 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-i440fx-noble-v2 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: ubuntu Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-q35-mantic Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-i440fx-impish-hpb Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-q35-5.2 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-q35-lunar-hpb Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-i440fx-mantic Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-i440fx-2.12 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-i440fx-2.0 Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-i440fx-xenial Jun 27 01:57:02.217294 np0000003818 nova-compute[98971]: pc-q35-kinetic Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-6.2 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-4.2 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-mantic-maxcpus Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-2.5 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-4.2 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-focal Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-hirsute Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-xenial Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-jammy-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-5.2 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-2.7 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-eoan-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-disco-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-groovy Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-zesty Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-lunar Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-mantic-hpb-maxcpus Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-groovy Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-7.1 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-artful Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-trusty Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-2.2 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-eoan-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-focal-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-8.1 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-jammy-maxcpus Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-bionic-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-mantic-hpb Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-artful Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-8.1 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-2.7 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-6.1 Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-kinetic Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-jammy-maxcpus Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-i440fx-yakkety Jun 27 01:57:02.218932 np0000003818 nova-compute[98971]: pc-q35-2.4 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-cosmic-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-7.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-2.10 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: x-remote Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-5.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-2.9 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-2.11 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-jammy-hpb-maxcpus Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-3.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-6.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-4.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-jammy Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-2.4 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-4.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-eoan Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-jammy-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-5.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-2.9 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-bionic-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-lunar Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: isapc Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-mantic-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-cosmic Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-2.6 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-mantic-maxcpus Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-3.1 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-bionic Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-disco-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-cosmic Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-2.12 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-bionic Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-kinetic-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-groovy-hpb Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-7.0 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-q35-noble-v2 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: ubuntu-q35 Jun 27 01:57:02.220099 np0000003818 nova-compute[98971]: pc-i440fx-lunar-hpb Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-disco Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-cosmic-hpb Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-noble Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: q35 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-2.1 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-8.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-impish Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-wily Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-8.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-2.6 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-6.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-impish Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-jammy Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-impish-hpb Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-hirsute Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-4.0.1 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-hirsute-hpb Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-7.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-5.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-2.8 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-2.10 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-3.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-6.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-zesty Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-7.2 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-4.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-focal Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: microvm Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-2.3 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-jammy-hpb-maxcpus Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-q35-8.2 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: q35 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-kinetic-hpb Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-focal-hpb Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-4.0 Jun 27 01:57:02.221334 np0000003818 nova-compute[98971]: pc-i440fx-noble Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-disco Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-groovy-hpb Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-8.2 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-hirsute-hpb Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-5.0 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-q35-6.2 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-2.8 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-eoan Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-q35-2.5 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-3.0 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-q35-yakkety Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-mantic-hpb-maxcpus Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-i440fx-7.2 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: pc-q35-2.11 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-m68k Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: mcf5208evb Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-7.0 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: an5206 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-6.0 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: q800 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-8.1 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-7.2 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-6.2 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-8.0 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: next-cube Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-7.1 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-6.1 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.222490 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-microblaze Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: petalogix-s3adsp1800 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: petalogix-ml605 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: xlnx-zynqmp-pmu Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-microblazeel Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: petalogix-s3adsp1800 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: petalogix-ml605 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: xlnx-zynqmp-pmu Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mips Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: mipssim Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mipsel Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: mipssim Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.224091 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mips64 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: mipssim Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: pica61 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: magnum Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mips64el Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: loongson3-virt Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: mipssim Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: pica61 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: magnum Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: boston Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: fuloong2e Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: g3beige Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: amigaone Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: virtex-ml507 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: mac99 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: ppce500 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: sam460ex Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: pegasos2 Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: bamboo Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: 40p Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: ref405ep Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: mpc8544ds Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.226288 np0000003818 nova-compute[98971]: Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-noble Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: amigaone Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: powernv9 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: powernv Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-4.1 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: mpc8544ds Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-6.1 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-2.5 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: powernv10 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-xenial Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-4.2 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-6.2 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-yakkety Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-2.6 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: ppce500 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-bionic-sxxm Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-2.7 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-3.0 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-8.0 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-5.0 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: 40p Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-lunar Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-2.8 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pegasos2 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-hirsute Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-3.1 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-8.1 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-5.1 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-eoan Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-2.9 Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-zesty Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: bamboo Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-groovy Jun 27 01:57:02.228192 np0000003818 nova-compute[98971]: pseries-focal Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: g3beige Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-8.2 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-5.2 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-disco Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.12-sxxm Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-mantic Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-kinetic Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.10 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-7.0 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: virtex-ml507 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.11 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.1 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-7.1 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-cosmic Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-bionic Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.12 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.2 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-7.2 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: mac99 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-impish Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-jammy Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-artful Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: sam460ex Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: ref405ep Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.3 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: powernv8 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-4.0 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-6.0 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-2.4 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64le Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries-noble Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: pseries Jun 27 01:57:02.229640 np0000003818 nova-compute[98971]: amigaone Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: powernv9 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: powernv Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-4.1 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: mpc8544ds Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-6.1 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-2.5 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: powernv10 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-xenial Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-4.2 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-6.2 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-yakkety Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-2.6 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: ppce500 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-bionic-sxxm Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-2.7 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-3.0 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-8.0 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-5.0 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: 40p Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-lunar Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-2.8 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pegasos2 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-hirsute Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-3.1 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-8.1 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-5.1 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-eoan Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-2.9 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-zesty Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: bamboo Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-groovy Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-focal Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: g3beige Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-8.2 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-5.2 Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-disco Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-2.12-sxxm Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-mantic Jun 27 01:57:02.231144 np0000003818 nova-compute[98971]: pseries-kinetic Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.10 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-7.0 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: virtex-ml507 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.11 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.1 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-7.1 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-cosmic Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-bionic Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.12 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.2 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-7.2 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: mac99 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-impish Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-jammy Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-artful Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: sam460ex Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: ref405ep Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.3 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: powernv8 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-4.0 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-6.0 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: pseries-2.4 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-riscv32 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: spike Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: opentitan Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: sifive_u Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: sifive_e Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.232254 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-riscv64 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: spike Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: microchip-icicle-kit Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: sifive_u Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: shakti_c Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: sifive_e Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-s390x Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-noble Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-8.0 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-disco Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-6.0 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.11 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-7.0 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-mantic Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-xenial Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-5.0 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-focal Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.8 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-4.0 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-zesty Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-8.2 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-6.2 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-3.0 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-groovy Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.5 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-7.2 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-5.2 Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-artful Jun 27 01:57:02.233867 np0000003818 nova-compute[98971]: s390-ccw-virtio-hirsute Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-4.2 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.10 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.7 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-lunar Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-eoan Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-kinetic Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-8.1 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-yakkety Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-6.1 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-cosmic Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-bionic Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.12 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-7.1 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.4 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-5.1 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.9 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-impish Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-4.1 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-jammy Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-3.1 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: s390-ccw-virtio-2.6 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sh4 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: shix Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: r2d Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.235257 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sh4eb Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: shix Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: r2d Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sparc Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SS-5 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SS-20 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: LX Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SPARCClassic Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: leon3_generic Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SPARCbook Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SS-4 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SS-600MP Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: SS-10 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Voyager Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sparc64 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: sun4u Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: niagara Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: sun4v Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: 64 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-x86_64 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: pc-i440fx-noble-v2 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: ubuntu Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: pc-q35-mantic Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: pc-i440fx-impish-hpb Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: pc-q35-5.2 Jun 27 01:57:02.236335 np0000003818 nova-compute[98971]: pc-q35-lunar-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-mantic Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-2.12 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-2.0 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-xenial Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-kinetic Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-6.2 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-4.2 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-mantic-maxcpus Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-2.5 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-4.2 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-focal Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-hirsute Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-xenial Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-jammy-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-5.2 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-2.7 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-eoan-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-zesty Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-groovy Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-disco-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-lunar Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-mantic-hpb-maxcpus Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-groovy Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-7.1 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-artful Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-trusty Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-2.2 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-focal-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-8.1 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-eoan-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-jammy-maxcpus Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-bionic-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-q35-mantic-hpb Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-artful Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-8.1 Jun 27 01:57:02.237468 np0000003818 nova-compute[98971]: pc-i440fx-2.7 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-6.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-kinetic Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-jammy-maxcpus Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-yakkety Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-2.4 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-cosmic-hpb Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-7.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-2.10 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: x-remote Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-5.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-2.9 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-2.11 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-jammy-hpb-maxcpus Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-3.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-6.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-4.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-jammy Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-2.4 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-4.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-eoan Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-jammy-hpb Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-5.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-2.9 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-bionic-hpb Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-lunar Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: isapc Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-mantic-hpb Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-cosmic Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-2.6 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-mantic-maxcpus Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-3.1 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-bionic Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-disco-hpb Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-cosmic Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-2.12 Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-i440fx-bionic Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-kinetic-hpb Jun 27 01:57:02.238096 np0000003818 nova-compute[98971]: pc-q35-groovy-hpb Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-7.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-noble-v2 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: ubuntu-q35 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-lunar-hpb Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-disco Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-cosmic-hpb Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-2.1 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-noble Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: q35 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-8.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-wily Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-impish Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-8.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-2.6 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-6.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-impish Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-jammy Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-impish-hpb Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-hirsute Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-4.0.1 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-hirsute-hpb Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-7.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-5.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-2.8 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-2.10 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-3.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-zesty Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-7.2 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-4.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-6.0 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-focal Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: microvm Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-2.3 Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-q35-jammy-hpb-maxcpus Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-disco Jun 27 01:57:02.238717 np0000003818 nova-compute[98971]: pc-i440fx-kinetic-hpb Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-4.0 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-focal-hpb Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-noble Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-q35-8.2 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: q35 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-groovy-hpb Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-hirsute-hpb Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-8.2 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-5.0 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-2.8 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-q35-6.2 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-eoan Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-q35-2.5 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-3.0 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-q35-yakkety Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-mantic-hpb-maxcpus Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-i440fx-7.2 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: pc-q35-2.11 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-xtensa Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: sim Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: kc705 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: ml605 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: ml605-nommu Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: lx60-nommu Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: lx200 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: lx200-nommu Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: lx60 Jun 27 01:57:02.239322 np0000003818 nova-compute[98971]: kc705-nommu Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: hvm Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: 32 Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-xtensaeb Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: sim Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: kc705 Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: ml605 Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: ml605-nommu Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: lx60-nommu Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: lx200 Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: lx200-nommu Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: lx60 Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: kc705-nommu Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-alpha Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: clipper Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: alpha Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.240104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: Jun 27 01:57:02.241137 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-arm Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: armv6l Jun 27 01:57:02.242491 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa270-c0 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-a15 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa270-b0 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-m4 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa270-a0 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: arm1176 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa270-b1 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-a7 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa270-a1 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-a8 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-r5 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: ti925t Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-r5f Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: arm1026 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-a9 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: cortex-m7 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa270 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa260 Jun 27 01:57:02.243559 np0000003818 nova-compute[98971]: pxa250 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: pxa270-c5 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: pxa261 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: pxa262 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: sa1110 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: cortex-r52 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: sa1100 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: max Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: cortex-m0 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: cortex-m33 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: arm946 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: pxa255 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: arm11mpcore Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: cortex-m55 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: arm926 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: arm1136 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: arm1136-r2 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: cortex-m3 Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.244432 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.245927 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: 2 Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: 3 Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-arm Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: armv6l Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: pxa270-c0 Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: cortex-a15 Jun 27 01:57:02.247661 np0000003818 nova-compute[98971]: pxa270-b0 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-m4 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa270-a0 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm1176 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa270-b1 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-a7 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa270-a1 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-a8 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-r5 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: ti925t Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-r5f Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm1026 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-a9 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-m7 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa270 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa260 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa250 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa270-c5 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa261 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa262 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: sa1110 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-r52 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: sa1100 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: max Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-m0 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-m33 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm946 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: pxa255 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm11mpcore Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: cortex-m55 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm926 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm1136 Jun 27 01:57:02.249186 np0000003818 nova-compute[98971]: arm1136-r2 Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: cortex-m3 Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: Jun 27 01:57:02.249750 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: 2 Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: 3 Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.251257 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-arm Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: armv7l Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: efi Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: pxa270-c0 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: cortex-a15 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: pxa270-b0 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: cortex-m4 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: pxa270-a0 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: arm1176 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: pxa270-b1 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: cortex-a7 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: pxa270-a1 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: cortex-a8 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: cortex-r5 Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: ti925t Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: cortex-r5f Jun 27 01:57:02.252568 np0000003818 nova-compute[98971]: arm1026 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-a9 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-m7 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa270 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa260 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa250 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa270-c5 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa261 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa262 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: sa1110 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-r52 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: sa1100 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: max Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-m0 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-m33 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: arm946 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: pxa255 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: arm11mpcore Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-m55 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: arm926 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: arm1136 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: arm1136-r2 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cortex-m3 Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: Jun 27 01:57:02.253482 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: Jun 27 01:57:02.254310 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: 2 Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: 3 Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-aarch64 Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: aarch64 Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: efi Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.255596 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: neoverse-n2 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa270-c0 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-a15 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa270-b0 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-a57 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-m4 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa270-a0 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: arm1176 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa270-b1 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-a7 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa270-a1 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-a76 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: a64fx Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-a8 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: neoverse-v1 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-r5 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: ti925t Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-r5f Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: arm1026 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-a9 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: cortex-m7 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa270 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa260 Jun 27 01:57:02.256621 np0000003818 nova-compute[98971]: pxa250 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: pxa270-c5 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: pxa261 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: pxa262 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-a710 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: sa1110 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-r52 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: sa1100 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: max Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-a53 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-m0 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-m33 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-a72 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: arm946 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: pxa255 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-a55 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: arm11mpcore Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-m55 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: neoverse-n1 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: arm926 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: arm1136 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-a35 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: arm1136-r2 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cortex-m3 Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.257351 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.258104 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: 2 Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: 3 Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-cris Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: axis-dev88 Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: cris Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.259405 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.260468 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-i386 Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: pc-i440fx-noble-v2 Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: i686 Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.261792 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.263068 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.264305 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.264918 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.265815 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-i386 Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: pc-q35-noble Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: i686 Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.267181 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: Jun 27 01:57:02.268484 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.269516 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: Jun 27 01:57:02.270175 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: Jun 27 01:57:02.271295 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-i386 Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: pc-i440fx-noble Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: i686 Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.272611 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.273785 np0000003818 nova-compute[98971]: Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.274730 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.275333 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.276198 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-i386 Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: pc-q35-noble-v2 Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: i686 Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.277463 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.278660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.279653 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: Jun 27 01:57:02.280289 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.281138 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-m68k Jun 27 01:57:02.282407 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: mcf5208evb Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: m68k Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.283395 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-m68k Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: virt-8.2 Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: m68k Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.284636 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: Jun 27 01:57:02.285801 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-microblaze Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: petalogix-s3adsp1800 Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: microblaze Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.287322 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.288461 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-microblazeel Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: petalogix-s3adsp1800 Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: microblazeel Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: Jun 27 01:57:02.289841 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.290854 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mips Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: mips Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.292209 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.293329 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mipsel Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: mipsel Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.294602 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.295709 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: Jun 27 01:57:02.296943 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mips64 Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: mips64 Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.298052 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: Jun 27 01:57:02.299008 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-mips64el Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: malta Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: mips64el Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: Jun 27 01:57:02.300372 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.301599 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: g3beige Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: ppc Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.302819 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.303821 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64 Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: pseries-noble Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: ppc64 Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.305151 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: POWER10 Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: POWER9 Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: POWER8 Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: POWER7 Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.306410 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: tpm-spapr Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: spapr-tpm-proxy Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.307677 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64 Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: pseries-noble Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: ppc64 Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: POWER10 Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: POWER9 Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: POWER8 Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: POWER7 Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.309037 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: tpm-spapr Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: spapr-tpm-proxy Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.310191 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64 Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: powernv9 Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: ppc64 Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.311362 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: POWER10 Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: POWER9 Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: POWER8 Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: POWER7 Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.312502 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: tpm-spapr Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: spapr-tpm-proxy Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.313693 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64le Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: pseries-noble Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: ppc64le Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: POWER10 Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: POWER9 Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: POWER8 Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: POWER7 Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: Jun 27 01:57:02.314802 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: tpm-spapr Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: spapr-tpm-proxy Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.315920 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-ppc64le Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: powernv9 Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: ppc64le Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: POWER10 Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: POWER9 Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: POWER8 Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: POWER7 Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.317127 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: Jun 27 01:57:02.318177 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: tpm-spapr Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: spapr-tpm-proxy Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-riscv32 Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.319420 np0000003818 nova-compute[98971]: riscv32 Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.320603 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.321889 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-riscv64 Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: virt Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: riscv64 Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: rv64 Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: sifive-e51 Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: any Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: x-rv128 Jun 27 01:57:02.323249 np0000003818 nova-compute[98971]: shakti-c Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: max Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: thead-c906 Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: sifive-u54 Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: veyron-v1 Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.324062 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: Jun 27 01:57:02.325210 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-s390x Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: s390-ccw-virtio-noble Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: s390x Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z13 Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z990.3 Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z13-base Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z990.2 Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z196.2-base Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z14 Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z14.2-base Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z990.4 Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z196 Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z10BC.2-base Jun 27 01:57:02.326391 np0000003818 nova-compute[98971]: z114-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: gen16b Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z890.3-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: gen16a Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z990.5 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z196.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: zEC12 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: zEC12.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z9EC.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z9BC Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z9EC.3-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z800-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z14ZR1-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z890 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z990.4-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z9EC.3 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z13.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z10BC.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: gen15a-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z14.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: zBC12-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: gen16a-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z900.3 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z196-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z990 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z14-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z900.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z800 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z10EC Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z14ZR1 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z900 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z10EC.2 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z10EC.2-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z900.2-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z900-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z10EC.3 Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: z990.5-base Jun 27 01:57:02.327210 np0000003818 nova-compute[98971]: max Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: gen15b Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z9BC.2-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: gen15a Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z990.2-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z10EC-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: gen16b-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z114 Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z9EC-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z13s Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: gen15b-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: zEC12-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z890.3 Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z10EC.3-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z890.2-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z890.2 Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z10BC-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: zEC12.2-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z890-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z9BC-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z10BC Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z9EC Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z9EC.2-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z13.2-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z900.3-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z990.3-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z13s-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: zBC12 Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z990-base Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: z9BC.2 Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.327884 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.328701 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sh4 Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: shix Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: sh4 Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.330073 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: Jun 27 01:57:02.331160 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sh4eb Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: shix Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: sh4eb Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.332637 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.334005 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sparc Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.335350 np0000003818 nova-compute[98971]: SS-5 Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: sparc Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.336418 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-sparc64 Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: sun4u Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: sparc64 Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.337735 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.338767 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: Jun 27 01:57:02.340256 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-x86_64 Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: pc-i440fx-noble-v2 Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: x86_64 Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: efi Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.341406 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.342292 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.343055 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.343608 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.344913 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-x86_64 Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: pc-q35-noble Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: x86_64 Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: efi Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: /usr/share/ovmf/OVMF.amdsev.fd Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.346270 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.347301 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.348315 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.348904 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.350013 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-x86_64 Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: pc-i440fx-noble Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: x86_64 Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: efi Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.351414 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.352500 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.353207 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: ide Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.353787 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.354931 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-x86_64 Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: pc-q35-noble-v2 Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: x86_64 Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: efi Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: /usr/share/ovmf/OVMF.amdsev.fd Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: on Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: off Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.356269 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: qemu64 Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: qemu32 Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: phenom Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: pentium3 Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: pentium2 Jun 27 01:57:02.357462 np0000003818 nova-compute[98971]: pentium Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: n270 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: kvm64 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: kvm32 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: coreduo Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: core2duo Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: athlon Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Westmere-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Westmere Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Snowridge Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Skylake-Server-noTSX-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Skylake-Server-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Skylake-Server Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Skylake-Client-noTSX-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Skylake-Client-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Skylake-Client Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: SapphireRapids Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: SandyBridge-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: SandyBridge Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Penryn Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Opteron_G5 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Opteron_G4 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Opteron_G3 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Opteron_G2 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Opteron_G1 Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Nehalem-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: IvyBridge-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: IvyBridge Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Icelake-Server-noTSX Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Icelake-Server Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Haswell-noTSX-IBRS Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Haswell-noTSX Jun 27 01:57:02.358163 np0000003818 nova-compute[98971]: Haswell-IBRS Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Haswell Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: EPYC-Rome Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: EPYC-Milan Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: EPYC-IBPB Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: EPYC-Genoa Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: EPYC Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Dhyana Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Cooperlake Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Conroe Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Cascadelake-Server-noTSX Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Cascadelake-Server Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Broadwell-noTSX-IBRS Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Broadwell-noTSX Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Broadwell-IBRS Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Broadwell Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: 486 Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.358725 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: tpm-tis Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: tpm-crb Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: passthrough Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: emulator Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: external Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: 1.2 Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: 2.0 Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.359720 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: relaxed Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: vapic Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: spinlocks Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: vpindex Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: runtime Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: synic Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: stimer Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: reset Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: vendor_id Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: frequencies Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: reenlightenment Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: tlbflush Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: ipi Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: avic Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-xtensa Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: sim Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: xtensa Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.361054 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: Jun 27 01:57:02.362205 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-xtensaeb Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: sim Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: xtensaeb Jun 27 01:57:02.363566 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: rom Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: pflash Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: yes Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: no Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: file Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: anonymous Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: memfd Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: disk Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: cdrom Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: floppy Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: lun Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: fdc Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: sata Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: sdl Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: vnc Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: spice Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: egl-headless Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: dbus Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: subsystem Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: Jun 27 01:57:02.364660 np0000003818 nova-compute[98971]: default Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: mandatory Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: requisite Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: optional Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: pci Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: scsi Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: virtio-transitional Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: virtio-non-transitional Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: random Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: egd Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: path Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: handle Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: virtiofs Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: usb Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: pty Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: unix Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: spicevmc Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: virtio Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: qemu Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: builtin Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: Jun 27 01:57:02.365906 np0000003818 nova-compute[98971]: {{(pid=98971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 27 01:57:02.367053 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Checking secure boot support for host arch (x86_64) {{(pid=98971) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 27 01:57:02.367053 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Checking secure boot support for host arch (x86_64) {{(pid=98971) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 27 01:57:02.367053 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Checking secure boot support for host arch (x86_64) {{(pid=98971) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 27 01:57:02.367053 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Secure Boot support detected Jun 27 01:57:02.815988 np0000003818 nova-compute[98971]: INFO nova.virt.node [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Generated node identity e15e7dcd-705b-4a74-b310-f650a880c622 Jun 27 01:57:02.816337 np0000003818 nova-compute[98971]: INFO nova.virt.node [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Wrote node identity e15e7dcd-705b-4a74-b310-f650a880c622 to /opt/stack/data/nova/compute_id Jun 27 01:57:03.319053 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Compute nodes ['e15e7dcd-705b-4a74-b310-f650a880c622'] for host np0000003818 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jun 27 01:57:04.322682 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jun 27 01:57:05.327846 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] No compute node record found for host np0000003818. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003818 could not be found. Jun 27 01:57:05.328338 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:57:05.328338 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:57:05.328338 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:57:05.328338 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 01:57:05.391998 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:57:05.392503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:57:05.405986 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:57:05.406237 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Hypervisor/Node resource view: name=np0000003818 free_ram=55577MB free_disk=75.18358993530273GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 01:57:05.406348 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:57:05.406555 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:57:05.909294 np0000003818 nova-compute[98971]: WARNING nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] No compute node record for np0000003818:e15e7dcd-705b-4a74-b310-f650a880c622: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e15e7dcd-705b-4a74-b310-f650a880c622 could not be found. Jun 27 01:57:06.413233 np0000003818 nova-compute[98971]: INFO nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Compute node record created for np0000003818:np0000003818 with uuid: e15e7dcd-705b-4a74-b310-f650a880c622 Jun 27 01:57:07.919636 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 01:57:07.920192 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:57:05 up 26 min, 2 users, load average: 2.75, 1.78, 0.91\n'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 01:57:08.373829 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] [req-fb757c8b-12b0-4c79-912c-1e23e4d920ec] Created resource provider record via placement API for resource provider with UUID e15e7dcd-705b-4a74-b310-f650a880c622 and name np0000003818. Jun 27 01:57:08.419936 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] /sys/module/kvm_amd/parameters/sev contains [N Jun 27 01:57:08.419936 np0000003818 nova-compute[98971]: ] {{(pid=98971) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jun 27 01:57:08.420107 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.host [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] kernel doesn't support AMD SEV Jun 27 01:57:08.420278 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:57:08.420452 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Updating inventory in ProviderTree for provider e15e7dcd-705b-4a74-b310-f650a880c622 with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 27 01:57:08.420706 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Libvirt baseline CPU Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: x86_64 Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: AMD Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: Jun 27 01:57:08.424280 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13761}} Jun 27 01:57:08.984147 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Updated inventory for provider e15e7dcd-705b-4a74-b310-f650a880c622 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} Jun 27 01:57:08.984532 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Updating resource provider e15e7dcd-705b-4a74-b310-f650a880c622 generation from 0 to 1 during operation: update_inventory {{(pid=98971) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 27 01:57:08.984532 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Updating inventory in ProviderTree for provider e15e7dcd-705b-4a74-b310-f650a880c622 with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 27 01:57:09.116767 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Updating resource provider e15e7dcd-705b-4a74-b310-f650a880c622 generation from 1 to 2 during operation: update_traits {{(pid=98971) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 27 01:57:09.623693 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 01:57:09.623884 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.217s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:57:09.624146 np0000003818 nova-compute[98971]: DEBUG nova.service [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98971) start /opt/stack/nova/nova/service.py:196}} Jun 27 01:57:09.639121 np0000003818 nova-compute[98971]: DEBUG nova.service [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98971) start /opt/stack/nova/nova/service.py:212}} Jun 27 01:57:09.653179 np0000003818 nova-compute[98971]: DEBUG nova.service [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] Join ServiceGroup membership for this service compute {{(pid=98971) start /opt/stack/nova/nova/service.py:222}} Jun 27 01:57:09.653319 np0000003818 nova-compute[98971]: DEBUG nova.servicegroup.drivers.db [None req-6b301547-d2f7-49ef-817c-858a6bcd3878 None None] DB_Driver: join new ServiceGroup member np0000003818 to the compute group, service = {{(pid=98971) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 27 01:57:15.156555 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 01:57:30.654777 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._sync_power_states {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:31.157532 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:31.158399 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 17.48 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 01:57:48.637829 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.638311 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.638376 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.638598 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.638786 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.638991 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.639180 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:48.639356 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 01:57:48.639529 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:57:49.143086 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:57:49.143333 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:57:49.143508 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:57:49.143619 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 01:57:49.152907 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:57:49.153655 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:57:49.168162 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:57:49.168791 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=55251MB free_disk=75.05362701416016GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 01:57:49.169028 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:57:49.169189 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:57:50.220997 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 01:57:50.220997 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:57:49 up 26 min, 2 users, load average: 4.30, 2.27, 1.11\n'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 01:57:50.273963 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:57:50.275197 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:57:50.778997 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:57:51.284001 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 01:57:51.284539 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.115s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:57:51.284694 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 01:58:51.279567 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.280299 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.280299 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.280415 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.280772 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.280922 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.281127 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.281320 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.281520 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 01:58:51.282098 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:58:51.787910 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:58:51.788131 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:58:51.788206 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:58:51.788305 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 01:58:51.796644 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:58:51.797341 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:58:51.811800 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:58:51.812172 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=55302MB free_disk=74.8428840637207GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 01:58:51.812377 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:58:51.812550 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:58:52.881961 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 01:58:52.882477 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:58:51 up 27 min, 2 users, load average: 2.42, 2.11, 1.13\n'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 01:58:52.925549 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:58:52.925817 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:58:53.428582 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:58:53.934711 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 01:58:53.935127 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.122s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:58:53.935185 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 01:59:15.163913 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 01:59:22.241232 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:22.241886 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:22.744563 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:23.328166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:23.328166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:23.399928 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:23.400097 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:23.402894 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 01:59:23.403112 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Claim successful on node np0000003818 Jun 27 01:59:23.832014 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:24.414769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:24.617224 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:59:24.617456 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:59:25.120756 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:59:25.630135 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.230s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:25.631128 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.216s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:25.631258 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 01:59:25.639815 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 01:59:25.640020 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Claim successful on node np0000003818 Jun 27 01:59:26.139557 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 01:59:26.140019 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 01:59:26.141146 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:26.142997 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:26.645819 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 01:59:26.916452 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:59:26.916763 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:59:27.160116 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e456b31af1694ba7806b8314709ff580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d954fa627b74bda8e96ce7fdea76d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 01:59:27.160116 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 01:59:27.328469 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:27.328725 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:27.425749 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:59:27.831638 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:27.933861 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.303s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:27.934398 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 01:59:28.168358 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 01:59:28.169785 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 01:59:28.170094 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Creating image(s) Jun 27 01:59:28.170938 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "/opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:28.174001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "/opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:28.174001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "/opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:28.174001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:28.174274 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:28.415330 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:28.416162 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:28.419563 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 01:59:28.422381 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Claim successful on node np0000003818 Jun 27 01:59:28.451488 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 01:59:28.451488 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 01:59:28.451488 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:28.451488 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:28.715630 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:28.718135 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12040f7bfd874cd086b002bc598c80d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a76767ddc64ede879746f16624d287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 01:59:28.719957 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:28.720664 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.part --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:28.809783 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.part --force-share --output=json" returned: 0 in 0.089s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:28.810721 np0000003818 nova-compute[98971]: DEBUG nova.virt.images [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] 978bb255-a7d2-43ac-8161-7d19816a5875 was qcow2, converting to raw {{(pid=98971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 27 01:59:28.812820 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 01:59:28.813147 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.part /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.converted {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:28.836695 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Successfully created port: 99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 01:59:28.949238 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 01:59:29.455367 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 01:59:29.770195 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:59:29.770449 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:59:29.909884 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.part /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.converted" returned: 0 in 1.097s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:29.914943 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.converted --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:29.991552 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf.converted --force-share --output=json" returned: 0 in 0.076s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:29.992295 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.819s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:29.992879 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:29.997242 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:29.998363 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsap2yj9p/privsep.sock'] Jun 27 01:59:30.008337 np0000003818 sudo[110301]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsap2yj9p/privsep.sock Jun 27 01:59:30.009388 np0000003818 sudo[110301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 27 01:59:30.235023 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Successfully created port: d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 01:59:30.265339 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 27 01:59:30.265339 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 01:59:30.265339 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 01:59:30.265541 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:30.265541 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 01:59:30.265946 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 01:59:30.265946 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 01:59:30.265946 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:30.265946 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 27 01:59:30.274564 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:59:30.469826 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 01:59:30.471179 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 01:59:30.471294 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Creating image(s) Jun 27 01:59:30.471950 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:30.472165 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:30.472551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:30.472994 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:30.475697 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:30.613848 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 27 01:59:30.613961 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 01:59:30.614015 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 01:59:30.614127 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:30.614190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 01:59:30.614235 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 01:59:30.614285 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 01:59:30.614331 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:30.614375 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 27 01:59:30.784401 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.369s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:30.784934 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 01:59:30.843720 np0000003818 sudo[110301]: pam_unix(sudo:session): session closed for user root Jun 27 01:59:30.845342 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Spawned new privsep daemon via rootwrap Jun 27 01:59:30.846301 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 27 01:59:30.846490 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 27 01:59:30.846490 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 27 01:59:30.846558 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110326 Jun 27 01:59:30.847851 np0000003818 nova-compute[98971]: WARNING oslo_privsep.priv_context [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] privsep daemon already running Jun 27 01:59:30.944635 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:30.957545 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.017793 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Successfully updated port: 99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 01:59:31.020354 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.076s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.021605 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:31.022014 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:31.022381 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:31.027938 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:31.028608 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.040293 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.086s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.041015 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:31.113030 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.084s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.113466 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.145109 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk 1073741824" returned: 0 in 0.031s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.145751 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.124s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:31.146518 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.153263 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.111s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:31.154235 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:31.157792 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:31.158453 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.217443 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.071s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.218032 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 01:59:31.218741 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.236448 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.078s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.237237 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.271184 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk 1073741824" returned: 0 in 0.033s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.271846 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.119s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:31.272323 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.287569 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.288224 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Cannot resize image /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 01:59:31.289284 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 01:59:31.292114 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Ensure instance console log exists: /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 01:59:31.295665 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:31.296530 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:31.296530 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:31.296530 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 01:59:31.296750 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 01:59:31.297163 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:31.297421 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:31.348114 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.076s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.348657 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 01:59:31.349030 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:31.389865 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12040f7bfd874cd086b002bc598c80d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a76767ddc64ede879746f16624d287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 01:59:31.401694 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Successfully updated port: d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 01:59:31.428923 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:31.428923 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Cannot resize image /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 01:59:31.428923 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 01:59:31.429733 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Ensure instance console log exists: /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 01:59:31.430050 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:31.430380 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:31.430617 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:31.521745 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "refresh_cache-06009c3c-6614-40da-910b-bd7e2ac02dc0" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:31.521909 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquired lock "refresh_cache-06009c3c-6614-40da-910b-bd7e2ac02dc0" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:31.522090 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 01:59:31.800710 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 01:59:31.818890 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-changed-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:31.819087 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Refreshing instance network info cache due to event network-changed-99790a0e-33c3-4174-abf4-8b83f563994b. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 01:59:31.819551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] Acquiring lock "refresh_cache-06009c3c-6614-40da-910b-bd7e2ac02dc0" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:31.905057 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:31.905275 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:31.905552 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 01:59:32.055046 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-changed-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:32.055489 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Refreshing instance network info cache due to event network-changed-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 01:59:32.055489 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] Acquiring lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:32.099930 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Successfully created port: 63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 01:59:32.209162 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:32.307468 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 01:59:32.865175 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:33.318372 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 01:59:33.319385 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 01:59:33.319711 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Creating image(s) Jun 27 01:59:33.323276 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:33.323569 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:33.324337 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:33.325196 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:33.329404 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:33.331803 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:33.407189 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.074s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:33.407422 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:33.408213 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:33.408543 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:33.414572 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:33.414722 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:33.491602 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Successfully updated port: 63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 01:59:33.524406 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.109s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:33.525085 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:33.558751 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk 1073741824" returned: 0 in 0.033s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:33.559201 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.151s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:33.559612 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:33.641549 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.082s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:33.642428 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 01:59:33.645647 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:33.665624 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:33.715277 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:33.717115 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Cannot resize image /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 01:59:33.717115 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 01:59:33.717115 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Ensure instance console log exists: /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 01:59:33.717115 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:33.717115 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:33.717115 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:33.799552 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:33.844334 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Updating instance_info_cache with network_info: [{"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:33.988785 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Updating instance_info_cache with network_info: [{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:33.995031 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:33.995190 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:33.995441 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 01:59:34.347818 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Releasing lock "refresh_cache-06009c3c-6614-40da-910b-bd7e2ac02dc0" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:34.348391 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Instance network_info: |[{"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 01:59:34.348802 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] Acquired lock "refresh_cache-06009c3c-6614-40da-910b-bd7e2ac02dc0" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:34.351174 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Start _get_guest_xml network_info=[{"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 01:59:34.351833 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Refreshing network info cache for port 99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 01:59:34.355301 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:59:34.357762 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-479865311', uuid='06009c3c-6614-40da-910b-bd7e2ac02dc0'), owner=OwnerMeta(userid='e456b31af1694ba7806b8314709ff580', username='tempest-DeleteServersTestJSON-1978332501-project-member', projectid='8d954fa627b74bda8e96ce7fdea76d6e', projectname='tempest-DeleteServersTestJSON-1978332501'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525574.3571527) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 01:59:34.358773 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 01:59:34.359355 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 01:59:34.359786 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 01:59:34.360029 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 01:59:34.361271 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 01:59:34.361617 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 01:59:34.361795 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 01:59:34.362071 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 01:59:34.362412 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 01:59:34.362517 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 01:59:34.362675 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 01:59:34.363080 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 01:59:34.363155 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 01:59:34.363466 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 01:59:34.363645 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 01:59:34.363798 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 01:59:34.377418 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 01:59:34.378768 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-479865311',display_name='tempest-DeleteServersTestJSON-server-479865311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-deleteserverstestjson-server-479865311',id=1,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d954fa627b74bda8e96ce7fdea76d6e',ramdisk_id='',reservation_id='r-vzq6tis0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1978332501',owner_user_name='tempest-DeleteServersTestJSON-1978332501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:27Z,user_data=None,user_id='e456b31af1694ba7806b8314709ff580',uuid=06009c3c-6614-40da-910b-bd7e2ac02dc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 01:59:34.379192 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Converting VIF {"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:34.380066 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:34.380852 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lazy-loading 'pci_devices' on Instance uuid 06009c3c-6614-40da-910b-bd7e2ac02dc0 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:34.491143 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:34.491504 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance network_info: |[{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 01:59:34.492160 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] Acquired lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:34.495097 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Start _get_guest_xml network_info=[{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 01:59:34.495097 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Refreshing network info cache for port d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 01:59:34.499176 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:59:34.500288 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-593188503', uuid='ea1483cd-9799-4aa0-b0c3-540d9ec1835e'), owner=OwnerMeta(userid='12040f7bfd874cd086b002bc598c80d4', username='tempest-ServerRescueNegativeTestJSON-438392507-project-member', projectid='d6a76767ddc64ede879746f16624d287', projectname='tempest-ServerRescueNegativeTestJSON-438392507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525574.499935) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 01:59:34.501356 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 01:59:34.502457 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 01:59:34.502931 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 01:59:34.503187 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 01:59:34.504169 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 01:59:34.504438 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 01:59:34.504641 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 01:59:34.504705 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 01:59:34.504772 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 01:59:34.505197 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 01:59:34.505475 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 01:59:34.505692 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 01:59:34.505823 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 01:59:34.505950 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 01:59:34.506108 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 01:59:34.506674 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 01:59:34.519704 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-593188503',display_name='tempest-ServerRescueNegativeTestJSON-server-593188503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-593188503',id=2,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-9mul9jc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:30Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=ea1483cd-9799-4aa0-b0c3-540d9ec1835e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 01:59:34.519895 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:34.520387 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:34.520986 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'pci_devices' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:34.605860 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:34.774025 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-changed-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:34.774652 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Refreshing instance network info cache due to event network-changed-63f73704-ae6b-45ab-bb38-54a802124fc0. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 01:59:34.774652 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] Acquiring lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:34.836059 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:34.854867 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] End _get_guest_xml xml= Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 06009c3c-6614-40da-910b-bd7e2ac02dc0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: instance-00000001 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 196608 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: tempest-DeleteServersTestJSON-server-479865311 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 2026-06-27 01:59:34 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 192 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: True Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: bare Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: qcow2 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: virtio Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: tempest-DeleteServersTestJSON-1978332501-project-member Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: tempest-DeleteServersTestJSON-1978332501 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 06009c3c-6614-40da-910b-bd7e2ac02dc0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 06009c3c-6614-40da-910b-bd7e2ac02dc0 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: hvm Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 128 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: Jun 27 01:59:34.885460 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 01:59:34.889951 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Preparing to wait for external event network-vif-plugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 01:59:34.889951 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:34.889951 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:34.889951 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:34.889951 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-479865311',display_name='tempest-DeleteServersTestJSON-server-479865311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-deleteserverstestjson-server-479865311',id=1,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d954fa627b74bda8e96ce7fdea76d6e',ramdisk_id='',reservation_id='r-vzq6tis0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1978332501',owner_user_name='tempest-DeleteServersTestJSON-1978332501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:27Z,user_data=None,user_id='e456b31af1694ba7806b8314709ff580',uuid=06009c3c-6614-40da-910b-bd7e2ac02dc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 01:59:34.890368 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Converting VIF {"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:34.890368 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:34.890368 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 01:59:34.947573 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Created schema index Interface.name {{(pid=98971) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 27 01:59:34.948415 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Created schema index Port.name {{(pid=98971) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 27 01:59:34.948601 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Created schema index Bridge.name {{(pid=98971) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 27 01:59:34.949126 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 27 01:59:34.949325 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [POLLOUT] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.950390 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 27 01:59:34.950390 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.951741 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.972489 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.990418 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.990418 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:34.990533 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 01:59:34.991767 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.991767 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5d729c2-650f-5341-ab46-679ecf3d4c79', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:34.993027 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.994147 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:34.994991 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:34.996350 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpt4f_eg_2/privsep.sock'] Jun 27 01:59:34.997467 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:35.008334 np0000003818 sudo[110585]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpt4f_eg_2/privsep.sock Jun 27 01:59:35.009231 np0000003818 sudo[110585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] End _get_guest_xml xml= Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: instance-00000002 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 196608 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-server-593188503 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 2026-06-27 01:59:34 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 192 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: True Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: bare Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: qcow2 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: virtio Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507-project-member Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: hvm Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 128 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: Jun 27 01:59:35.026513 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 01:59:35.028471 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Preparing to wait for external event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 01:59:35.028471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:35.028471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:35.028471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:35.028471 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-593188503',display_name='tempest-ServerRescueNegativeTestJSON-server-593188503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-593188503',id=2,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-9mul9jc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:30Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=ea1483cd-9799-4aa0-b0c3-540d9ec1835e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 01:59:35.028774 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:35.034776 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:35.035283 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 01:59:35.038139 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:35.038139 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:35.038139 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 01:59:35.039885 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:35.039885 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9e6685e-e6a4-59f8-bfb3-ad0c0ccd963a', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:35.042863 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:35.043705 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:35.067601 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Updating instance_info_cache with network_info: [{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:35.311897 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 27 01:59:35.312035 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 01:59:35.312102 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 01:59:35.312148 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:35.312213 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 01:59:35.312275 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 01:59:35.312342 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 01:59:35.312411 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:35.312475 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 27 01:59:35.415241 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:35.517379 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:35.539894 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:35.569537 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:35.569963 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance network_info: |[{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 01:59:35.570853 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] Acquired lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:35.572922 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Start _get_guest_xml network_info=[{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 01:59:35.573454 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Refreshing network info cache for port 63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 01:59:35.579295 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:59:35.580477 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1976442498', uuid='2a3c8563-52c1-48ac-b1e5-2a3ba54f4770'), owner=OwnerMeta(userid='12040f7bfd874cd086b002bc598c80d4', username='tempest-ServerRescueNegativeTestJSON-438392507-project-member', projectid='d6a76767ddc64ede879746f16624d287', projectname='tempest-ServerRescueNegativeTestJSON-438392507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525575.5800831) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 01:59:35.583901 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 01:59:35.584465 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 01:59:35.586837 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 01:59:35.587123 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 01:59:35.588313 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 01:59:35.589758 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 01:59:35.589952 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 01:59:35.590108 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 01:59:35.590384 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 01:59:35.590525 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 01:59:35.590709 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 01:59:35.590906 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 01:59:35.591064 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 01:59:35.591426 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 01:59:35.591549 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 01:59:35.591725 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 01:59:35.610774 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:35.610774 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:35.615145 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976442498',display_name='tempest-ServerRescueNegativeTestJSON-server-1976442498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-1976442498',id=3,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-boe1ivgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:32Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=2a3c8563-52c1-48ac-b1e5-2a3ba54f4770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 01:59:35.615376 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:35.615852 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:35.616577 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:35.629945 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Updated VIF entry in instance network info cache for port 99790a0e-33c3-4174-abf4-8b83f563994b. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 01:59:35.630378 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Updating instance_info_cache with network_info: [{"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:35.695190 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 27 01:59:35.838410 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Updated VIF entry in instance network info cache for port d873a2d1-0f5a-4dc4-96df-c2cdf7c82151. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 01:59:35.838797 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Updating instance_info_cache with network_info: [{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:35.971512 np0000003818 sudo[110585]: pam_unix(sudo:session): session closed for user root Jun 27 01:59:35.973143 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Spawned new privsep daemon via rootwrap Jun 27 01:59:35.974280 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 27 01:59:35.974429 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 27 01:59:35.974913 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jun 27 01:59:35.974913 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110609 Jun 27 01:59:35.975311 np0000003818 nova-compute[98971]: WARNING oslo_privsep.priv_context [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] privsep daemon already running Jun 27 01:59:36.076731 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:36.114553 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] End _get_guest_xml xml= Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: instance-00000003 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 196608 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-server-1976442498 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 2026-06-27 01:59:35 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 192 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: True Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: bare Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: qcow2 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: virtio Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507-project-member Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: hvm Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 128 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: Jun 27 01:59:36.119799 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 01:59:36.123077 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Preparing to wait for external event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 01:59:36.123077 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:36.123077 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:36.123077 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:36.123077 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976442498',display_name='tempest-ServerRescueNegativeTestJSON-server-1976442498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-1976442498',id=3,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-boe1ivgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:32Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=2a3c8563-52c1-48ac-b1e5-2a3ba54f4770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 01:59:36.123661 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:36.123661 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:36.124422 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 01:59:36.125197 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.125775 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.125775 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 01:59:36.127873 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.127873 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4204c5f8-d4ee-5d4a-aa8c-b6bc7f90529e', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.128635 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.129169 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:36.129759 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.134698 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3188a1ff-1edb-4beb-b1bd-6ec8ef39467d req-0ac358f5-6bf1-40ea-a7f3-a9efa3ab68dd service nova] Releasing lock "refresh_cache-06009c3c-6614-40da-910b-bd7e2ac02dc0" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:36.260281 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.260475 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99790a0e-33, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.260885 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99790a0e-33, col_values=(('qos', UUID('231505bf-d81d-47d2-80b1-5e24133029c7')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.261547 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99790a0e-33, col_values=(('external_ids', {'iface-id': '99790a0e-33c3-4174-abf4-8b83f563994b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ca:3d', 'vm-uuid': '06009c3c-6614-40da-910b-bd7e2ac02dc0'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.267912 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:36.269449 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.270427 np0000003818 nova-compute[98971]: INFO os_vif [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') Jun 27 01:59:36.271017 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.271251 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd873a2d1-0f, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.271623 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd873a2d1-0f, col_values=(('qos', UUID('a1f212ae-4a7f-48c0-b84b-d1fae577d033')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.271904 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd873a2d1-0f, col_values=(('external_ids', {'iface-id': 'd873a2d1-0f5a-4dc4-96df-c2cdf7c82151', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:71:b7', 'vm-uuid': 'ea1483cd-9799-4aa0-b0c3-540d9ec1835e'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.276029 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.276029 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:36.285290 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.287359 np0000003818 nova-compute[98971]: INFO os_vif [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') Jun 27 01:59:36.287359 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.287571 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63f73704-ae, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.288329 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63f73704-ae, col_values=(('qos', UUID('c29903f9-2f37-411a-8eef-e96b60bcba7f')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.288518 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63f73704-ae, col_values=(('external_ids', {'iface-id': '63f73704-ae6b-45ab-bb38-54a802124fc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:6a:e0', 'vm-uuid': '2a3c8563-52c1-48ac-b1e5-2a3ba54f4770'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:36.296806 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:36.307615 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:36.308560 np0000003818 nova-compute[98971]: INFO os_vif [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') Jun 27 01:59:36.341376 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df8b8b82-df38-41b1-8278-0c7b69e04e75 req-813b6f01-6ca7-4bf4-b0a3-4513cbcbb4da service nova] Releasing lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:36.435035 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:36.623623 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Updated VIF entry in instance network info cache for port 63f73704-ae6b-45ab-bb38-54a802124fc0. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 01:59:36.623811 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Updating instance_info_cache with network_info: [{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:36.698305 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:36.698921 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:36.701832 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 01:59:36.701892 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Claim successful on node np0000003818 Jun 27 01:59:37.082820 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:37.131784 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ce98a963-cbed-48d7-94ed-1869fdcb3720 req-c4b29845-808f-44e3-883c-158266cf0f38 service nova] Releasing lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:37.410175 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:37.798318 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:37.798318 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:37.798318 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No VIF found with MAC fa:16:3e:86:ca:3d, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 01:59:37.798318 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Using config drive Jun 27 01:59:37.815989 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f4a6569f-849f-4b37-ad74-4ea75bafc9f4 req-6f9a8c71-dab7-4531-b37e-f06e320a147e service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:37.816302 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f4a6569f-849f-4b37-ad74-4ea75bafc9f4 req-6f9a8c71-dab7-4531-b37e-f06e320a147e service nova] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:37.816557 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f4a6569f-849f-4b37-ad74-4ea75bafc9f4 req-6f9a8c71-dab7-4531-b37e-f06e320a147e service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:37.819941 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f4a6569f-849f-4b37-ad74-4ea75bafc9f4 req-6f9a8c71-dab7-4531-b37e-f06e320a147e service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:37.822233 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f4a6569f-849f-4b37-ad74-4ea75bafc9f4 req-6f9a8c71-dab7-4531-b37e-f06e320a147e service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] No event matching network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b in dict_keys([('network-vif-plugged', '99790a0e-33c3-4174-abf4-8b83f563994b')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 01:59:37.822995 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f4a6569f-849f-4b37-ad74-4ea75bafc9f4 req-6f9a8c71-dab7-4531-b37e-f06e320a147e service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received unexpected event network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b for instance with vm_state building and task_state spawning. Jun 27 01:59:37.825808 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:37.826411 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:37.826592 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:93:71:b7, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 01:59:37.829116 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Using config drive Jun 27 01:59:37.836068 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:37.840821 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:37.840821 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:6f:6a:e0, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 01:59:37.841442 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Using config drive Jun 27 01:59:38.016834 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:59:38.016834 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:59:38.097123 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:38.310668 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:38.337746 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:38.349099 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:38.521459 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:59:38.909615 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Creating config drive at /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.config Jun 27 01:59:38.913492 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvs_p4rel {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:38.949043 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Creating config drive at /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk.config Jun 27 01:59:38.949649 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvs_p4rel" returned: 0 in 0.036s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:38.954875 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf351778j {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:38.981446 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf351778j" returned: 0 in 0.026s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:39.034890 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.336s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:39.035428 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 01:59:39.284188 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Creating config drive at /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.config Jun 27 01:59:39.287679 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqpiqg2s1 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:39.319471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqpiqg2s1" returned: 0 in 0.031s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:39.544433 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 01:59:39.544678 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 01:59:39.545147 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:39.545654 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:39.642660 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a7a7428581459bba5343e1a0dfc07e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fd76d60c45450e986685d262adcd78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 01:59:40.049070 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jun 27 01:59:40.119175 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.151837 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.240575 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.266281 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.367087 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.387477 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.548070 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.552995 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 01:59:40.571531 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.645276 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Successfully created port: 7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 01:59:40.694550 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:40.833779 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:41.166737 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-45d1cfd9-4ae6-45b5-99d4-79b1ca450689 req-b58d9660-64ea-46c7-972b-c332f05b3aae service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-plugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:41.167190 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-45d1cfd9-4ae6-45b5-99d4-79b1ca450689 req-b58d9660-64ea-46c7-972b-c332f05b3aae service nova] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:41.167190 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-45d1cfd9-4ae6-45b5-99d4-79b1ca450689 req-b58d9660-64ea-46c7-972b-c332f05b3aae service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:41.167456 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-45d1cfd9-4ae6-45b5-99d4-79b1ca450689 req-b58d9660-64ea-46c7-972b-c332f05b3aae service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:41.167599 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-45d1cfd9-4ae6-45b5-99d4-79b1ca450689 req-b58d9660-64ea-46c7-972b-c332f05b3aae service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Processing event network-vif-plugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 01:59:41.291397 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:41.566097 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Creating image(s) Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "/opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "/opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "/opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "d79c2379c93e3ea149acfe3582f5db21135c0c28" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:41.571133 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "d79c2379c93e3ea149acfe3582f5db21135c0c28" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:41.947568 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Successfully updated port: 7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 01:59:42.032549 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-changed-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:42.032549 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Refreshing instance network info cache due to event network-changed-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 01:59:42.032549 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] Acquiring lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:42.032729 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] Acquired lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:42.032782 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Refreshing network info cache for port 7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 01:59:42.091552 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:42.266996 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:42.268852 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] VM Started (Lifecycle Event) Jun 27 01:59:42.392171 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 01:59:42.395178 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 01:59:42.402180 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Instance spawned successfully. Jun 27 01:59:42.402478 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 01:59:42.414707 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:42.449134 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:42.539307 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:42.683173 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:42.788317 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:42.788317 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:42.788317 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] VM Paused (Lifecycle Event) Jun 27 01:59:42.918475 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 01:59:42.921742 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 01:59:42.921921 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 01:59:42.922209 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 01:59:42.922670 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 01:59:42.923188 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 01:59:43.061235 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:43.214615 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:43.217531 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:43.217531 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.part --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:43.263233 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d0dd0230-ef51-4fcc-974e-6c47eefdf38e req-911f6702-7f1b-4b40-9359-bd6dbca7db2f service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-plugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:43.264956 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d0dd0230-ef51-4fcc-974e-6c47eefdf38e req-911f6702-7f1b-4b40-9359-bd6dbca7db2f service nova] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:43.276393 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d0dd0230-ef51-4fcc-974e-6c47eefdf38e req-911f6702-7f1b-4b40-9359-bd6dbca7db2f service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:43.276393 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d0dd0230-ef51-4fcc-974e-6c47eefdf38e req-911f6702-7f1b-4b40-9359-bd6dbca7db2f service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:43.276393 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d0dd0230-ef51-4fcc-974e-6c47eefdf38e req-911f6702-7f1b-4b40-9359-bd6dbca7db2f service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] No waiting events found dispatching network-vif-plugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 01:59:43.276393 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-d0dd0230-ef51-4fcc-974e-6c47eefdf38e req-911f6702-7f1b-4b40-9359-bd6dbca7db2f service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received unexpected event network-vif-plugged-99790a0e-33c3-4174-abf4-8b83f563994b for instance with vm_state building and task_state spawning. Jun 27 01:59:43.286634 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:43.289700 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 01:59:43.295465 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.part --force-share --output=json" returned: 0 in 0.074s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:43.295465 np0000003818 nova-compute[98971]: DEBUG nova.virt.images [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] 7813580d-6730-4c93-aa15-fa46229391d6 was qcow2, converting to raw {{(pid=98971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 27 01:59:43.295465 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 01:59:43.295465 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.part /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.converted {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:43.344703 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:43.367745 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:43.435448 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Took 15.26 seconds to spawn the instance on the hypervisor. Jun 27 01:59:43.436928 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:43.564675 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cb0f1774-893f-460b-9821-ae1c18cac716 req-b4339126-4d4f-47a2-967f-a947e4576a90 service nova] Releasing lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:43.564675 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquired lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:43.583313 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 01:59:43.795353 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 01:59:43.796286 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:43.799264 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Started (Lifecycle Event) Jun 27 01:59:43.956937 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Took 20.70 seconds to build instance. Jun 27 01:59:44.021792 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.024295 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.191942 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:44.301921 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:44.306725 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:44.306725 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Paused (Lifecycle Event) Jun 27 01:59:44.381315 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.386997 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.394546 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.396902 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.434864 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:44.437538 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.part /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.converted" returned: 0 in 1.142s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.443164 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.converted --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:44.459181 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aa47036-ff21-45c2-a56e-83a2a684a770 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.217s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:44.517661 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28.converted --force-share --output=json" returned: 0 in 0.074s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.519543 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "d79c2379c93e3ea149acfe3582f5db21135c0c28" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 2.949s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:44.520140 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:44.524253 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:44.525713 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28 --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:44.606384 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28 --force-share --output=json" returned: 0 in 0.081s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.616556 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "d79c2379c93e3ea149acfe3582f5db21135c0c28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:44.616556 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "d79c2379c93e3ea149acfe3582f5db21135c0c28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:44.616556 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:44.617184 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:44.617477 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28 --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:44.693387 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28 --force-share --output=json" returned: 0 in 0.072s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.693387 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28,backing_fmt=raw /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:44.771471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28,backing_fmt=raw /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk 1073741824" returned: 0 in 0.079s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.771471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "d79c2379c93e3ea149acfe3582f5db21135c0c28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.161s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:44.771471 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28 --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:44.809219 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:44.814473 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:44.816664 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 01:59:44.845267 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d79c2379c93e3ea149acfe3582f5db21135c0c28 --force-share --output=json" returned: 0 in 0.074s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.845708 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 01:59:44.845708 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:44.922130 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:44.930176 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Cannot resize image /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 01:59:44.930176 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 01:59:44.930176 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Ensure instance console log exists: /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 01:59:44.930176 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:44.930176 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:44.930176 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:45.320374 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 01:59:45.320925 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:45.321210 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] VM Started (Lifecycle Event) Jun 27 01:59:45.530196 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Updating instance_info_cache with network_info: [{"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:45.826349 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:45.872766 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 01:59:46.033039 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Releasing lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:46.033461 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Instance network_info: |[{"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 01:59:46.038654 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Start _get_guest_xml network_info=[{"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:59:26Z,direct_url=,disk_format='qcow2',id=7813580d-6730-4c93-aa15-fa46229391d6,min_disk=0,min_ram=0,name='',owner='afb1b77a5d66464aa72ea4886b88249f',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:59:31Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'disk_bus': 'scsi', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '7813580d-6730-4c93-aa15-fa46229391d6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='7813580d-6730-4c93-aa15-fa46229391d6', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1856993571', uuid='117bc011-c34c-4a7e-8083-a032031054cb'), owner=OwnerMeta(userid='77a7a7428581459bba5343e1a0dfc07e', username='tempest-AttachSCSIVolumeTestJSON-534497572-project-member', projectid='83fd76d60c45450e986685d262adcd78', projectname='tempest-AttachSCSIVolumeTestJSON-534497572'), image=ImageMeta(id='7813580d-6730-4c93-aa15-fa46229391d6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525586.0454402) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:59:26Z,direct_url=,disk_format='qcow2',id=7813580d-6730-4c93-aa15-fa46229391d6,min_disk=0,min_ram=0,name='',owner='afb1b77a5d66464aa72ea4886b88249f',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:59:31Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 01:59:46.056708 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 01:59:46.057194 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 01:59:46.069288 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1856993571',display_name='tempest-AttachSCSIVolumeTestJSON-server-1856993571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-attachscsivolumetestjson-server-1856993571',id=4,image_ref='7813580d-6730-4c93-aa15-fa46229391d6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ90jUdf0z3gf9wxvWe5E6IpnxVE1P6Do8je5VDSKyaFZMwI6pXNQSmTU419mli9VL8ApVkN4YEyJDzrCeHRmP2VgcilIOWf1B7ij8KT+43S4p1Iye9la7l7FpfyZb6qQ==',key_name='tempest-keypair-2007110502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83fd76d60c45450e986685d262adcd78',ramdisk_id='',reservation_id='r-8z40e7t6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7813580d-6730-4c93-aa15-fa46229391d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-534497572',owner_user_name='tempest-AttachSCSIVolumeTestJSON-534497572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a7a7428581459bba5343e1a0dfc07e',uuid=117bc011-c34c-4a7e-8083-a032031054cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 01:59:46.069288 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Converting VIF {"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:46.071278 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:46.072563 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lazy-loading 'pci_devices' on Instance uuid 117bc011-c34c-4a7e-8083-a032031054cb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:46.294446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.376389 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:46.377026 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] VM Paused (Lifecycle Event) Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] End _get_guest_xml xml= Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 117bc011-c34c-4a7e-8083-a032031054cb Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: instance-00000004 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 196608 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: tempest-AttachSCSIVolumeTestJSON-server-1856993571 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 2026-06-27 01:59:46 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 192 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: True Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: bare Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: qcow2 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: scsi Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: scsi Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: virtio-scsi Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: tempest-AttachSCSIVolumeTestJSON-534497572-project-member Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: tempest-AttachSCSIVolumeTestJSON-534497572 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 117bc011-c34c-4a7e-8083-a032031054cb Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 117bc011-c34c-4a7e-8083-a032031054cb Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: hvm Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 128 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]:
Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]:
Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: Jun 27 01:59:46.575695 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 01:59:46.579668 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Preparing to wait for external event network-vif-plugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 01:59:46.579668 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:46.579668 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:46.579668 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:46.579668 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1856993571',display_name='tempest-AttachSCSIVolumeTestJSON-server-1856993571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-attachscsivolumetestjson-server-1856993571',id=4,image_ref='7813580d-6730-4c93-aa15-fa46229391d6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ90jUdf0z3gf9wxvWe5E6IpnxVE1P6Do8je5VDSKyaFZMwI6pXNQSmTU419mli9VL8ApVkN4YEyJDzrCeHRmP2VgcilIOWf1B7ij8KT+43S4p1Iye9la7l7FpfyZb6qQ==',key_name='tempest-keypair-2007110502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83fd76d60c45450e986685d262adcd78',ramdisk_id='',reservation_id='r-8z40e7t6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7813580d-6730-4c93-aa15-fa46229391d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-534497572',owner_user_name='tempest-AttachSCSIVolumeTestJSON-534497572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a7a7428581459bba5343e1a0dfc07e',uuid=117bc011-c34c-4a7e-8083-a032031054cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 01:59:46.580063 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Converting VIF {"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:46.580063 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:46.580063 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 01:59:46.580063 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.580063 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:46.580063 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 01:59:46.580339 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.580548 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50583b16-2f20-56e9-b58c-373c38d45d7f', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:46.584135 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.585161 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:46.587686 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.587903 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a1fcbb8-3c, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:46.588934 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a1fcbb8-3c, col_values=(('qos', UUID('35d5325f-d959-4152-826d-20f0982e1c0a')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:46.589171 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a1fcbb8-3c, col_values=(('external_ids', {'iface-id': '7a1fcbb8-3c56-4cbe-b88e-9d824146b14a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:7c:ae', 'vm-uuid': '117bc011-c34c-4a7e-8083-a032031054cb'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:46.592668 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.594411 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:46.596671 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.597561 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:46.597762 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:46.599672 np0000003818 nova-compute[98971]: INFO os_vif [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') Jun 27 01:59:46.815226 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:46.884060 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:46.888435 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:46.888668 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] VM Resumed (Lifecycle Event) Jun 27 01:59:47.087375 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:47.101187 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:47.369271 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:47.369668 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:47.391298 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:47.395139 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 01:59:47.673956 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:47.673956 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:47.678127 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 01:59:47.678127 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Claim successful on node np0000003818 Jun 27 01:59:47.873927 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lazy-loading 'flavor' on Instance uuid 06009c3c-6614-40da-910b-bd7e2ac02dc0 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:48.118823 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No BDM found with device name sda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:48.119031 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:48.119165 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No VIF found with MAC fa:16:3e:b4:7c:ae, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 01:59:48.119626 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Using config drive Jun 27 01:59:48.628446 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:48.873451 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Creating config drive at /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk.config Jun 27 01:59:48.882639 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:48.886302 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprrfe01ue {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:48.913129 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprrfe01ue" returned: 0 in 0.026s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:49.060121 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:59:49.060377 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:59:49.406442 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.424405 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.436861 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.561910 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.565732 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:59:49.801545 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.815054 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.815650 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:49.828859 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:50.074477 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.402s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:50.074966 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 01:59:50.583515 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 01:59:50.584269 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 01:59:50.584662 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:50.585062 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:50.707812 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '629334c529ac4873ad0ea78a432c130a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1bee9ee1c04149b8557934c3938a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 01:59:50.803058 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:50.803058 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] VM Started (Lifecycle Event) Jun 27 01:59:50.826597 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:50.826597 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:50.826939 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Attaching volume 9f6195d3-ab0a-40da-bf52-f23586953fda to /dev/vdb Jun 27 01:59:50.908376 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 01:59:50.909057 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpk78n1kom/privsep.sock'] Jun 27 01:59:50.917312 np0000003818 sudo[111260]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpk78n1kom/privsep.sock Jun 27 01:59:50.918135 np0000003818 sudo[111260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 27 01:59:51.084602 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 01:59:51.214297 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 27 01:59:51.214442 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 01:59:51.214442 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 01:59:51.214536 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:51.214580 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 01:59:51.214580 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 01:59:51.214670 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 01:59:51.214899 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:51.214899 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 27 01:59:51.308472 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:51.322775 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:51.322775 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] VM Paused (Lifecycle Event) Jun 27 01:59:51.494316 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Successfully created port: e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 01:59:51.576264 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 27 01:59:51.576435 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 01:59:51.576435 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 01:59:51.576521 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:51.576558 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 01:59:51.576639 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 01:59:51.576678 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 01:59:51.576728 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 01:59:51.576763 np0000003818 nova-compute[98971]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 27 01:59:51.588843 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 01:59:51.598224 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:51.816521 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 01:59:51.819149 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 01:59:51.858178 np0000003818 sudo[111260]: pam_unix(sudo:session): session closed for user root Jun 27 01:59:51.859625 np0000003818 nova-compute[98971]: INFO oslo.privsep.daemon [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Spawned new privsep daemon via rootwrap Jun 27 01:59:52.000916 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 01:59:52.001308 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.nvmeof [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 27 01:59:52.037518 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:52.055008 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 01:59:52.055216 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 01:59:52.065789 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 01:59:52.067382 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe86:ca3d', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::a43a:31ff:fe80:bf14', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b'] Jun 27 01:59:52.067543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 01:59:52.067822 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 01:59:52.069434 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] <== get_connector_properties: return (1159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 01:59:52.069434 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Updating existing volume attachment record: 0f31b6ea-1b16-4901-827a-2a83e536a933 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 01:59:52.089701 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:52.322029 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 01:59:52.487503 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Successfully updated port: e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 01:59:52.552669 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-changed-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:52.552669 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Refreshing instance network info cache due to event network-changed-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 01:59:52.552669 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] Acquiring lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:52.552669 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] Acquired lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:52.552669 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Refreshing network info cache for port e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 01:59:52.598874 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 01:59:52.600121 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 01:59:52.600390 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Creating image(s) Jun 27 01:59:52.600919 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:52.601118 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "/opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:52.601637 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "/opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:52.602207 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:52.605429 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:52.607337 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:52.681504 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:52.681863 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:52.682663 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.075s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:52.684216 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:52.684767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:52.686753 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:52.690431 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 01:59:52.690897 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:52.691846 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connector [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Factory for ISCSI on None {{(pid=98971) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 27 01:59:52.692176 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.010s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:52.692505 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 01:59:52.701947 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f6195d3-ab0a-40da-bf52-f23586953fda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 01:59:52.702766 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 01:59:52.704138 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 01:59:52.706892 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f6195d3-ab0a-40da-bf52-f23586953fda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 01:59:52.720624 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 01:59:52.721136 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 01:59:52.722118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 01:59:52.722717 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 01:59:52.722916 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 01:59:52.723172 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 01:59:52.730894 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-919fb148-3e24-48ea-97d1-33f765fd449a req-1fe9d4c2-c7bf-4c7a-932b-97f75344d444 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:52.731187 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-919fb148-3e24-48ea-97d1-33f765fd449a req-1fe9d4c2-c7bf-4c7a-932b-97f75344d444 service nova] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:52.731673 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-919fb148-3e24-48ea-97d1-33f765fd449a req-1fe9d4c2-c7bf-4c7a-932b-97f75344d444 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:52.731839 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-919fb148-3e24-48ea-97d1-33f765fd449a req-1fe9d4c2-c7bf-4c7a-932b-97f75344d444 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:52.732028 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-919fb148-3e24-48ea-97d1-33f765fd449a req-1fe9d4c2-c7bf-4c7a-932b-97f75344d444 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] No waiting events found dispatching network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 01:59:52.732180 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-919fb148-3e24-48ea-97d1-33f765fd449a req-1fe9d4c2-c7bf-4c7a-932b-97f75344d444 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received unexpected event network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c for instance with vm_state building and task_state spawning. Jun 27 01:59:52.735198 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 01:59:52.735198 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:52.740346 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 01:59:52.740346 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda] added Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 01:59:52.746416 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:52.746693 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 01:59:52.747094 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 01:59:52.747955 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda] added Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 01:59:52.752937 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 01:59:52.767216 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.072s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:52.767216 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:52.824526 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk 1073741824" returned: 0 in 0.060s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:52.825138 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.140s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:52.825565 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:52.894278 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.068s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:52.894685 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 01:59:52.894930 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:52.965889 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:52.966398 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Cannot resize image /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 01:59:52.966892 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 01:59:52.967111 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Ensure instance console log exists: /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 01:59:52.967432 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:52.967667 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:52.967792 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:52.992711 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 01:59:53.055416 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:53.149385 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:53.335482 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:53.748451 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 01:59:53.755988 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: # END RECORD Jun 27 01:59:53.762404 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: # END RECORD Jun 27 01:59:53.769395 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:53.784377 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:53.793161 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 27 01:59:53.793161 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 01:59:53.793376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 27 01:59:53.793376 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 01:59:53.793552 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 27 01:59:53.793552 np0000003818 nova-compute[98971]: Jun 27 01:59:53.798148 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:53.809422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 27 01:59:53.809422 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 01:59:53.809674 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 27 01:59:53.809674 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 01:59:53.820848 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 27 01:59:53.820848 np0000003818 nova-compute[98971]: Jun 27 01:59:53.838258 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4865619c-9a2a-489d-a28b-e9c81c30d6b0 req-4969b9fd-82f2-47a7-8325-8326894b3f12 service nova] Releasing lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:53.839090 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquired lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 01:59:53.839377 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 01:59:53.935904 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.936414 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.936773 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.937687 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.938081 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.938308 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.938724 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:53.938827 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 01:59:53.939065 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 01:59:54.444353 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:54.444353 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:54.455364 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:54.455364 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 01:59:54.455364 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 01:59:54.710926 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:54.842114 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.50.100,3260] Jun 27 01:59:54.842114 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.50.100,3260] successful. Jun 27 01:59:54.842114 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:54.846559 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.40.100,3260] Jun 27 01:59:54.846559 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.40.100,3260] successful. Jun 27 01:59:54.846559 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:54.860677 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:54.868674 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 01:59:54.872886 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.872886 np0000003818 nova-compute[98971]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.872886 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 01:59:54.873085 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.873085 np0000003818 nova-compute[98971]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.873085 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 01:59:54.873411 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.151s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 01:59:54.873491 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 01:59:54.874824 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 01:59:54.874824 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 01:59:54.880137 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.880137 np0000003818 nova-compute[98971]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.880137 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 01:59:54.880305 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.880305 np0000003818 nova-compute[98971]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 01:59:54.880305 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 01:59:54.880518 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.159s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 01:59:54.880631 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 01:59:54.881363 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 01:59:54.881363 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 01:59:54.890543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 01:59:54.890543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f6195d3-ab0a-40da-bf52-f23586953fda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 01:59:54.895258 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 01:59:54.898489 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f6195d3-ab0a-40da-bf52-f23586953fda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 01:59:54.950063 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Updating instance_info_cache with network_info: [{"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 01:59:55.456240 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Releasing lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 01:59:55.456453 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Instance network_info: |[{"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 01:59:55.458212 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Start _get_guest_xml network_info=[{"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 01:59:55.460681 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:59:55.462608 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-96634270', uuid='c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1'), owner=OwnerMeta(userid='629334c529ac4873ad0ea78a432c130a', username='tempest-VolumesAssistedSnapshotsTest-909756397-project-member', projectid='6f1bee9ee1c04149b8557934c3938a58', projectname='tempest-VolumesAssistedSnapshotsTest-909756397'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525595.462102) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 01:59:55.463560 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 01:59:55.464629 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 01:59:55.465110 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 01:59:55.465543 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 01:59:55.466736 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 01:59:55.467072 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 01:59:55.467276 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 01:59:55.467482 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 01:59:55.467551 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 01:59:55.467685 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 01:59:55.467823 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 01:59:55.468161 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 01:59:55.468304 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 01:59:55.469174 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 01:59:55.469174 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 01:59:55.470110 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 01:59:55.487016 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-96634270',display_name='tempest-VolumesAssistedSnapshotsTest-server-96634270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesassistedsnapshotstest-server-96634270',id=5,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRGxiDtl5FDdcjeTmvBt0hdqSPFmnwpnq56FTAgP91UPLrodZ20BGyzZHdYtHsE9XUHJI3d6bUnEdg4vhTisNQ+EHesKo7Rb7kHPs8VIexny4n73fUE/4S4Zo3WGyhRdw==',key_name='tempest-keypair-2100306775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f1bee9ee1c04149b8557934c3938a58',ramdisk_id='',reservation_id='r-ztbvuy3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-909756397',owner_user_name='tempest-VolumesAssistedSnapshotsTest-909756397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='629334c529ac4873ad0ea78a432c130a',uuid=c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 01:59:55.487241 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Converting VIF {"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:55.487742 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:55.488456 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lazy-loading 'pci_devices' on Instance uuid c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:55.491272 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:55.571241 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:55.572175 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:55.660357 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:55.664059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:55.725881 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 01:59:55.749568 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:55.750280 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:55.843345 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:55.847009 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:55.915391 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:55.916315 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] End _get_guest_xml xml= Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: instance-00000005 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 196608 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: tempest-VolumesAssistedSnapshotsTest-server-96634270 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 2026-06-27 01:59:55 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 192 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: True Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: bare Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: qcow2 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 0 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: virtio Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: tempest-VolumesAssistedSnapshotsTest-909756397-project-member Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: tempest-VolumesAssistedSnapshotsTest-909756397 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: hvm Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 128 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: 1 Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Nehalem Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: Jun 27 01:59:56.002877 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 01:59:56.006205 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Preparing to wait for external event network-vif-plugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 01:59:56.006205 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:56.006205 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:56.006205 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:56.006205 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T01:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-96634270',display_name='tempest-VolumesAssistedSnapshotsTest-server-96634270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesassistedsnapshotstest-server-96634270',id=5,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRGxiDtl5FDdcjeTmvBt0hdqSPFmnwpnq56FTAgP91UPLrodZ20BGyzZHdYtHsE9XUHJI3d6bUnEdg4vhTisNQ+EHesKo7Rb7kHPs8VIexny4n73fUE/4S4Zo3WGyhRdw==',key_name='tempest-keypair-2100306775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f1bee9ee1c04149b8557934c3938a58',ramdisk_id='',reservation_id='r-ztbvuy3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-909756397',owner_user_name='tempest-VolumesAssistedSnapshotsTest-909756397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T01:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='629334c529ac4873ad0ea78a432c130a',uuid=c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 01:59:56.006545 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Converting VIF {"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 01:59:56.006811 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 01:59:56.007160 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 01:59:56.008350 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:56.008701 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:56.009120 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:56.010060 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 01:59:56.012815 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:56.020888 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:56.022297 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3041ee31-4149-517a-80ae-213afb7d9557', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:56.027465 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:56.030223 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:56.036360 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:56.036360 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b40d5c-59, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:56.037439 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4b40d5c-59, col_values=(('qos', UUID('67a2272c-7b20-4ce8-8cb3-4296e56b5b96')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:56.037439 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4b40d5c-59, col_values=(('external_ids', {'iface-id': 'e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:ec:1a', 'vm-uuid': 'c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 01:59:56.039285 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:56.041433 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 01:59:56.046723 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:56.047314 np0000003818 nova-compute[98971]: INFO os_vif [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') Jun 27 01:59:56.092878 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:56.093517 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:56.162884 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:56.166825 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 01:59:56.168497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:56.188945 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.020s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:56.189306 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=52789MB free_disk=74.65104293823242GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 01:59:56.189456 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:56.189898 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:56.742872 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Found WWN 3300000004aaa46a4 for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 01:59:56.743332 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.039s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 01:59:56.743539 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] <== connect_volume: return (4041ms) {'type': 'block', 'scsi_wwn': '3300000004aaa46a4', 'path': '/dev/dm-0', 'multipath_id': '3300000004aaa46a4'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 01:59:56.743774 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004aaa46a4', 'path': '/dev/dm-0', 'multipath_id': '3300000004aaa46a4'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 01:59:56.745905 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lazy-loading 'flavor' on Instance uuid 06009c3c-6614-40da-910b-bd7e2ac02dc0 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 01:59:56.850995 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:57.091644 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:57.252603 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Attempting to attach volume 9f6195d3-ab0a-40da-bf52-f23586953fda with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] attach device xml: Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: 9f6195d3-ab0a-40da-bf52-f23586953fda Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: Jun 27 01:59:57.256696 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 01:59:57.271646 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 01:59:57.272269 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 117bc011-c34c-4a7e-8083-a032031054cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 01:59:57.272269 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 06009c3c-6614-40da-910b-bd7e2ac02dc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 01:59:57.349946 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:57.350249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:57.574899 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:57.574899 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:57.575130 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] No VIF found with MAC fa:16:3e:2a:ec:1a, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 01:59:57.577016 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Using config drive Jun 27 01:59:57.777907 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 27 01:59:57.777907 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 01:59:57.777907 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance ea1483cd-9799-4aa0-b0c3-540d9ec1835e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 01:59:57.777907 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 01:59:57.777907 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:59:56 up 28 min, 2 users, load average: 7.12, 3.50, 1.67\n', 'num_instances': '5', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '5', 'num_proj_8d954fa627b74bda8e96ce7fdea76d6e': '1', 'io_workload': '4', 'num_vm_building': '4', 'num_task_spawning': '4', 'num_proj_d6a76767ddc64ede879746f16624d287': '2', 'num_proj_83fd76d60c45450e986685d262adcd78': '1', 'num_proj_6f1bee9ee1c04149b8557934c3938a58': '1'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 01:59:57.853608 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:57.933644 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:57.933966 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:58.085570 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 01:59:58.280376 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Creating config drive at /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk.config Jun 27 01:59:58.287822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpitvisoi_ {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 01:59:58.301544 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 01:59:58.301791 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 01:59:58.321824 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpitvisoi_" returned: 0 in 0.034s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 01:59:58.437378 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 01:59:58.460715 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:58.495679 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-eb116f51-b679-49bd-a1a3-34fe20802cd3 req-319c805d-00c7-42fc-8efc-0e8a0cd719a9 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 01:59:58.495887 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-eb116f51-b679-49bd-a1a3-34fe20802cd3 req-319c805d-00c7-42fc-8efc-0e8a0cd719a9 service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:58.496087 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-eb116f51-b679-49bd-a1a3-34fe20802cd3 req-319c805d-00c7-42fc-8efc-0e8a0cd719a9 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:58.496226 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-eb116f51-b679-49bd-a1a3-34fe20802cd3 req-319c805d-00c7-42fc-8efc-0e8a0cd719a9 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:58.498721 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-eb116f51-b679-49bd-a1a3-34fe20802cd3 req-319c805d-00c7-42fc-8efc-0e8a0cd719a9 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No event matching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 in dict_keys([('network-vif-plugged', 'd873a2d1-0f5a-4dc4-96df-c2cdf7c82151')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 01:59:58.498721 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-eb116f51-b679-49bd-a1a3-34fe20802cd3 req-319c805d-00c7-42fc-8efc-0e8a0cd719a9 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state building and task_state spawning. Jun 27 01:59:58.808640 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 01:59:58.836192 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:58.860199 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:58.980027 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:58.980206 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:58.980206 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 01:59:58.980754 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] No VIF found with MAC fa:16:3e:86:ca:3d, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 01:59:58.988172 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:59.034864 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 01:59:59.244821 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:59.246790 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:59.250060 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:59.268247 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:59.317644 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 01:59:59.317833 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.128s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 01:59:59.321089 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.70 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 01:59:59.321089 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.859s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 01:59:59.321927 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 01:59:59.322142 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Claim successful on node np0000003818 Jun 27 01:59:59.798373 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 01:59:59.846993 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 01:59:59.846993 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] VM Started (Lifecycle Event) Jun 27 02:00:00.349256 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:00.350891 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:00.351045 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] VM Paused (Lifecycle Event) Jun 27 02:00:00.546879 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-593d8bdb-f21c-4ff8-939c-1d6f3a00803d tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.720s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.576431 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.576620 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.576769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.576884 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.577028 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No event matching network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 in dict_keys([('network-vif-plugged', '63f73704-ae6b-45ab-bb38-54a802124fc0')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:00.577149 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received unexpected event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with vm_state building and task_state spawning. Jun 27 02:00:00.577249 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.577363 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.578516 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.579039 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.579160 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Processing event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:00.579325 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.579477 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.579616 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.580005 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance event wait completed in 18 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:00.580156 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.580296 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:00.580439 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state building and task_state spawning. Jun 27 02:00:00.580563 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.580680 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.580808 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.580928 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.581074 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Processing event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:00.581299 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.581385 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.581543 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.581859 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.581859 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:00.581948 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received unexpected event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with vm_state building and task_state spawning. Jun 27 02:00:00.582108 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.582661 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.583210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance event wait completed in 18 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:00.583435 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.583602 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.583807 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] No event matching network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a in dict_keys([('network-vif-plugged', '7a1fcbb8-3c56-4cbe-b88e-9d824146b14a')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:00.583910 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received unexpected event network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a for instance with vm_state building and task_state spawning. Jun 27 02:00:00.584079 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-plugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.584231 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.584383 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.584512 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.584652 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Processing event network-vif-plugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:00.584921 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-plugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:00.585074 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:00.585207 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:00.585437 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:00.586044 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] No waiting events found dispatching network-vif-plugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:00.589525 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Instance event wait completed in 9 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:00.592491 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cba69d13-57fd-4e49-8a68-c7c4e1a4c852 req-feeacbcf-5fa3-4a88-8b29-8881ef1d712e service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received unexpected event network-vif-plugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a for instance with vm_state building and task_state spawning. Jun 27 02:00:00.593001 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:00.593545 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:00.594442 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:00.595736 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance spawned successfully. Jun 27 02:00:00.596203 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:00.597688 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance spawned successfully. Jun 27 02:00:00.598090 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Instance spawned successfully. Jun 27 02:00:00.599007 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:00.600580 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:00.602921 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:00.603368 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:00.603796 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:00.604465 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:00.746049 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:00.746049 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:00.853431 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:00.857940 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:01.042304 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:01.119315 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.120984 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.122748 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.122748 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.122748 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.125144 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.127961 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Took 19.56 seconds to spawn the instance on the hypervisor. Jun 27 02:00:01.129540 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:01.140129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.140129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.140129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.140129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.140129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.140129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:01.251617 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:00:01.358362 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:00:01.358362 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:01.359189 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Resumed (Lifecycle Event) Jun 27 02:00:01.647351 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Took 31.18 seconds to spawn the instance on the hypervisor. Jun 27 02:00:01.648020 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:01.652176 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Took 28.33 seconds to spawn the instance on the hypervisor. Jun 27 02:00:01.652327 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:01.679438 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Took 25.06 seconds to build instance. Jun 27 02:00:01.773611 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.455s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:01.774420 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:00:01.777658 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.744s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:01.786837 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:00:01.786837 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Claim successful on node np0000003818 Jun 27 02:00:01.828681 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:01.828681 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:01.829248 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:01.830355 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:01.830355 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:01.837278 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Terminating instance Jun 27 02:00:01.864648 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:01.869066 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:02.093991 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:02.173344 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Took 37.83 seconds to build instance. Jun 27 02:00:02.178801 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Took 33.84 seconds to build instance. Jun 27 02:00:02.184944 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c50f9f9-bfb6-4658-bd79-7e6d7deb0182 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.575s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:02.284526 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:00:02.284844 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:00:02.285531 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:02.287506 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:02.350291 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:00:02.374758 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:02.374758 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] VM Resumed (Lifecycle Event) Jun 27 02:00:02.376561 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:02.380170 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:02.408807 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:02.438190 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:02.660319 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59f6ef5fcd66441e91a33a1c88bad260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c1552799934b6c80ecd7f89d497a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:00:02.663490 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c628e3a5-d7e5-4289-9a07-af93aff6465e req-76d524db-aa9e-4001-bb22-3de0307d454b service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:02.663703 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c628e3a5-d7e5-4289-9a07-af93aff6465e req-76d524db-aa9e-4001-bb22-3de0307d454b service nova] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:02.663884 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c628e3a5-d7e5-4289-9a07-af93aff6465e req-76d524db-aa9e-4001-bb22-3de0307d454b service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:02.664114 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c628e3a5-d7e5-4289-9a07-af93aff6465e req-76d524db-aa9e-4001-bb22-3de0307d454b service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:02.667050 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c628e3a5-d7e5-4289-9a07-af93aff6465e req-76d524db-aa9e-4001-bb22-3de0307d454b service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] No waiting events found dispatching network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:02.667711 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c628e3a5-d7e5-4289-9a07-af93aff6465e req-76d524db-aa9e-4001-bb22-3de0307d454b service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:00:02.675374 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f02142d7-c16c-4dca-9fd2-109b420359e7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 39.346s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:02.682100 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ca8eb54f-c2b1-422a-930e-9585f95d8ff2 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 35.353s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:02.731371 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Instance destroyed successfully. Jun 27 02:00:02.732926 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lazy-loading 'resources' on Instance uuid 06009c3c-6614-40da-910b-bd7e2ac02dc0 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:02.791068 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:00:02.882430 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:02.890516 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:03.135252 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Rescuing Jun 27 02:00:03.135485 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:03.135680 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:03.135931 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:03.241179 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-479865311',display_name='tempest-DeleteServersTestJSON-server-479865311',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-deleteserverstestjson-server-479865311',id=1,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T01:59:43Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d954fa627b74bda8e96ce7fdea76d6e',ramdisk_id='',reservation_id='r-vzq6tis0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1978332501',owner_user_name='tempest-DeleteServersTestJSON-1978332501-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T01:59:43Z,user_data=None,user_id='e456b31af1694ba7806b8314709ff580',uuid=06009c3c-6614-40da-910b-bd7e2ac02dc0,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:00:03.241459 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Converting VIF {"id": "99790a0e-33c3-4174-abf4-8b83f563994b", "address": "fa:16:3e:86:ca:3d", "network": {"id": "d53e28c2-2ddf-4cce-ad62-5366cef429b3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1365498405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d954fa627b74bda8e96ce7fdea76d6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99790a0e-33", "ovs_interfaceid": "99790a0e-33c3-4174-abf4-8b83f563994b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:03.242157 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:03.242500 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:00:03.244753 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:03.245028 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99790a0e-33, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:03.246408 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:03.249152 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:03.249152 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:03.250031 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:03.250177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=231505bf-d81d-47d2-80b1-5e24133029c7) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:03.251027 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:03.252796 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:03.256173 np0000003818 nova-compute[98971]: INFO os_vif [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ca:3d,bridge_name='br-int',has_traffic_filtering=True,id=99790a0e-33c3-4174-abf4-8b83f563994b,network=Network(d53e28c2-2ddf-4cce-ad62-5366cef429b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99790a0e-33') Jun 27 02:00:03.257903 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:00:03.258168 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f6195d3-ab0a-40da-bf52-f23586953fda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:03.258295 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:03.258647 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:03.259044 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f6195d3-ab0a-40da-bf52-f23586953fda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:00:03.259269 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:00:03.286666 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 02:00:03.286666 np0000003818 nova-compute[98971]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 02:00:03.286666 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:03.286854 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 02:00:03.286854 np0000003818 nova-compute[98971]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda (non-flash) Jun 27 02:00:03.286854 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:03.287045 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', '4')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:00:03.287211 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', '4')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:00:03.288658 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda', '3')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:00:03.289262 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Resulting device map defaultdict(. at 0x7decc05963e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'): ({'sdb'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:00:03.289522 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Removing multipathed devices sdb, sdc {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:00:03.289879 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Flush multipath device 3300000004aaa46a4 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:00:03.323277 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:00:03.344713 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:03.345082 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:03.364070 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:00:03.394428 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] During sync_power_state the instance has a pending task (rescuing). Skip. Jun 27 02:00:03.394920 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:03.395055 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] VM Resumed (Lifecycle Event) Jun 27 02:00:03.422080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:00:03.422293 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:00:03.423584 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:00:03.439753 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:00:03.440054 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:00:03.454369 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:03.478052 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully created port: 94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:03.483198 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.40.100,3260] Jun 27 02:00:03.483198 np0000003818 nova-compute[98971]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.40.100,3260] successful. Jun 27 02:00:03.483198 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:03.497057 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:03.507617 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:03.534188 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.50.100,3260] Jun 27 02:00:03.534188 np0000003818 nova-compute[98971]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-9f6195d3-ab0a-40da-bf52-f23586953fda, portal: 192.168.50.100,3260] successful. Jun 27 02:00:03.534188 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:03.544923 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:03.545326 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:03.545605 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] <== disconnect_volume: return (286ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:03.545605 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:00:03.545937 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Deleting instance files /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0_del Jun 27 02:00:03.546666 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Deletion of /opt/stack/data/nova/instances/06009c3c-6614-40da-910b-bd7e2ac02dc0_del complete Jun 27 02:00:03.638011 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:03.849241 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:00:03.893750 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:03.898278 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:03.905988 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:03.942854 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-changed-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:03.944829 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Refreshing instance network info cache due to event network-changed-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:03.944829 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] Acquiring lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:03.944829 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] Acquired lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:03.944829 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Refreshing network info cache for port 7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:04.055464 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:04.059324 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Took 1.71 seconds to destroy the instance on the hypervisor. Jun 27 02:00:04.060028 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:00:04.062026 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:00:04.062184 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:00:04.062461 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:04.076135 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully created port: 5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:04.216243 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:04.286670 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Updating instance_info_cache with network_info: [{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:04.309339 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:00:04.358463 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.581s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:04.359054 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:00:04.409618 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999359979000019 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:04.410050 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998921493999887 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:04.410240 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99870982099992 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:04.448718 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:04.607102 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully created port: bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:04.751045 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:04.751468 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] Acquiring lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:04.751534 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:04.751682 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:04.752051 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] No waiting events found dispatching network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:04.752051 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-unplugged-99790a0e-33c3-4174-abf4-8b83f563994b for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:00:04.752051 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Received event network-vif-deleted-99790a0e-33c3-4174-abf4-8b83f563994b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:04.752290 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Neutron deleted interface 99790a0e-33c3-4174-abf4-8b83f563994b; detaching it from the instance and deleting it from the info cache Jun 27 02:00:04.754551 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-50836849-1ee8-4039-bed9-d9507ab85424 req-f360fccf-8f60-4116-b8bb-4c9d26b6687c service nova] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Detach interface failed, port_id=99790a0e-33c3-4174-abf4-8b83f563994b, reason: Instance 06009c3c-6614-40da-910b-bd7e2ac02dc0 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:00:04.791122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:04.817154 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Booting with volume a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 at /dev/vda Jun 27 02:00:04.867820 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:00:04.867820 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:00:04.868428 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:04.871692 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:04.899677 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:04.917662 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:04.945066 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:04.975697 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:04.975916 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:04.989735 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:04.991888 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9'] Jun 27 02:00:04.991888 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:04.991888 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:04.991888 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:04.991888 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating existing volume attachment record: a89baa02-d067-4f3e-a62c-943b240d71dc {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:05.001073 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:05.047481 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:05.210695 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully created port: feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:05.222518 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Updated VIF entry in instance network info cache for port 7a1fcbb8-3c56-4cbe-b88e-9d824146b14a. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:05.222877 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Updating instance_info_cache with network_info: [{"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:05.304527 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f496e8289a4abc80ec16cc9d3cba52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6202ba11720e4772878029919cc6d682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:00:05.369017 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:00:05.478229 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:05.478674 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:05.550994 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Took 1.49 seconds to deallocate network for instance. Jun 27 02:00:05.725745 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-27b26ada-7561-43d8-9820-8aa99fe1fb73 req-fd601ac5-d85b-4be1-a23a-c1ec2d538f4b service nova] Releasing lock "refresh_cache-117bc011-c34c-4a7e-8083-a032031054cb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:05.983037 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:00:06.032315 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully created port: 7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:06.046477 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-plugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:06.047275 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:06.047426 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:06.047597 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:06.048485 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Processing event network-vif-plugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:06.049288 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-plugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:06.049944 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:06.051144 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:06.051416 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:06.051612 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:06.051798 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] No waiting events found dispatching network-vif-plugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:06.052357 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-239bde38-5ef3-4c1a-bf23-1f305185f502 req-c8a2bf4d-463e-44f6-827d-ae64f3044354 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received unexpected event network-vif-plugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c for instance with vm_state building and task_state spawning. Jun 27 02:00:06.058064 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:06.058160 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] VM Resumed (Lifecycle Event) Jun 27 02:00:06.060526 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:06.065764 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Instance spawned successfully. Jun 27 02:00:06.066252 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:06.128020 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully created port: 4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:06.157079 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Took 0.61 seconds to detach 1 volumes for instance. Jun 27 02:00:06.473059 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:06.481448 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:06.495721 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:06.564164 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:06.572523 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:06.577253 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully created port: 709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:06.595966 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:06.597289 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.011s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:06.598255 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:06.598255 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:06.598749 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:06.599195 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:06.599356 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:06.599961 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:06.609687 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:00:06.610536 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Claim successful on node np0000003818 Jun 27 02:00:06.665173 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:06.686778 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Booting with volume d0833d39-4314-447f-8696-58f17281209d at /dev/vdb Jun 27 02:00:06.725648 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:06.734292 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:06.763248 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:06.778914 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:06.806858 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:06.832936 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:06.833822 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:06.836524 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance destroyed successfully. Jun 27 02:00:06.838418 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'numa_topology' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:06.845445 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:06.849420 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9'] Jun 27 02:00:06.849564 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:06.849714 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:06.851445 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:06.851812 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating existing volume attachment record: 11753ad4-4336-470b-ae8e-b805b6af06cd {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:06.880149 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:00:07.053923 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: 94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:07.075246 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:00:07.076509 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.99972956800002 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:07.099179 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:07.110811 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Took 14.51 seconds to spawn the instance on the hypervisor. Jun 27 02:00:07.110811 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:07.149345 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a45ebe92-6d2c-414d-8489-58e9ffc77a3e req-4b923d6f-500d-41a9-af71-37820731c84f service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:07.149850 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a45ebe92-6d2c-414d-8489-58e9ffc77a3e req-4b923d6f-500d-41a9-af71-37820731c84f service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:07.150039 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a45ebe92-6d2c-414d-8489-58e9ffc77a3e req-4b923d6f-500d-41a9-af71-37820731c84f service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:07.150180 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a45ebe92-6d2c-414d-8489-58e9ffc77a3e req-4b923d6f-500d-41a9-af71-37820731c84f service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:07.150329 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a45ebe92-6d2c-414d-8489-58e9ffc77a3e req-4b923d6f-500d-41a9-af71-37820731c84f service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:07.150480 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-a45ebe92-6d2c-414d-8489-58e9ffc77a3e req-4b923d6f-500d-41a9-af71-37820731c84f service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received unexpected event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with vm_state active and task_state rescuing. Jun 27 02:00:07.194425 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:07.194733 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-94af59a9-6083-4695-95fd-a6d5a45d3081. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:07.195059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:07.195497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:07.195646 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port 94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:07.216479 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully created port: ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:07.343860 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Attempting rescue Jun 27 02:00:07.344985 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 27 02:00:07.351645 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance directory exists: not creating {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 27 02:00:07.352996 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Creating image(s) Jun 27 02:00:07.354771 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:07.354771 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:07.354771 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:07.354771 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:07.389121 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Booting with volume 5a722800-5408-438a-9b21-7df978337edb at /dev/vda Jun 27 02:00:07.454650 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:07.467761 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:07.488282 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:07.511875 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:07.514025 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:07.523683 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:07.524803 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9'] Jun 27 02:00:07.524963 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:07.525058 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:07.525314 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:07.525552 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating existing volume attachment record: 8fe19358-5a94-4939-91f2-d648e81bb5c4 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:07.646206 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Took 20.04 seconds to build instance. Jun 27 02:00:07.698630 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:07.808202 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully created port: 911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:07.814873 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:07.857898 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:07.862207 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:07.867334 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:07.868940 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:07.869729 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:07.870039 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:07.873983 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:07.874444 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:07.976751 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.102s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:07.977295 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:08.029943 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue" returned: 0 in 0.051s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:08.030488 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.161s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:08.030882 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'migration_context' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:08.103649 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:08.146398 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.548s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:08.252568 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:08.304480 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:08.304823 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:08.458549 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: 4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:08.490418 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully created port: 3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:08.538322 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:08.538762 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:00:08.539304 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Start _get_guest_xml network_info=[{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:6f:6a:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue={'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:08.539655 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'resources' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:08.562361 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Booting with volume d300a977-f409-4d83-9498-6151a32ce522 at /dev/vdc Jun 27 02:00:08.605800 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df3d03c5-41e4-445a-b2ed-5462930cc45d req-803aa47d-377a-4276-b499-32fca71ebc0a service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:08.626549 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:08.644782 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:08.678658 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:08.707113 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:08.707486 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:08.716097 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:08.717341 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9'] Jun 27 02:00:08.717466 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:08.717595 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:08.717879 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:08.719050 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating existing volume attachment record: 96153aee-6e9b-4f45-8b23-f4f76e42af9e {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:08.809475 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:00:09.043401 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:09.049063 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:09.050654 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1976442498', uuid='2a3c8563-52c1-48ac-b1e5-2a3ba54f4770'), owner=OwnerMeta(userid='12040f7bfd874cd086b002bc598c80d4', username='tempest-ServerRescueNegativeTestJSON-438392507-project-member', projectid='d6a76767ddc64ede879746f16624d287', projectname='tempest-ServerRescueNegativeTestJSON-438392507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:6f:6a:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525609.0502098) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:09.051737 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:09.052176 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:09.053203 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:09.053446 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:09.054525 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:09.055792 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:09.056347 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:09.056347 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:09.056539 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:09.178441 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: 7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:09.215688 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Booting with volume f382398a-3059-47ac-a0ef-27af21f0c12b at /dev/vdb Jun 27 02:00:09.253527 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6d082268-3859-41f9-bf05-6cb401a96ef7 req-155597c6-a339-4b9e-b119-58712f39d16e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:09.253839 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6d082268-3859-41f9-bf05-6cb401a96ef7 req-155597c6-a339-4b9e-b119-58712f39d16e service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:09.254115 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6d082268-3859-41f9-bf05-6cb401a96ef7 req-155597c6-a339-4b9e-b119-58712f39d16e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:09.254300 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6d082268-3859-41f9-bf05-6cb401a96ef7 req-155597c6-a339-4b9e-b119-58712f39d16e service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:09.254469 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6d082268-3859-41f9-bf05-6cb401a96ef7 req-155597c6-a339-4b9e-b119-58712f39d16e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:09.254661 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-6d082268-3859-41f9-bf05-6cb401a96ef7 req-155597c6-a339-4b9e-b119-58712f39d16e service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received unexpected event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with vm_state active and task_state rescuing. Jun 27 02:00:09.281957 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:09.298651 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:09.315433 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:09.317306 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-4fcc673e-9697-4b65-b801-ba54a85d563b. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:09.317447 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:09.317860 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:09.317860 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port 4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:09.322537 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.726s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:09.323220 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:00:09.328386 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.663s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:09.329957 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:09.366274 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:09.366274 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:09.378143 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:09.379403 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9'] Jun 27 02:00:09.379403 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:09.379618 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:09.380102 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:09.380571 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating existing volume attachment record: e48ac86e-3622-4a7f-b5d8-a87c81321d74 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:09.538302 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-changed-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:09.539163 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Refreshing instance network info cache due to event network-changed-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:09.539502 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] Acquiring lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:09.539915 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] Acquired lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:09.541050 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Refreshing network info cache for port e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:09.560267 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:09.580485 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976442498',display_name='tempest-ServerRescueNegativeTestJSON-server-1976442498',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-1976442498',id=3,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:00:01Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-boe1ivgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:02Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=2a3c8563-52c1-48ac-b1e5-2a3ba54f4770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:6f:6a:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:09.581696 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:6f:6a:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:09.582960 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:09.584399 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:09.805078 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: 1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:09.829459 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:09.846007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:00:09.846007 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:00:09.846007 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:09.846007 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:09.957001 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:09.969308 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:09.970344 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:09.980781 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0054898809a24ab39080e132cd20ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c59372a35d245a7b24ad6282d28e3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:00:10.043741 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:10.086943 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] End _get_guest_xml xml= Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: instance-00000003 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-server-1976442498 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 2026-06-27 02:00:09 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: True Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: bare Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: ide Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: pc Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507-project-member Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: Jun 27 02:00:10.088335 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:10.092988 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance destroyed successfully. Jun 27 02:00:10.187271 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:10.350230 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:00:10.401801 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:10.443123 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:10.475009 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:00:10.550654 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Successfully created port: c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:10.636049 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Updated VIF entry in instance network info cache for port e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:10.636648 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Updating instance_info_cache with network_info: [{"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:10.689882 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2ff972b4-919a-4eb8-bd66-1ccd35599cb4 req-986ab322-77e5-49fd-83c2-9498ed5e99bf service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:10.859905 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:00:10.905046 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:00:10.910807 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:00:10.911253 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Creating image(s) Jun 27 02:00:10.911905 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Did not create local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 27 02:00:10.911985 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Ensure instance console log exists: /opt/stack/data/nova/instances/1600aedd-362f-49f5-ab76-7a79cabf4d3f/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:00:10.912352 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:10.912551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:10.912728 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:10.988273 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.657s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:11.039591 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: 5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:11.067430 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Deleted allocations for instance 06009c3c-6614-40da-910b-bd7e2ac02dc0 Jun 27 02:00:11.070681 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Booting with volume 3163a61c-cd01-446e-8d32-a22592dd81b9 at /dev/vdc Jun 27 02:00:11.139963 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8e8e8560-1120-4b37-b71a-617fa6d22252 req-2ec5ee7d-7e9b-4a56-affe-13d73678fe6d service nova] Releasing lock "refresh_cache-c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:11.141802 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:11.165510 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:11.196888 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:11.222085 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:11.222914 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:11.234680 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:11.237543 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe93:71b7', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9'] Jun 27 02:00:11.238685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:11.238685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:11.238685 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:11.239204 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating existing volume attachment record: 4f431035-f063-477d-957a-3c0376cda952 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:11.339933 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Successfully updated port: c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:11.345263 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:11.345407 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-7405eae2-5d9a-4d94-9d70-578a9f29cae1. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:11.347315 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:11.348202 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:11.348202 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port 7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:11.437403 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:11.438049 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-1f4bae04-be71-4886-bb62-cb8bad0230c6. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:11.439517 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:11.440798 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:11.440798 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port 1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:11.621773 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:11.626893 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:11.626893 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:11.626893 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:6f:6a:e0, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:11.626893 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Using config drive Jun 27 02:00:11.648478 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:11.648667 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-f19364ba-31e7-48cd-bacf-e0028ac86cb8. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:11.648843 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:11.767994 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: 1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:11.844342 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:11.844482 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:11.844645 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:11.851419 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:11.875560 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:00:11.876910 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:00:11.877166 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Creating image(s) Jun 27 02:00:11.877690 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:11.877903 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:11.878528 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:11.879347 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:11.883766 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:11.885081 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:11.943851 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:11.951075 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:11.965085 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.080s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:11.968490 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:11.969702 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:11.969702 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:11.975185 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:11.983116 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:12.054797 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.074s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:12.057991 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:12.070770 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:12.088195 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-5d622516-eadf-4b80-a9b1-3a5c29556461 tempest-DeleteServersTestJSON-1978332501 tempest-DeleteServersTestJSON-1978332501-project-member] Lock "06009c3c-6614-40da-910b-bd7e2ac02dc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.260s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:12.105878 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk 1073741824" returned: 0 in 0.050s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:12.107306 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.138s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:12.107306 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:12.123246 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:12.133416 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:12.194056 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.087s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:12.194853 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:00:12.195503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:12.246290 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:12.298287 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:12.298869 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Cannot resize image /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:00:12.299396 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:00:12.299812 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Ensure instance console log exists: /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:00:12.300767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:12.300767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:12.300767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:12.321124 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:12.383459 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:12.462053 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:12.641141 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:12.641684 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'keypairs' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:12.650235 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:12.753749 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:12.753749 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:12.753749 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-5cc55294-ac9c-469c-b1cf-642609e8d5f9. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:12.756593 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:12.756593 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:12.756593 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:12.854216 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:12.885421 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-80aa1216-9df3-4fa2-a201-547f098d9309 req-6e3ddfc2-2a69-4044-a84f-13591f0b3548 service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:12.885962 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:12.886202 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port 5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:13.035852 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: 709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:13.100451 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:13.100643 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-709dc39f-ad52-424b-b903-d6db3d30ba4e. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:13.100795 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:13.144841 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<2a3c8563-52c1-48ac-b1e5-2a3ba54f4770> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:13.148430 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:13.254298 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.262030 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:13.332017 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Creating config drive at /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.config.rescue Jun 27 02:00:13.338217 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcimtd5yt {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:13.360867 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:13.362099 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance network_info: |[{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:00:13.368847 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Start _get_guest_xml network_info=[{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:13.372403 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:13.376646 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:13.378230 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1697177352', uuid='536746ce-ca15-4708-b1f0-9aca4dc185e5'), owner=OwnerMeta(userid='0054898809a24ab39080e132cd20ec96', username='tempest-ServerStableDeviceRescueTest-686305345-project-member', projectid='8c59372a35d245a7b24ad6282d28e3d7', projectname='tempest-ServerStableDeviceRescueTest-686305345'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525613.377699) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:13.379162 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcimtd5yt" returned: 0 in 0.041s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:13.380171 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:13.381163 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:13.383184 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:13.383502 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:13.385798 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:13.387037 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:13.387250 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:13.387390 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:13.387570 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:13.388145 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:13.388289 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:13.388631 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:13.389147 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:13.390164 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:13.390292 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:13.390682 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:13.396316 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:13.408007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:00:13.409743 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1697177352',display_name='tempest-ServerStableDeviceRescueTest-server-1697177352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverstabledevicerescuetest-server-1697177352',id=8,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9yf02HargSaAeo/3gzQ1u/ovITL4PxYzZDhIE1ZjiQobiZLbRakEZ392FVeXytMbnK/SoojofaeCb1tmEHICneTo68Me+KYfv1eTRb1CvFmWIrdCPCMLPCZeZJHbFXtw==',key_name='tempest-keypair-638937042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c59372a35d245a7b24ad6282d28e3d7',ramdisk_id='',reservation_id='r-fdt0sx0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-686305345',owner_user_name='tempest-ServerStableDeviceRescueTest-686305345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054898809a24ab39080e132cd20ec96',uuid=536746ce-ca15-4708-b1f0-9aca4dc185e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:13.409933 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converting VIF {"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:13.411612 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:13.414342 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'pci_devices' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:13.415079 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:00:13.415528 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Creating image(s) Jun 27 02:00:13.415919 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Did not create local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 27 02:00:13.416108 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Ensure instance console log exists: /opt/stack/data/nova/instances/e9a68589-d76c-48cf-afd7-a1021c6d38e6/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:00:13.416297 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:13.416688 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:13.416688 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:13.502302 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:13.523127 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:13.528998 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:13.531357 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-1401dd8a-1a01-4629-9689-791335582698. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:13.533474 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:13.593982 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:13.750451 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:13.750997 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-bcaa5778-2722-4e86-ade0-a7f551f92cde. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:13.750997 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:13.785929 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] End _get_guest_xml xml= Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: instance-00000008 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: tempest-ServerStableDeviceRescueTest-server-1697177352 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 2026-06-27 02:00:13 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: True Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: bare Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: tempest-ServerStableDeviceRescueTest-686305345-project-member Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: tempest-ServerStableDeviceRescueTest-686305345 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: Jun 27 02:00:13.919154 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:13.923769 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Preparing to wait for external event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:13.923769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:13.923769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:13.923769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:13.923769 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1697177352',display_name='tempest-ServerStableDeviceRescueTest-server-1697177352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverstabledevicerescuetest-server-1697177352',id=8,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9yf02HargSaAeo/3gzQ1u/ovITL4PxYzZDhIE1ZjiQobiZLbRakEZ392FVeXytMbnK/SoojofaeCb1tmEHICneTo68Me+KYfv1eTRb1CvFmWIrdCPCMLPCZeZJHbFXtw==',key_name='tempest-keypair-638937042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c59372a35d245a7b24ad6282d28e3d7',ramdisk_id='',reservation_id='r-fdt0sx0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-686305345',owner_user_name='tempest-ServerStableDeviceRescueTest-686305345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054898809a24ab39080e132cd20ec96',uuid=536746ce-ca15-4708-b1f0-9aca4dc185e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converting VIF {"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.925446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32bde360-b66c-5e4c-afeb-8b3bdd9f303d', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:13.926604 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.927392 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:13.932780 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.935670 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.935844 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc85dd54a-d4, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:13.936250 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc85dd54a-d4, col_values=(('qos', UUID('9a198d73-2616-49c7-8ff5-fe847d092dd1')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:13.936439 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc85dd54a-d4, col_values=(('external_ids', {'iface-id': 'c85dd54a-d4ef-48d4-bcf6-723ac647e834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:55:2b', 'vm-uuid': '536746ce-ca15-4708-b1f0-9aca4dc185e5'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:13.939074 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.939074 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:13.949736 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:13.950730 np0000003818 nova-compute[98971]: INFO os_vif [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') Jun 27 02:00:13.974428 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:14.007004 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:14.096245 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:14.096501 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:14.096741 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing instance network info cache due to event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:14.096905 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:14.097048 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:14.097160 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:14.098103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:14.098365 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port 709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:14.131047 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:14.214227 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:14.222957 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:14.291683 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3631cf08-0b84-4317-aaf2-96d72c2b7c34 req-7b2d3e73-e713-43f1-80cd-9b979aa29a99 service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:14.292158 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:14.292158 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:14.343151 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d627f13f-0e3d-4bb5-b00b-255ca6961732 req-26d7ae3d-340b-495d-a617-d880f2ebd385 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:14.345014 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d627f13f-0e3d-4bb5-b00b-255ca6961732 req-26d7ae3d-340b-495d-a617-d880f2ebd385 service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:14.345014 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d627f13f-0e3d-4bb5-b00b-255ca6961732 req-26d7ae3d-340b-495d-a617-d880f2ebd385 service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:14.345014 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d627f13f-0e3d-4bb5-b00b-255ca6961732 req-26d7ae3d-340b-495d-a617-d880f2ebd385 service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:14.345014 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d627f13f-0e3d-4bb5-b00b-255ca6961732 req-26d7ae3d-340b-495d-a617-d880f2ebd385 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:14.345014 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-d627f13f-0e3d-4bb5-b00b-255ca6961732 req-26d7ae3d-340b-495d-a617-d880f2ebd385 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received unexpected event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with vm_state active and task_state rescuing. Jun 27 02:00:14.350227 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:14.602167 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:14.604901 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:14.739925 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:14.760609 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Successfully updated port: 4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:14.795818 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:14.899994 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:15.183654 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:15.183654 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-4cae5406-fc0f-4b98-ae36-437f32645e33. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:15.183654 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:15.183654 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:15.274081 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:15.285471 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:15.341101 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:15.481155 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:15.481316 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:15.481453 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No VIF found with MAC fa:16:3e:58:55:2b, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:15.481997 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Using config drive Jun 27 02:00:15.616546 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updated VIF entry in instance network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:15.616546 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:15.628006 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:00:15.628006 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:15.628006 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] VM Resumed (Lifecycle Event) Jun 27 02:00:15.628006 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e19147e9-92d5-40b4-8d62-30c8c79259db tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:15.685356 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0fd7997f-2d08-4895-b187-339fe85fbe22 req-c5db1475-8845-41ea-9eab-f906db25b876 service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:15.687440 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:15.687668 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port 1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:15.787720 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:15.788274 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:15.788274 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-feceed2c-66b6-4b32-ad15-e5b1cac20ad1. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:15.792291 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:15.792291 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:15.792291 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:15.835117 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:15.835257 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:15.835391 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:15.989189 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:16.060671 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: 911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:16.120221 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-49c851da-3c0e-4ba5-8848-100873856230 req-3ef2496e-abe4-4d6d-b71c-743abf11b8ed service nova] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:16.130380 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:16.131942 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:16.167344 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Creating config drive at /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config Jun 27 02:00:16.175460 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbyt7_1av {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:16.194167 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:16.219736 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbyt7_1av" returned: 0 in 0.044s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:16.291402 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:16.318272 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:16.408139 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:16.462389 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c9bddf17-b148-47de-984e-546bae6bbb58 req-95d968cd-4a34-44d2-827f-ecb404aeec4b service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:16.468373 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c9bddf17-b148-47de-984e-546bae6bbb58 req-95d968cd-4a34-44d2-827f-ecb404aeec4b service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:16.468373 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c9bddf17-b148-47de-984e-546bae6bbb58 req-95d968cd-4a34-44d2-827f-ecb404aeec4b service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:16.468373 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c9bddf17-b148-47de-984e-546bae6bbb58 req-95d968cd-4a34-44d2-827f-ecb404aeec4b service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:16.468373 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c9bddf17-b148-47de-984e-546bae6bbb58 req-95d968cd-4a34-44d2-827f-ecb404aeec4b service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:16.468373 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-c9bddf17-b148-47de-984e-546bae6bbb58 req-95d968cd-4a34-44d2-827f-ecb404aeec4b service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received unexpected event network-vif-plugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with vm_state rescued and task_state None. Jun 27 02:00:16.613929 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:16.635792 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:16.636130 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] VM Started (Lifecycle Event) Jun 27 02:00:16.676675 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:16.804258 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:16.834512 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:16.955832 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:17.115446 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:17.118140 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7c3dd22c-ccc3-4397-98c1-24a2f4812e8b req-19e2cc6a-a404-41ee-8195-36d474b4b871 service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:17.119431 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:17.120896 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:17.149945 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:17.166641 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:17.181322 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b74fb977-5750-41d8-9c61-ec20bde8919e req-629a55dc-8a97-4776-aeda-0eaa3afee2b4 service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:17.181630 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:17.181909 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:17.232499 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-65153903-0a12-484b-a131-398d68dc6c44 req-ae1624b5-027c-45be-83e7-84ceb308b2df service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:17.232629 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-65153903-0a12-484b-a131-398d68dc6c44 req-ae1624b5-027c-45be-83e7-84ceb308b2df service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:17.232774 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-65153903-0a12-484b-a131-398d68dc6c44 req-ae1624b5-027c-45be-83e7-84ceb308b2df service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:17.232959 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-65153903-0a12-484b-a131-398d68dc6c44 req-ae1624b5-027c-45be-83e7-84ceb308b2df service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:17.233105 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-65153903-0a12-484b-a131-398d68dc6c44 req-ae1624b5-027c-45be-83e7-84ceb308b2df service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Processing event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:17.325314 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:17.335826 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:17.340996 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:17.361823 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:17.603952 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Successfully updated port: 3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:17.626990 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:17.675415 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:17.675625 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-3ce7ae87-1473-43ee-a91f-2730d281f4cb. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:17.675771 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:17.734006 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:17.794810 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:17.921107 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:17.921534 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-911ce191-d0af-4262-bf68-1b09900c9727. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:17.922075 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:17.950160 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:18.018095 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:18.108191 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:18.411596 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:18.412142 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:18.412309 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Started (Lifecycle Event) Jun 27 02:00:18.415233 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:18.417319 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance spawned successfully. Jun 27 02:00:18.417788 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:18.454529 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e6fd40ce-994d-4c38-b772-91704e00070e req-76eea18b-cbe1-49af-9342-efd470f9b01f service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:18.455017 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:18.456080 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port 3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:18.540197 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:18.915532 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:18.917690 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:18.928620 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:18.929111 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:18.930010 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:18.933025 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:18.934650 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:18.938490 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:18.940184 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:18.957576 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:19.120803 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:19.144906 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:19.303088 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8eeb17ae-5f11-4b2e-8f66-ffa8b4f89f29 req-f984e7c9-41fa-45d5-95e6-d694187ccf87 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:19.303241 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8eeb17ae-5f11-4b2e-8f66-ffa8b4f89f29 req-f984e7c9-41fa-45d5-95e6-d694187ccf87 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:19.303394 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8eeb17ae-5f11-4b2e-8f66-ffa8b4f89f29 req-f984e7c9-41fa-45d5-95e6-d694187ccf87 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:19.303510 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8eeb17ae-5f11-4b2e-8f66-ffa8b4f89f29 req-f984e7c9-41fa-45d5-95e6-d694187ccf87 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:19.304175 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8eeb17ae-5f11-4b2e-8f66-ffa8b4f89f29 req-f984e7c9-41fa-45d5-95e6-d694187ccf87 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:19.304175 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-8eeb17ae-5f11-4b2e-8f66-ffa8b4f89f29 req-f984e7c9-41fa-45d5-95e6-d694187ccf87 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state building and task_state spawning. Jun 27 02:00:19.410194 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009631929999613931 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:19.410194 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:19.410194 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.665981851999959 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:19.410366 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=2.6658932569998797 future=) was cancelled while queued, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:19.410366 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:19.411322 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:19.411484 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] VM Stopped (Lifecycle Event) Jun 27 02:00:19.420409 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:00:19.426277 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:19.426277 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Paused (Lifecycle Event) Jun 27 02:00:19.444189 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Took 7.57 seconds to spawn the instance on the hypervisor. Jun 27 02:00:19.444446 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:19.448221 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:19.489986 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Rescuing Jun 27 02:00:19.490223 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:19.490370 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:19.490526 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:19.637054 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:19.919687 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-559b0fc7-72e6-4b3f-b540-613cbf361756 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: 06009c3c-6614-40da-910b-bd7e2ac02dc0] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:19.935218 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:19.940513 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:19.940513 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Resumed (Lifecycle Event) Jun 27 02:00:19.950902 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a54ec512-9c9a-4534-8e80-72ecddba01c7 req-66754be4-860e-44b5-a118-886e5171e9fd service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:19.951746 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:19.951946 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port 911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:19.962797 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Took 13.47 seconds to build instance. Jun 27 02:00:19.995680 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:20.109416 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:20.401986 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:20.444771 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:20.454893 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:20.458291 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:20.465095 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.986s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:20.599365 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:20.620532 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:20.665999 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Updating instance_info_cache with network_info: [{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:20.879860 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:21.048331 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:21.166904 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:21.212544 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [{"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:21.382257 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-28321118-c217-462d-a802-603c6db24eda req-9cc3821f-4e0a-46e1-9751-7406d851aa98 service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:21.382681 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:21.383111 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:21.715015 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:21.715609 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance network_info: |[{"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:00:21.717562 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Start _get_guest_xml network_info=[{"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1600aedd-362f-49f5-ab76-7a79cabf4d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'serial': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'}, 'attachment_id': 'a89baa02-d067-4f3e-a62c-943b240d71dc', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1600aedd-362f-49f5-ab76-7a79cabf4d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'serial': 'd0833d39-4314-447f-8696-58f17281209d'}, 'attachment_id': '11753ad4-4336-470b-ae8e-b805b6af06cd', 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1600aedd-362f-49f5-ab76-7a79cabf4d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'serial': 'd300a977-f409-4d83-9498-6151a32ce522'}, 'attachment_id': '96153aee-6e9b-4f45-8b23-f4f76e42af9e', 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:21.720671 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:21.720671 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port 4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:21.725254 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:21.725254 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-187080806', uuid='1600aedd-362f-49f5-ab76-7a79cabf4d3f'), owner=OwnerMeta(userid='59f6ef5fcd66441e91a33a1c88bad260', username='tempest-TaggedBootDevicesTest-112727879-project-member', projectid='96c1552799934b6c80ecd7f89d497a79', projectname='tempest-TaggedBootDevicesTest-112727879'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525621.7240438) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:21.726474 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:21.727159 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:21.728378 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:21.729177 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:21.730845 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:21.731487 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:21.733039 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:21.733427 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:21.733948 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:21.734308 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:21.751287 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:21.751830 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:21.752201 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:21.752743 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:21.753227 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:21.769806 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:21.771273 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:21.772519 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:21.773793 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:21.777139 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:21.777139 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:21.793883 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:21.793883 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:21.804016 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:21.804016 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7] added Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:21.813001 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:21.814068 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:21.814485 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:21.814824 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7] added Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:21.819845 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:21.820228 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:21.821019 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0449(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:21.821229 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:21.991291 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:22.117368 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:22.222105 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:22.227938 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:22.705142 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:22.706885 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing instance network info cache due to event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:22.707016 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:22.707111 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:22.707269 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:22.759505 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:22.764607 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:22.815349 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:22.823997 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:22.832347 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:22.836418 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:22.839242 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:22.843939 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:22.856504 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:22.867917 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:22.868223 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:22.876222 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 27 02:00:22.876222 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:22.876222 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 27 02:00:22.876222 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:22.876914 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 27 02:00:22.876914 np0000003818 nova-compute[98971]: Jun 27 02:00:22.886041 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 27 02:00:22.886041 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:22.886328 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 27 02:00:22.886328 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:22.886328 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 27 02:00:22.886328 np0000003818 nova-compute[98971]: Jun 27 02:00:23.028115 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updated VIF entry in instance network info cache for port 4cae5406-fc0f-4b98-ae36-437f32645e33. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:23.028267 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [{"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:23.058013 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:23.065951 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:23.150500 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-65dabe17-cda2-4fc2-becd-d45813134cc1 req-5e1e2227-cec7-4cbb-a065-d91d408cc263 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:23.151189 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-65dabe17-cda2-4fc2-becd-d45813134cc1 req-5e1e2227-cec7-4cbb-a065-d91d408cc263 service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:23.151479 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-65dabe17-cda2-4fc2-becd-d45813134cc1 req-5e1e2227-cec7-4cbb-a065-d91d408cc263 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:23.151624 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-65dabe17-cda2-4fc2-becd-d45813134cc1 req-5e1e2227-cec7-4cbb-a065-d91d408cc263 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:23.151734 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-65dabe17-cda2-4fc2-becd-d45813134cc1 req-5e1e2227-cec7-4cbb-a065-d91d408cc263 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:23.151868 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-65dabe17-cda2-4fc2-becd-d45813134cc1 req-5e1e2227-cec7-4cbb-a065-d91d408cc263 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state rescuing. Jun 27 02:00:23.159422 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999657422999917 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:23.159422 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999243733999947 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:23.159422 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999100728999792 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:23.161752 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance destroyed successfully. Jun 27 02:00:23.162238 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'numa_topology' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:23.211201 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:23.215878 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:23.531409 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-17217ae2-ea77-4875-8f45-7b52192efd75 req-1aa501c7-b546-4871-ba2b-bd476a5b2403 service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:23.671246 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:23.675329 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Attempting rescue Jun 27 02:00:23.675506 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 27 02:00:23.685522 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance directory exists: not creating {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 27 02:00:23.685684 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Creating image(s) Jun 27 02:00:23.687005 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:23.689477 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:23.691373 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:23.691783 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:23.772151 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:23.912318 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.40.100,3260] Jun 27 02:00:23.912318 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.40.100,3260] successful. Jun 27 02:00:23.912318 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:23.923290 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.50.100,3260] Jun 27 02:00:23.923290 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.50.100,3260] successful. Jun 27 02:00:23.923290 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:23.929111 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:23.939018 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:23.942689 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:23.949461 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.949461 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.949461 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:23.950040 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.950040 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.950040 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:23.950439 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.178s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:23.950684 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:23.952809 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:23.953132 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:23.959315 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.959315 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.959315 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:23.959678 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.959678 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:23.959678 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:23.960082 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.185s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:23.960222 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:23.962618 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updated VIF entry in instance network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:23.963005 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:23.964551 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:23.964758 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:23.979894 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:23.982009 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:23.996484 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:23.996484 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:24.181907 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:24.194491 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:24.195232 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:24.200860 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:24.202545 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:24.204088 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:24.206203 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:24.209924 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:24.210407 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:24.306111 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.094s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:24.307079 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.rescue {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:24.366163 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.rescue" returned: 0 in 0.059s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:24.367604 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.164s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:24.367604 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'migration_context' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:24.467195 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-84483d96-1227-40a3-9832-4e131acda669 req-3be96aab-cb7d-4c0c-87c9-884d8a73fb5a service nova] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:24.644207 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:24.777871 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:00:24.873532 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:24.873894 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:00:24.875558 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Start _get_guest_xml network_info=[{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:93:71:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue={'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:24.875558 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'resources' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:25.032070 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:25.211195 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [{"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:25.241660 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-beefe47d-04f2-4acd-b3b2-e725b0eb311c req-d07d88d4-6432-49c6-8143-85ae427ffeab service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:25.242016 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-beefe47d-04f2-4acd-b3b2-e725b0eb311c req-d07d88d4-6432-49c6-8143-85ae427ffeab service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:25.244481 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-beefe47d-04f2-4acd-b3b2-e725b0eb311c req-d07d88d4-6432-49c6-8143-85ae427ffeab service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:25.245511 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-beefe47d-04f2-4acd-b3b2-e725b0eb311c req-d07d88d4-6432-49c6-8143-85ae427ffeab service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:25.245511 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-beefe47d-04f2-4acd-b3b2-e725b0eb311c req-d07d88d4-6432-49c6-8143-85ae427ffeab service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:25.245511 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-beefe47d-04f2-4acd-b3b2-e725b0eb311c req-d07d88d4-6432-49c6-8143-85ae427ffeab service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state rescuing. Jun 27 02:00:25.378336 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:25.382051 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:25.382051 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-593188503', uuid='ea1483cd-9799-4aa0-b0c3-540d9ec1835e'), owner=OwnerMeta(userid='12040f7bfd874cd086b002bc598c80d4', username='tempest-ServerRescueNegativeTestJSON-438392507-project-member', projectid='d6a76767ddc64ede879746f16624d287', projectname='tempest-ServerRescueNegativeTestJSON-438392507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:93:71:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525625.3814738) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:25.384451 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:25.385113 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:25.386139 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:25.386456 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:25.387691 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:25.388212 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:25.388519 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:25.388717 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:25.388990 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:25.389994 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:25.390472 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:25.717828 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:25.719646 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance network_info: |[{"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:00:25.723230 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Start _get_guest_xml network_info=[{"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6', 'attached_at': '', 'detached_at': '', 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'serial': '5a722800-5408-438a-9b21-7df978337edb'}, 'attachment_id': '8fe19358-5a94-4939-91f2-d648e81bb5c4', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'serial': 'f382398a-3059-47ac-a0ef-27af21f0c12b'}, 'attachment_id': 'e48ac86e-3622-4a7f-b5d8-a87c81321d74', 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6', 'attached_at': '', 'detached_at': '', 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'serial': '3163a61c-cd01-446e-8d32-a22592dd81b9'}, 'attachment_id': '4f431035-f063-477d-957a-3c0376cda952', 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:25.735019 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:25.735019 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1779297975', uuid='e9a68589-d76c-48cf-afd7-a1021c6d38e6'), owner=OwnerMeta(userid='96f496e8289a4abc80ec16cc9d3cba52', username='tempest-TaggedBootDevicesTest_v242-991946975-project-member', projectid='6202ba11720e4772878029919cc6d682', projectname='tempest-TaggedBootDevicesTest_v242-991946975'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525625.7331007) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:25.744446 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:25.749594 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:25.753923 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:25.753923 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:25.757010 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:25.757336 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:25.757611 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:25.757611 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:25.758448 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:25.758448 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:25.758448 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:25.759040 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:25.759040 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:25.759260 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:25.759398 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:25.759926 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:25.774484 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:25.774484 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:25.774484 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:25.804442 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Found WWN 330000000589f2015 for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:25.805075 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.052s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:25.805784 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== connect_volume: return (4052ms) {'type': 'block', 'scsi_wwn': '330000000589f2015', 'path': '/dev/dm-0', 'multipath_id': '330000000589f2015'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:25.806340 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:25.807814 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000589f2015', 'path': '/dev/dm-0', 'multipath_id': '330000000589f2015'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:25.808496 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.032s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:25.808845 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:25.822256 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:25.823840 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:25.825016 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:25.825157 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:25.825808 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:25.826160 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:25.839863 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:25.839863 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:25.846768 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:25.846768 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb] added Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:25.858230 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:25.858499 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:25.858499 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb] added Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:25.862739 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:25.863488 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:25.863488 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:25.892960 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:25.904480 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-593188503',display_name='tempest-ServerRescueNegativeTestJSON-server-593188503',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-593188503',id=2,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:00:01Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-9mul9jc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:02Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=ea1483cd-9799-4aa0-b0c3-540d9ec1835e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:93:71:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:25.904758 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:93:71:b7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:25.905309 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:25.905899 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'pci_devices' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:26.319905 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:26.320347 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:26.320451 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:26.408635 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] End _get_guest_xml xml= Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: instance-00000002 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-server-593188503 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 2026-06-27 02:00:25 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: True Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: bare Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: ide Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: pc Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507-project-member Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: Jun 27 02:00:26.410357 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:26.415251 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance destroyed successfully. Jun 27 02:00:26.861221 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:26.863869 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:26.874474 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:26.880348 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.887379 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.892824 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.898960 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.898960 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.898960 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:26.899233 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.899233 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.899233 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:26.908158 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.908158 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.908158 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:26.908672 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.908672 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.908672 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:26.939058 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.50.100,3260] Jun 27 02:00:26.939058 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.50.100,3260] successful. Jun 27 02:00:26.939058 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.959058 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.963121 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.40.100,3260] Jun 27 02:00:26.963121 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.40.100,3260] successful. Jun 27 02:00:26.963121 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:26.981850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:26.996888 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.996888 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.996888 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.996888 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.996888 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:26.997110 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.997110 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:26.997110 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.997110 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:26.997110 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:26.997467 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:26.997599 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:26.998373 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:26.998548 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:27.010100 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:27.010631 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:27.019531 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:27.019531 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:27.120421 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:27.825557 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:00:27.936214 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:27.936348 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:27.936489 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:27.936656 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:93:71:b7, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:27.937330 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Using config drive Jun 27 02:00:28.257891 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:28.439638 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'ec2_ids' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:28.846518 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Found WWN 330000000958f74ed for multipath device dm-3 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:28.847065 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:28.847065 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== connect_volume: return (3072ms) {'type': 'block', 'scsi_wwn': '330000000958f74ed', 'path': '/dev/dm-3', 'multipath_id': '330000000958f74ed'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:28.847220 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000958f74ed', 'path': '/dev/dm-3', 'multipath_id': '330000000958f74ed'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:28.847894 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.527s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:28.848319 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:28.862904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:28.863561 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:28.864446 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:28.864806 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:28.865029 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:28.865227 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:28.883397 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:28.883397 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:28.883397 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:28.883397 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d] added Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:28.898702 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:28.898900 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:28.899176 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:28.899257 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d] added Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:28.901800 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:28.902047 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:28.902175 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:28.902285 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:28.943401 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:28.943669 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:28.944031 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'keypairs' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:29.364716 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:29.365150 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:29.365346 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:29.448699 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:29.451929 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:29.645223 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Creating config drive at /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.config.rescue Jun 27 02:00:29.649249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpevbgcx7r {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:29.696957 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpevbgcx7r" returned: 0 in 0.048s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:29.902938 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:29.902938 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:29.916487 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:29.920152 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:29.926632 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:29.936551 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:29.942617 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.942617 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.942617 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.942617 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.942617 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:29.942952 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.942952 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.942952 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.942952 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.942952 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:29.950351 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.950351 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.950351 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.950351 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.950351 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:29.951094 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.951094 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:29.951094 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.951094 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:29.951094 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:29.981641 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.40.100,3260] Jun 27 02:00:29.981641 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.40.100,3260] successful. Jun 27 02:00:29.981641 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:29.994013 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.50.100,3260] Jun 27 02:00:29.994013 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.50.100,3260] successful. Jun 27 02:00:29.994013 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:29.997933 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:30.008391 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.015248 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:30.018094 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:30.019823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:30.020097 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:30.029904 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:30.030809 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:30.030949 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:30.031935 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:30.033029 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:30.058378 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:30.061027 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:30.266731 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:30.295555 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:30.295555 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:30.405912 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:30.499664 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:30.504836 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:30.696443 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1e9ea5b0-f1e3-4392-984b-a26e7f2ace13 req-2552dfdc-03ea-4976-a872-54732f586efe service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:30.696813 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1e9ea5b0-f1e3-4392-984b-a26e7f2ace13 req-2552dfdc-03ea-4976-a872-54732f586efe service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:30.696813 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1e9ea5b0-f1e3-4392-984b-a26e7f2ace13 req-2552dfdc-03ea-4976-a872-54732f586efe service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:30.697730 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1e9ea5b0-f1e3-4392-984b-a26e7f2ace13 req-2552dfdc-03ea-4976-a872-54732f586efe service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:30.697730 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1e9ea5b0-f1e3-4392-984b-a26e7f2ace13 req-2552dfdc-03ea-4976-a872-54732f586efe service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:30.697730 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-1e9ea5b0-f1e3-4392-984b-a26e7f2ace13 req-2552dfdc-03ea-4976-a872-54732f586efe service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state rescuing. Jun 27 02:00:31.049898 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:31.050364 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:31.061750 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:31.061871 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:31.550315 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for ea1483cd-9799-4aa0-b0c3-540d9ec1835e due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:00:31.551074 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:31.551074 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Resumed (Lifecycle Event) Jun 27 02:00:31.558161 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-3e3e6978-0100-450d-8305-04b67143a5dd tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:31.865013 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:00:32.058039 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:32.059922 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:32.120814 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:32.574289 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:32.574664 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Started (Lifecycle Event) Jun 27 02:00:32.783266 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-13819935-4643-43b1-87d8-8d8a21c346d7 req-c3b5e0a5-5f19-4c77-8012-97e2a1655695 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:32.783407 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-13819935-4643-43b1-87d8-8d8a21c346d7 req-c3b5e0a5-5f19-4c77-8012-97e2a1655695 service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:32.783556 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-13819935-4643-43b1-87d8-8d8a21c346d7 req-c3b5e0a5-5f19-4c77-8012-97e2a1655695 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:32.783691 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-13819935-4643-43b1-87d8-8d8a21c346d7 req-c3b5e0a5-5f19-4c77-8012-97e2a1655695 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:32.783781 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-13819935-4643-43b1-87d8-8d8a21c346d7 req-c3b5e0a5-5f19-4c77-8012-97e2a1655695 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:32.783927 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-13819935-4643-43b1-87d8-8d8a21c346d7 req-c3b5e0a5-5f19-4c77-8012-97e2a1655695 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:00:32.880685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Found WWN 330000000dea61d01 for multipath device dm-6 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:32.880967 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:32.881410 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== connect_volume: return (6560ms) {'type': 'block', 'scsi_wwn': '330000000dea61d01', 'path': '/dev/dm-6', 'multipath_id': '330000000dea61d01'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:32.881606 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dea61d01', 'path': '/dev/dm-6', 'multipath_id': '330000000dea61d01'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:32.882122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.517s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:32.882624 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:32.896214 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:32.896214 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:32.896214 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:32.896214 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:32.896214 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:32.896214 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:32.905536 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:32.905536 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:32.910943 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:32.910943 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b] added Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:32.922223 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:32.922600 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:32.923122 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0279(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:32.923292 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b] added Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:32.926501 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:32.926760 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:32.927053 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:32.927242 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:33.040852 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Unrescuing Jun 27 02:00:33.041014 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:33.041137 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:33.041486 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:33.078968 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:33.080640 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:33.385852 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:33.386206 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:33.386354 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:33.515815 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:33.516063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:33.543760 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:33.583171 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 27 02:00:33.924053 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:33.928161 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:33.942905 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:33.950874 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:33.958780 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:33.965677 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.979853 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.980356 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:33.987913 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:34.017935 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:00:34.027952 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:34.037424 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.50.100,3260] Jun 27 02:00:34.037424 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.50.100,3260] successful. Jun 27 02:00:34.037424 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:34.053824 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:34.076495 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:34.077202 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:34.079422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:34.079422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:34.079422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:34.079422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:34.099782 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:34.099782 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:34.224470 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Updating instance_info_cache with network_info: [{"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:34.596777 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:34.597004 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:34.600382 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:00:34.601027 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Claim successful on node np0000003818 Jun 27 02:00:34.727544 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-ea1483cd-9799-4aa0-b0c3-540d9ec1835e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:34.728138 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'flavor' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:35.043188 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.40.100,3260] Jun 27 02:00:35.043188 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.40.100,3260] successful. Jun 27 02:00:35.043188 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:35.058077 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:35.075044 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:35.075311 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:35.075466 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.181s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:35.075466 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:35.076239 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:35.076295 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:35.092934 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:35.092934 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:35.254737 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.260190 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.294541 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.450212 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.453628 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.496317 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3af44bdc-22c4-4d86-8926-f5fec135ab1f req-1995bf6d-b90b-46bb-8457-835ae65ba3fb service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:35.496988 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3af44bdc-22c4-4d86-8926-f5fec135ab1f req-1995bf6d-b90b-46bb-8457-835ae65ba3fb service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:35.497172 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3af44bdc-22c4-4d86-8926-f5fec135ab1f req-1995bf6d-b90b-46bb-8457-835ae65ba3fb service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:35.497776 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3af44bdc-22c4-4d86-8926-f5fec135ab1f req-1995bf6d-b90b-46bb-8457-835ae65ba3fb service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:35.497776 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3af44bdc-22c4-4d86-8926-f5fec135ab1f req-1995bf6d-b90b-46bb-8457-835ae65ba3fb service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:35.498328 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-3af44bdc-22c4-4d86-8926-f5fec135ab1f req-1995bf6d-b90b-46bb-8457-835ae65ba3fb service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:00:35.548777 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.584885 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.591593 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.613278 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.998949447999848 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:35.613806 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance destroyed successfully. Jun 27 02:00:35.614065 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'numa_topology' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:35.615063 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.739893 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.745059 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.913657 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.920965 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:35.923926 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:00:36.116690 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:00:36.171937 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:36.171937 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:36.601316 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:36.629830 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:36.633767 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:36.674049 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:00:36.731793 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:36.789782 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:36.790837 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:36.941711 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798924 for multipath device dm-7 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:36.941986 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.060s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:36.942319 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== connect_volume: return (7576ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798924', 'path': '/dev/dm-7', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798924'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:36.942511 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798924', 'path': '/dev/dm-7', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798924'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:36.942923 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.556s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:36.943409 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:36.955825 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:36.956430 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:36.956823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:36.957047 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:36.957392 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:36.957687 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:36.972195 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:36.972195 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:36.977131 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:36.977131 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522] added Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:36.987689 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:36.988086 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:36.988510 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:36.989643 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522] added Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:36.990554 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:36.990899 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:36.991052 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:36.991227 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:37.122617 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:37.182868 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.586s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.183401 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:00:37.444011 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for ea1483cd-9799-4aa0-b0c3-540d9ec1835e due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:00:37.444181 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:37.444346 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Resumed (Lifecycle Event) Jun 27 02:00:37.446368 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-865de408-1dae-4bf7-a8a0-b03779505d34 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:37.448158 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:37.451438 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:37.451694 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:37.567026 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.567810 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.567901 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.568079 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.568376 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.568376 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.568635 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.568635 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.568800 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.568873 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.569090 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.569090 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.569272 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.569272 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.569516 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.570314 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.570476 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.570844 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.571087 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.571512 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.571740 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.571995 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.572116 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.572268 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.572406 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.572602 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.572773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.572946 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.573122 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.573620 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.573948 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.574758 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.574915 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.575098 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.575244 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.575396 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.575528 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:37.575691 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:37.575855 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:37.575992 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:37.576124 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:37.576259 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f94787a4-80af-44d0-bd2e-92446ae01d7c req-12455619-4159-4c59-8f88-690f050e627e service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received unexpected event network-vif-plugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with vm_state active and task_state None. Jun 27 02:00:37.689726 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:00:37.693008 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:00:37.693008 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:37.693008 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:37.803024 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d0ea64538644b3c8b1194033f822216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd687a155933b421c8c35d3a3655e35bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:00:37.948373 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:37.950890 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:37.990192 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:37.992628 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:38.008760 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:38.017997 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.024652 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.036361 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.046834 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.047209 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.058342 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.058864 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:38.106745 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.40.100,3260] Jun 27 02:00:38.106745 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.40.100,3260] successful. Jun 27 02:00:38.106745 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.120467 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.50.100,3260] Jun 27 02:00:38.120467 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.50.100,3260] successful. Jun 27 02:00:38.120467 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.128786 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.142258 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.157261 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.157784 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:38.158111 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:38.158203 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:38.159522 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010212520001005032 future=) was cancelled during its delay period, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:38.159782 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:38.160916 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.451822070999924 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:38.160916 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=12.451718777999986 future=) was cancelled while queued, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:38.160916 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:00:38.160916 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:38.160916 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.172692 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:38.173182 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:38.173575 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:38.173575 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:38.174831 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:38.174949 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:38.191319 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:00:38.194287 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:38.194643 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:38.221875 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:38.464816 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:38.464816 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Started (Lifecycle Event) Jun 27 02:00:38.561659 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Successfully created port: e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:38.696832 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:00:38.949059 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:38.961201 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:38.963161 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:39.185380 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Successfully updated port: e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:39.200820 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:39.204031 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:39.253360 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-changed-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:39.253518 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Refreshing instance network info cache due to event network-changed-e72cdd58-08c5-4654-abf5-4fe4f1251017. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:39.253877 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:39.254077 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:39.254669 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Refreshing network info cache for port e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:39.687593 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:39.706384 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:00:39.708038 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:00:39.708038 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Creating image(s) Jun 27 02:00:39.708740 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:39.708860 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:39.709290 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:39.709877 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:39.714567 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:39.715959 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:39.758424 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:39.814580 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.098s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:39.815578 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:39.816789 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:39.817359 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:39.824149 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:39.824411 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:39.871064 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:39.925206 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.101s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:39.927344 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:39.982126 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Found WWN 3300000007292ac48 for multipath device dm-8 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:39.982776 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:39.983844 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== connect_volume: return (6596ms) {'type': 'block', 'scsi_wwn': '3300000007292ac48', 'path': '/dev/dm-8', 'multipath_id': '3300000007292ac48'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:39.983844 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007292ac48', 'path': '/dev/dm-8', 'multipath_id': '3300000007292ac48'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:39.984527 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk 1073741824" returned: 0 in 0.058s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:39.985311 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.169s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:39.986434 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:39.986509 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.535s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:39.986853 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:40.009814 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:40.012004 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:40.013147 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:40.014657 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:40.019980 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:40.026296 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:40.042222 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:40.042222 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:40.044352 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:40.044352 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9] added Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:40.057997 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:40.058369 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:40.058496 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0438(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:40.058697 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9] added Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:40.062861 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:40.063276 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:40.063276 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0429(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:40.063450 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:40.086367 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:40.086367 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:00:40.087100 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:40.114193 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:40.175049 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:40.175885 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Cannot resize image /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:00:40.175885 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:00:40.175885 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Ensure instance console log exists: /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:00:40.176169 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:40.176407 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:40.176543 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:40.516618 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.516618 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.517441 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.518355 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.518651 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.519803 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.520136 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.520136 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.520588 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.521812 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.522926 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.522926 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.523942 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.524137 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.524592 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.525264 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.525478 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.526066 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.527855 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:40.527855 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:40.527855 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:40.529144 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lazy-loading 'pci_devices' on Instance uuid 1600aedd-362f-49f5-ab76-7a79cabf4d3f {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:40.619232 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-315a97ae-1fd4-4993-a168-30b7a4b17f89 req-d8aef86a-d8b7-4f3c-ba86-633d449d8cd3 service nova] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:40.619963 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:40.620217 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] End _get_guest_xml xml= Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1600aedd-362f-49f5-ab76-7a79cabf4d3f Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: instance-00000006 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: tempest-device-tagging-server-187080806 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 2026-06-27 02:00:21 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: True Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: bare Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: tempest-TaggedBootDevicesTest-112727879-project-member Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: tempest-TaggedBootDevicesTest-112727879 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1600aedd-362f-49f5-ab76-7a79cabf4d3f Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1600aedd-362f-49f5-ab76-7a79cabf4d3f Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: d0833d39-4314-447f-8696-58f17281209d Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: d300a977-f409-4d83-9498-6151a32ce522 Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: Jun 27 02:00:41.033323 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Preparing to wait for external event network-vif-plugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.038210 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:41.039113 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.039113 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.039605 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.039911 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.040610 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.041106 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.041440 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.046033 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.046433 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd56de5a0-208c-5bdf-a7dc-f07f5b212492', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.049307 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.050420 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.053671 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.053955 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94af59a9-60, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.054393 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94af59a9-60, col_values=(('qos', UUID('5720f37a-501f-4008-930a-62aa9ade17a3')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.054636 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94af59a9-60, col_values=(('external_ids', {'iface-id': '94af59a9-6083-4695-95fd-a6d5a45d3081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:b2:15', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.055697 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.056917 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.059418 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:41.068890 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:41.069807 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.071282 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') Jun 27 02:00:41.072243 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.072516 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.073077 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.073344 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.073827 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.074018 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.074205 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.075119 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.075415 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7e6d873-41f5-5fc7-a5d6-b00efab7f301', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.077789 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.079004 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:41.080533 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.086843 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.089461 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.089747 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fcc673e-96, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.090143 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fcc673e-96, col_values=(('qos', UUID('7b38f109-f0b2-4811-9a1b-c2b8d79b60ba')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.090327 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fcc673e-96, col_values=(('external_ids', {'iface-id': '4fcc673e-9697-4b65-b801-ba54a85d563b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:66:b6', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.091341 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.093857 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:41.095123 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.098867 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.105669 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.106962 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') Jun 27 02:00:41.108089 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.108089 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.108818 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.109128 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.109352 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.109876 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.109876 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.110699 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.110885 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7dc29a5-926b-59cc-9ce3-a8e1440b033d', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.111954 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.112651 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.116152 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.124880 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.127360 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:41.130182 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.130469 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4bae04-be, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.130894 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4bae04-be, col_values=(('qos', UUID('7c4db3d8-fb9c-4bda-b895-113bea3a11d9')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.131843 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4bae04-be, col_values=(('external_ids', {'iface-id': '1f4bae04-be71-4886-bb62-cb8bad0230c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:83:f8', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.132475 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.134644 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.137526 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.138043 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:41.155058 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.158431 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') Jun 27 02:00:41.159408 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.159683 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.160188 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.160410 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.160853 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.161247 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.161925 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.162502 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.162785 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edd2cfba-7e89-5620-b067-52e5065991b9', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.163860 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.172459 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.183518 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.186097 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.186458 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc55294-ac, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.186902 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cc55294-ac, col_values=(('qos', UUID('06fc8882-95c1-4c87-8f06-bc54bbaa5d94')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.187090 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cc55294-ac, col_values=(('external_ids', {'iface-id': '5cc55294-ac9c-469c-b1cf-642609e8d5f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:bf:d1', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.189046 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.191576 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.198677 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.40.100,3260] Jun 27 02:00:41.198677 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.40.100,3260] successful. Jun 27 02:00:41.198677 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.207484 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.50.100,3260] Jun 27 02:00:41.207484 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.50.100,3260] successful. Jun 27 02:00:41.207484 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.218623 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.221531 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.223914 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') Jun 27 02:00:41.225544 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.225544 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.229160 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.229963 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:41.232983 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.233673 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.233940 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.234280 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.235070 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.235302 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db2fba62-038d-5c30-a69c-0a776929d228', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.239002 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:41.244214 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.245667 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:41.246352 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:41.248415 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:41.248810 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:41.248946 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.257284 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:41.257812 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:41.260625 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:41.260625 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:41.260625 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:41.264332 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.267296 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.267440 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcaa5778-27, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.267743 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcaa5778-27, col_values=(('qos', UUID('06d48d56-8bde-428a-a69c-328fa0b45647')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.268004 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcaa5778-27, col_values=(('external_ids', {'iface-id': 'bcaa5778-2722-4e86-ade0-a7f551f92cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:52:e2', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.271012 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.271012 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.277423 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:41.300318 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:41.300456 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:41.318435 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.319524 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') Jun 27 02:00:41.320466 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.320674 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.321293 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.321594 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.322156 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.322156 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.322252 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.323056 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.323227 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7117e74d-9926-547e-8199-f306bb570e38', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.323956 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.324681 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.360309 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.366008 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.366008 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeceed2c-66, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.366008 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfeceed2c-66, col_values=(('qos', UUID('2fd74552-496c-4814-a75a-c2b8ac3a5fa4')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.366359 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfeceed2c-66, col_values=(('external_ids', {'iface-id': 'feceed2c-66b6-4b32-ad15-e5b1cac20ad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:27:d3', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.367727 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.370020 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.410013 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.411041 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') Jun 27 02:00:41.412424 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:41.412654 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:41.413372 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:41.413682 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:41.413914 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.414145 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.414351 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:41.415303 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.415469 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '978476e7-40a6-5daa-bca7-188da9787dc8', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.417054 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.418148 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.463528 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.466675 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.467161 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cae5406-fc, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.467605 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cae5406-fc, col_values=(('qos', UUID('4b7bd917-487a-41b1-8f7f-1d671591724d')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.468135 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cae5406-fc, col_values=(('external_ids', {'iface-id': '4cae5406-fc0f-4b98-ae36-437f32645e33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:06:76', 'vm-uuid': '1600aedd-362f-49f5-ab76-7a79cabf4d3f'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:41.469949 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.473029 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:41.510948 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:41.527406 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:41.529455 np0000003818 nova-compute[98971]: INFO os_vif [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') Jun 27 02:00:41.714843 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:41.715080 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:41.752545 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:42.128424 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.219947 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lazy-loading 'flavor' on Instance uuid 117bc011-c34c-4a7e-8083-a032031054cb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:42.254380 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:42.254646 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance network_info: |[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:00:42.256659 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start _get_guest_xml network_info=[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:42.258315 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:42.259549 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1976611999', uuid='ad0aa6e6-31be-4a5b-b89c-152d732f755e'), owner=OwnerMeta(userid='7d0ea64538644b3c8b1194033f822216', username='tempest-ServerActionsTestOtherB-461891651-project-member', projectid='d687a155933b421c8c35d3a3655e35bc', projectname='tempest-ServerActionsTestOtherB-461891651'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525642.2591467) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:42.263953 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:42.264781 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:42.274954 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:42.275236 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:42.275629 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:42.276059 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'pci_devices' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:42.278193 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:42.278462 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] End _get_guest_xml xml= Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: instance-00000009 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-server-1976611999 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 2026-06-27 02:00:42 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: True Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: bare Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-461891651-project-member Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-461891651 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: Jun 27 02:00:42.780228 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:42.782882 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Preparing to wait for external event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:42.782882 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:42.782882 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:42.782882 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:42.782882 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:42.782882 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:42.785571 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:42.786316 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:42.786962 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.786962 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:42.786962 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:42.788256 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.788256 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd77ee4f1-7d33-56c9-a54c-c1be99b9b654', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:42.789407 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.789407 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:42.794608 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:42.794747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:42.825623 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.829149 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.829149 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape72cdd58-08, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:42.829149 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape72cdd58-08, col_values=(('qos', UUID('eb67c092-3f55-4ad6-b910-e644fc27d2f5')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:42.829149 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape72cdd58-08, col_values=(('external_ids', {'iface-id': 'e72cdd58-08c5-4654-abf5-4fe4f1251017', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:8b:3f', 'vm-uuid': 'ad0aa6e6-31be-4a5b-b89c-152d732f755e'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:42.831418 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.831418 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:42.873346 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:42.873809 np0000003818 nova-compute[98971]: INFO os_vif [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') Jun 27 02:00:43.034816 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Found WWN 3300000000e62c91b for multipath device dm-9 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:43.035142 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:43.035779 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== connect_volume: return (5583ms) {'type': 'block', 'scsi_wwn': '3300000000e62c91b', 'path': '/dev/dm-9', 'multipath_id': '3300000000e62c91b'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:43.035924 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e62c91b', 'path': '/dev/dm-9', 'multipath_id': '3300000000e62c91b'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:43.074478 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:43.074645 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:43.074722 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] No VIF found with MAC fa:16:3e:58:b2:15, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:43.074955 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] No VIF found with MAC fa:16:3e:92:52:e2, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:43.075642 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Using config drive Jun 27 02:00:43.231211 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.516s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:43.296856 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:00:43.541333 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.541604 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.542573 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.542774 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.542922 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.545990 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.546756 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.546756 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.547235 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.547799 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.547934 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.548307 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.548838 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:43.548963 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:43.549369 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:43.550022 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lazy-loading 'pci_devices' on Instance uuid e9a68589-d76c-48cf-afd7-a1021c6d38e6 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:43.583925 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:43.772446 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Creating config drive at /opt/stack/data/nova/instances/1600aedd-362f-49f5-ab76-7a79cabf4d3f/disk.config Jun 27 02:00:43.776800 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1600aedd-362f-49f5-ab76-7a79cabf4d3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnx6aqc9a {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:43.818837 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1600aedd-362f-49f5-ab76-7a79cabf4d3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnx6aqc9a" returned: 0 in 0.042s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:43.885673 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:43.886054 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:43.890445 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:00:43.890704 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Claim successful on node np0000003818 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] End _get_guest_xml xml= Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: e9a68589-d76c-48cf-afd7-a1021c6d38e6 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: instance-00000007 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: tempest-device-tagging-server-1779297975 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 2026-06-27 02:00:25 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: True Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: bare Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: tempest-TaggedBootDevicesTest_v242-991946975-project-member Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: tempest-TaggedBootDevicesTest_v242-991946975 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: e9a68589-d76c-48cf-afd7-a1021c6d38e6 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: e9a68589-d76c-48cf-afd7-a1021c6d38e6 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 5a722800-5408-438a-9b21-7df978337edb Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: f382398a-3059-47ac-a0ef-27af21f0c12b Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: 3163a61c-cd01-446e-8d32-a22592dd81b9 Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: Jun 27 02:00:44.053539 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Preparing to wait for external event network-vif-plugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.070462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.071760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92ea0725-7d71-533a-85b5-3ec133bfa2df', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.073927 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.073927 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.115561 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.120499 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.120499 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7405eae2-5d, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.120499 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7405eae2-5d, col_values=(('qos', UUID('3507064e-274c-4285-a949-74a149234cb4')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.120499 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7405eae2-5d, col_values=(('external_ids', {'iface-id': '7405eae2-5d9a-4d94-9d70-578a9f29cae1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:ef:ef', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.122958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.122958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.178478 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.178478 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') Jun 27 02:00:44.178478 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:44.178478 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:44.178478 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:44.178478 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:44.179130 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.179427 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.179716 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:44.181571 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.181571 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '802e59a3-11b1-53ee-959f-721486b4cb50', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.182054 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.183682 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.234900 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.237513 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.238398 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf19364ba-31, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.239289 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf19364ba-31, col_values=(('qos', UUID('a0f35001-7440-4398-90e2-10f9de4d3c3f')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.239289 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf19364ba-31, col_values=(('external_ids', {'iface-id': 'f19364ba-31e7-48cd-bacf-e0028ac86cb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:b7:a8', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.245195 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.245195 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.305235 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.308297 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') Jun 27 02:00:44.308297 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:44.308297 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:44.308297 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:44.308297 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:44.322034 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.322034 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.322034 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:44.322034 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.322034 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db019108-1768-55ce-abb6-9fac29de1a46', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.322034 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.325269 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.379536 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.407705 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:44.411889 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:44.411889 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No VIF found with MAC fa:16:3e:fa:8b:3f, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:44.411889 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Using config drive Jun 27 02:00:44.453064 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.462214 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.462214 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1401dd8a-1a, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.462894 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1401dd8a-1a, col_values=(('qos', UUID('bc60d4a0-3478-4f1b-a6e5-d881372efb96')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.462894 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1401dd8a-1a, col_values=(('external_ids', {'iface-id': '1401dd8a-1a01-4629-9689-791335582698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1e:bf', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.467363 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.469210 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.510739 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.635354 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.639139 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') Jun 27 02:00:44.639992 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:44.640283 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:44.640992 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:44.641442 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:44.641613 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.641797 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.642029 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:44.643207 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.643391 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7e97751-e3f8-56a6-bcbd-0f30d662d01e', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.647223 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.648413 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.682785 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.735509 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.746542 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.748546 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.748711 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap709dc39f-ad, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.749836 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap709dc39f-ad, col_values=(('qos', UUID('3425a60b-fa8d-48d0-9154-892ccb1598f8')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.749836 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap709dc39f-ad, col_values=(('external_ids', {'iface-id': '709dc39f-ad52-424b-b903-d6db3d30ba4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b3:1d', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.754501 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.756096 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.807263 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.827409 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.853227 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6145f75d-9883-45eb-9c84-92bcd58fab80 req-16bae2ef-ad8d-4bd2-988f-80324ad264c2 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:44.854508 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6145f75d-9883-45eb-9c84-92bcd58fab80 req-16bae2ef-ad8d-4bd2-988f-80324ad264c2 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.854508 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6145f75d-9883-45eb-9c84-92bcd58fab80 req-16bae2ef-ad8d-4bd2-988f-80324ad264c2 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.857263 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6145f75d-9883-45eb-9c84-92bcd58fab80 req-16bae2ef-ad8d-4bd2-988f-80324ad264c2 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:44.857263 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6145f75d-9883-45eb-9c84-92bcd58fab80 req-16bae2ef-ad8d-4bd2-988f-80324ad264c2 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:44.881071 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.884531 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') Jun 27 02:00:44.887257 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:44.887257 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:44.889044 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:44.889651 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:44.890496 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.890710 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.890965 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:44.895440 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.895778 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07f76d7d-453c-574e-8942-0eb9f49c2971', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:44.896684 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.897511 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:44.921781 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:44.932549 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.946029 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:44.952091 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:44.952091 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:44.952091 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Attaching volume f1f3011c-af04-4d71-91b7-7345f6b36811 to /dev/sdc Jun 27 02:00:45.012420 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.033177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.046394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.046394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef02fa0a-81, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.046394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef02fa0a-81, col_values=(('qos', UUID('8d9e20a1-b297-43b1-b57f-02d7459eb825')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.046394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef02fa0a-81, col_values=(('external_ids', {'iface-id': 'ef02fa0a-81ac-4278-8a8a-4e41ef5e0007', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:0e:1b', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.046394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.048824 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:45.050878 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:45.071380 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:45.078077 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.109640 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:45.147745 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:45.148985 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:45.159850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:45.161511 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe58:552b', 'fe80::fc9d:c9ff:feea:6a6c', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:b215', 'fe80::fc16:3eff:fee8:66b6', 'fe80::4410:b5ff:fe74:fbb2', 'fe80::fc16:3eff:fea6:83f8', 'fe80::fc16:3eff:feff:bfd1', 'fe80::fc16:3eff:fe92:52e2', 'fe80::fc16:3eff:febf:27d3'] Jun 27 02:00:45.161811 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:45.161897 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:45.162941 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:45.163267 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Updating existing volume attachment record: 3d27d0eb-b556-47ef-ac59-e6fa185f8d3c {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:45.197608 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.197608 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') Jun 27 02:00:45.197884 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:45.200222 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:45.200222 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:45.200222 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:45.201335 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.201942 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.202763 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:45.222502 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.222502 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ed134ac-19d5-5cdc-af00-b3f2edf9fbbd', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.222502 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.223068 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:45.252392 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-dbf6c8b8-6406-48c0-a0a1-1cd20fc29ec5 req-127141d0-04c1-474c-896b-148cb36adb09 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:45.252754 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-dbf6c8b8-6406-48c0-a0a1-1cd20fc29ec5 req-127141d0-04c1-474c-896b-148cb36adb09 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:45.253226 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-dbf6c8b8-6406-48c0-a0a1-1cd20fc29ec5 req-127141d0-04c1-474c-896b-148cb36adb09 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:45.253678 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-dbf6c8b8-6406-48c0-a0a1-1cd20fc29ec5 req-127141d0-04c1-474c-896b-148cb36adb09 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:45.255070 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-dbf6c8b8-6406-48c0-a0a1-1cd20fc29ec5 req-127141d0-04c1-474c-896b-148cb36adb09 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:45.267242 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.271947 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2e921216-59fc-411f-8058-1bcf329332e5 req-16076c95-a8df-44e8-9541-3c4e599dd85b service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:45.273424 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2e921216-59fc-411f-8058-1bcf329332e5 req-16076c95-a8df-44e8-9541-3c4e599dd85b service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:45.273424 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2e921216-59fc-411f-8058-1bcf329332e5 req-16076c95-a8df-44e8-9541-3c4e599dd85b service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:45.273424 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2e921216-59fc-411f-8058-1bcf329332e5 req-16076c95-a8df-44e8-9541-3c4e599dd85b service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:45.273424 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2e921216-59fc-411f-8058-1bcf329332e5 req-16076c95-a8df-44e8-9541-3c4e599dd85b service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:45.305401 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.307006 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.319384 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.319384 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap911ce191-d0, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.319384 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap911ce191-d0, col_values=(('qos', UUID('a2740687-6c62-4216-9f41-a87a023d1f86')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.319384 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap911ce191-d0, col_values=(('external_ids', {'iface-id': '911ce191-d0af-4262-bf68-1b09900c9727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:61:ca', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.329186 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Creating config drive at /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config Jun 27 02:00:45.330211 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.332544 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:45.346959 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3uax376 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:45.383138 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.438523 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk3uax376" returned: 0 in 0.087s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:45.438898 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.447602 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:45.450495 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.450495 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '685d4283-aa8a-531e-b5c1-54e1a891d1cd', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.453033 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:45.550772 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.556468 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.557187 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce7ae87-14, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.557891 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce7ae87-14, col_values=(('qos', UUID('6b285bfb-f48d-4bcb-a5b6-23851c9797f5')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.557891 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce7ae87-14, col_values=(('external_ids', {'iface-id': '3ce7ae87-1473-43ee-a91f-2730d281f4cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:90:43', 'vm-uuid': 'e9a68589-d76c-48cf-afd7-a1021c6d38e6'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:45.563337 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:45.667309 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.668628 np0000003818 nova-compute[98971]: INFO os_vif [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') Jun 27 02:00:45.731809 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a2dcc927-b9bc-40d2-8230-d8334e7060cf req-1d3fe68d-724d-4451-9110-859449db5bde service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:45.738357 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a2dcc927-b9bc-40d2-8230-d8334e7060cf req-1d3fe68d-724d-4451-9110-859449db5bde service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:45.738357 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a2dcc927-b9bc-40d2-8230-d8334e7060cf req-1d3fe68d-724d-4451-9110-859449db5bde service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:45.738357 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a2dcc927-b9bc-40d2-8230-d8334e7060cf req-1d3fe68d-724d-4451-9110-859449db5bde service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:45.738357 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a2dcc927-b9bc-40d2-8230-d8334e7060cf req-1d3fe68d-724d-4451-9110-859449db5bde service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:45.752382 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.807544 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:45.807899 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:45.810288 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.813860 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.824941 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:45.826304 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1f3011c-af04-4d71-91b7-7345f6b36811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:45.826304 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:45.826304 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:45.826593 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1f3011c-af04-4d71-91b7-7345f6b36811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:45.846012 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:45.849536 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:45.850298 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:45.850495 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:45.851352 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:45.851942 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:45.867794 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:45.868192 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:45.870278 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:45.870278 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:45.873040 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:45.873040 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:45.884707 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811] added Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:45.887832 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:45.897566 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:45.897566 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811] added Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:45.900421 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:45.903152 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:45.903152 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0504(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:45.903152 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:45.949145 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.165030 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.240882 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.299160 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.315695 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lazy-loading 'flavor' on Instance uuid c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:46.383749 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:00:46.387119 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.569545 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.620793 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.836147 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.884174 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.998s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:46.885599 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:46.886374 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:00:46.890220 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:46.903998 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:46.912527 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:46.928291 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:46.938723 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:46.956210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:46.956279 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:46.958545 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:46.959106 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:46.959737 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No event matching network-vif-plugged-94af59a9-6083-4695-95fd-a6d5a45d3081 in dict_keys([('network-vif-plugged', '1f4bae04-be71-4886-bb62-cb8bad0230c6'), ('network-vif-plugged', 'bcaa5778-2722-4e86-ade0-a7f551f92cde'), ('network-vif-plugged', '4cae5406-fc0f-4b98-ae36-437f32645e33')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:46.960505 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-94af59a9-6083-4695-95fd-a6d5a45d3081 for instance with vm_state building and task_state spawning. Jun 27 02:00:46.960652 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:46.960879 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:46.962426 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:46.962747 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:46.963635 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:46.963635 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:46.963635 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:46.964112 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:46.964388 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:46.964515 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:46.964754 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No event matching network-vif-plugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 in dict_keys([('network-vif-plugged', 'bcaa5778-2722-4e86-ade0-a7f551f92cde'), ('network-vif-plugged', '4cae5406-fc0f-4b98-ae36-437f32645e33')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:46.965022 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cd628604-1683-46a6-ad4a-961e60e31638 req-639a47df-6a7e-4be4-8750-06981804af74 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 for instance with vm_state building and task_state spawning. Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:46.982728 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:46.984250 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.001072 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.001540 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:47.130776 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.50.100,3260] Jun 27 02:00:47.130776 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.50.100,3260] successful. Jun 27 02:00:47.130776 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:47.145515 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:47.151708 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.175050 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:47.175926 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:47.177589 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.327s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:47.177589 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:47.178932 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] HCTL ('21', '-', '-', 0) found on session 19 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:47.179292 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:47.212055 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Searching for a device in session 19 and hctl ['21', '*', '*', 0] yield: sdo {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:47.212055 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f1f3011c-af04-4d71-91b7-7345f6b36811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:47.215576 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:47.215851 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:47.215984 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] No VIF found with MAC fa:16:3e:07:ef:ef, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:47.217722 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] No VIF found with MAC fa:16:3e:37:0e:1b, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:47.217722 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Using config drive Jun 27 02:00:47.325390 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.516s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.366714 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-944b2831-3cd9-4d24-88f5-4362e5e255d6 req-c6562559-5b85-449a-a256-1bb84ab18392 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.367392 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-944b2831-3cd9-4d24-88f5-4362e5e255d6 req-c6562559-5b85-449a-a256-1bb84ab18392 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.380036 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-944b2831-3cd9-4d24-88f5-4362e5e255d6 req-c6562559-5b85-449a-a256-1bb84ab18392 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.380458 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-944b2831-3cd9-4d24-88f5-4362e5e255d6 req-c6562559-5b85-449a-a256-1bb84ab18392 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.013s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.380680 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-944b2831-3cd9-4d24-88f5-4362e5e255d6 req-c6562559-5b85-449a-a256-1bb84ab18392 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No event matching network-vif-plugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 in dict_keys([('network-vif-plugged', 'bcaa5778-2722-4e86-ade0-a7f551f92cde'), ('network-vif-plugged', '4cae5406-fc0f-4b98-ae36-437f32645e33')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:47.380956 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-944b2831-3cd9-4d24-88f5-4362e5e255d6 req-c6562559-5b85-449a-a256-1bb84ab18392 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 for instance with vm_state building and task_state spawning. Jun 27 02:00:47.383211 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.383373 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.383541 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.383746 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.384187 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No event matching network-vif-plugged-4fcc673e-9697-4b65-b801-ba54a85d563b in dict_keys([('network-vif-plugged', 'bcaa5778-2722-4e86-ade0-a7f551f92cde'), ('network-vif-plugged', '4cae5406-fc0f-4b98-ae36-437f32645e33')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:47.384187 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-4fcc673e-9697-4b65-b801-ba54a85d563b for instance with vm_state building and task_state spawning. Jun 27 02:00:47.384504 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.384992 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.385170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.385341 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.385919 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:47.387223 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.388093 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.388093 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.388801 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.388801 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No event matching network-vif-plugged-bcaa5778-2722-4e86-ade0-a7f551f92cde in dict_keys([('network-vif-plugged', '4cae5406-fc0f-4b98-ae36-437f32645e33')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:47.388801 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-bcaa5778-2722-4e86-ade0-a7f551f92cde for instance with vm_state building and task_state spawning. Jun 27 02:00:47.388801 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.388801 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.389035 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.389245 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.389385 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Processing event network-vif-plugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:47.389600 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.389744 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.389924 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.390569 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.390873 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-plugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:47.391051 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-4cae5406-fc0f-4b98-ae36-437f32645e33 for instance with vm_state building and task_state spawning. Jun 27 02:00:47.391205 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.391442 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.391660 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.391849 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.392724 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2a82bb90-e570-43e0-93bb-c8f8bd1f3f31 req-94c3153a-26c1-4f40-9a77-45a053cce9ab service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Processing event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:47.394246 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:00:47.397842 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:00:47.398698 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:47.398698 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:47.406544 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.450916 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.456456 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.521088 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12040f7bfd874cd086b002bc598c80d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a76767ddc64ede879746f16624d287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:00:47.525149 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.527191 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.579248 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:47.580998 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:47.580998 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] VM Started (Lifecycle Event) Jun 27 02:00:47.583100 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:47.588939 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance spawned successfully. Jun 27 02:00:47.589516 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:47.728183 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:47.808790 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:47.813648 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:47.818894 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance spawned successfully. Jun 27 02:00:47.822067 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:47.850123 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.869781 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e4c99a13-ae24-4d76-8b54-5cc54cf682f1 req-e392e661-a0f5-40f5-9e97-31f2165e3dd1 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-plugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:47.873567 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e4c99a13-ae24-4d76-8b54-5cc54cf682f1 req-e392e661-a0f5-40f5-9e97-31f2165e3dd1 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:47.873567 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e4c99a13-ae24-4d76-8b54-5cc54cf682f1 req-e392e661-a0f5-40f5-9e97-31f2165e3dd1 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:47.873567 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e4c99a13-ae24-4d76-8b54-5cc54cf682f1 req-e392e661-a0f5-40f5-9e97-31f2165e3dd1 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:47.873567 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e4c99a13-ae24-4d76-8b54-5cc54cf682f1 req-e392e661-a0f5-40f5-9e97-31f2165e3dd1 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-plugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:47.873567 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-e4c99a13-ae24-4d76-8b54-5cc54cf682f1 req-e392e661-a0f5-40f5-9e97-31f2165e3dd1 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received unexpected event network-vif-plugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 for instance with vm_state building and task_state spawning. Jun 27 02:00:47.903632 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:00:47.913293 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:47.998041 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Creating config drive at /opt/stack/data/nova/instances/e9a68589-d76c-48cf-afd7-a1021c6d38e6/disk.config Jun 27 02:00:48.006600 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9a68589-d76c-48cf-afd7-a1021c6d38e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8r2exu_3 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:48.084393 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:48.085620 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9a68589-d76c-48cf-afd7-a1021c6d38e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8r2exu_3" returned: 0 in 0.078s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:48.090389 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:48.114466 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.114773 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.115356 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.115921 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.116471 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.117897 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.134353 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.40.100,3260] Jun 27 02:00:48.134353 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.40.100,3260] successful. Jun 27 02:00:48.134353 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:48.160244 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.341s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:48.193717 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:48.196674 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:48.196854 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:48.248382 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdp {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:48.249171 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1f3011c-af04-4d71-91b7-7345f6b36811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:48.337923 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.338167 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.338709 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.339081 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.339467 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.340039 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:48.363120 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Successfully created port: 8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:00:48.416367 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:00:48.499821 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.569016 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.570355 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.598341 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.604231 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:00:48.604706 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:48.604892 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] VM Paused (Lifecycle Event) Jun 27 02:00:48.636366 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Took 37.73 seconds to spawn the instance on the hypervisor. Jun 27 02:00:48.637112 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:48.653304 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.772388 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.850280 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Took 9.14 seconds to spawn the instance on the hypervisor. Jun 27 02:00:48.850280 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:48.851655 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.862802 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:48.895868 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:00:48.929258 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.081382 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.095929 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.114946 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:49.122219 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:49.122219 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] VM Resumed (Lifecycle Event) Jun 27 02:00:49.127136 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.152230 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.168137 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.178588 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Took 50.82 seconds to build instance. Jun 27 02:00:49.249278 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.310335 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.310335 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.345381 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:49.345607 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:49.346157 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Attaching volume 9621ee79-a08c-4f4a-8f70-d868ebe57324 to /dev/vdb Jun 27 02:00:49.378285 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Took 14.84 seconds to build instance. Jun 27 02:00:49.395718 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.419122 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.427304 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.460756 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.465106 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:00:49.469149 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:00:49.476727 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Creating image(s) Jun 27 02:00:49.481336 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:49.488128 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.492513 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "/opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:49.492513 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.005s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:49.493387 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:49.504074 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:49.515659 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:49.521862 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:00:49.533060 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:49.543122 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.564536 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-32bb0c89-eb7c-4cab-8356-a2c872c17f73 req-9521e93d-f055-4381-a438-71b19001e661 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:49.564766 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-32bb0c89-eb7c-4cab-8356-a2c872c17f73 req-9521e93d-f055-4381-a438-71b19001e661 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:49.566071 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-32bb0c89-eb7c-4cab-8356-a2c872c17f73 req-9521e93d-f055-4381-a438-71b19001e661 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:49.566956 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-32bb0c89-eb7c-4cab-8356-a2c872c17f73 req-9521e93d-f055-4381-a438-71b19001e661 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:49.567209 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-32bb0c89-eb7c-4cab-8356-a2c872c17f73 req-9521e93d-f055-4381-a438-71b19001e661 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:49.575497 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b6bce430-702c-4fe4-bde1-6f188a88b3e8 req-0e30cd18-45d5-4390-88e3-d230e9d7c4c3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:49.575497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b6bce430-702c-4fe4-bde1-6f188a88b3e8 req-0e30cd18-45d5-4390-88e3-d230e9d7c4c3 service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:49.575497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b6bce430-702c-4fe4-bde1-6f188a88b3e8 req-0e30cd18-45d5-4390-88e3-d230e9d7c4c3 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:49.575497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b6bce430-702c-4fe4-bde1-6f188a88b3e8 req-0e30cd18-45d5-4390-88e3-d230e9d7c4c3 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:49.575497 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b6bce430-702c-4fe4-bde1-6f188a88b3e8 req-0e30cd18-45d5-4390-88e3-d230e9d7c4c3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:49.575497 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-b6bce430-702c-4fe4-bde1-6f188a88b3e8 req-0e30cd18-45d5-4390-88e3-d230e9d7c4c3 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state active and task_state None. Jun 27 02:00:49.585002 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:49.621253 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:00:49.622872 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:00:49.630818 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Successfully updated port: 8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:00:49.637100 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.114s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:49.638822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:49.640303 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:49.642068 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:49.649914 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:49.663758 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:00:49.668601 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:49.673449 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:00:49.677367 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:feb4:7cae', 'fe80::7802:3dff:fe11:693b', 'fe80::fc16:3eff:fe2a:ec1a', 'fe80::f033:86ff:fe84:a3f9', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe58:552b', 'fe80::fc9d:c9ff:feea:6a6c', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:b215', 'fe80::fc16:3eff:fee8:66b6', 'fe80::4410:b5ff:fe74:fbb2', 'fe80::fc16:3eff:fea6:83f8', 'fe80::fc16:3eff:feff:bfd1', 'fe80::fc16:3eff:fe92:52e2', 'fe80::fc16:3eff:febf:27d3', 'fe80::fc16:3eff:fe52:676', 'fe80::980a:61ff:fe78:5465', 'fe80::fc16:3eff:fefa:8b3f', 'fe80::984c:cff:fec4:61ff', 'fe80::30fb:ceff:fe90:4fe3', 'fe80::fc16:3eff:fe07:efef', 'fe80::fc16:3eff:fe21:b7a8', 'fe80::a031:5ff:fe73:c733', 'fe80::fc16:3eff:fee1:1ebf', 'fe80::fc16:3eff:fe26:b31d', 'fe80::fc16:3eff:fe37:e1b'] Jun 27 02:00:49.677367 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:00:49.677367 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:00:49.679613 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:49.679613 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Updating existing volume attachment record: 88846cf3-367b-4af1-840d-b12ef3e1a497 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:00:49.697432 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-53670660-b7a5-4c1c-b16c-fc1a5ec240b0 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 52.346s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:49.711856 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:49.727423 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.779994 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:49.780061 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing instance network info cache due to event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:49.782065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:49.782065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:49.782065 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:49.815438 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.819097 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.151s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:49.819899 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:49.821513 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:49.887739 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.368s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:49.928912 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk 1073741824" returned: 0 in 0.107s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:49.930046 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.289s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:49.930046 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:49.963673 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798939 for multipath device dm-10 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:49.965980 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.138s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:49.965980 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] <== connect_volume: return (4139ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798939', 'path': '/dev/dm-10', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798939'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:49.969469 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798939', 'path': '/dev/dm-10', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798939'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:49.972569 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.004803 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lazy-loading 'flavor' on Instance uuid 117bc011-c34c-4a7e-8083-a032031054cb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:50.022319 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.052449 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.120s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:50.052449 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:00:50.052449 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:50.054575 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:50.055796 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:50.056816 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:50.056816 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:50.056982 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:50.057822 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:50.057822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:50.057822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:50.058821 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:50.059627 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No event matching network-vif-plugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 in dict_keys([('network-vif-plugged', '1401dd8a-1a01-4629-9689-791335582698'), ('network-vif-plugged', '709dc39f-ad52-424b-b903-d6db3d30ba4e'), ('network-vif-plugged', 'ef02fa0a-81ac-4278-8a8a-4e41ef5e0007'), ('network-vif-plugged', '911ce191-d0af-4262-bf68-1b09900c9727'), ('network-vif-plugged', '3ce7ae87-1473-43ee-a91f-2730d281f4cb')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:50.060829 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cdbfc1b1-9d05-4345-94f7-cb4df16b2b2b req-558af0bf-9680-4f27-97c1-cd22f0ecf45f service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 for instance with vm_state building and task_state spawning. Jun 27 02:00:50.160643 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:50.184898 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:50.185406 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Cannot resize image /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:00:50.185877 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:00:50.186042 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Ensure instance console log exists: /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:00:50.186341 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:50.186770 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:50.187363 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:50.193048 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.235293 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:50.236494 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Started (Lifecycle Event) Jun 27 02:00:50.298310 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:50.321413 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.327287 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.361211 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.362452 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:00:50.363219 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:50.363219 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:50.363636 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:50.364060 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:00:50.386935 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:50.389274 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:50.390334 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:50.390334 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:50.391525 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:50.393223 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:50.415876 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:50.415876 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:50.427025 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:00:50.427025 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324] added Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:50.436238 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:50.436446 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:50.436816 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0465(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:50.437047 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324] added Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:00:50.441877 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:50.442281 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:00:50.442281 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0511(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:00:50.442394 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:00:50.476691 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] attach device xml: Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: f1f3011c-af04-4d71-91b7-7345f6b36811 Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]:
Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: Jun 27 02:00:50.520872 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:00:50.560484 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.745503 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.750235 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:50.752072 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:50.754126 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:50.798746 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:50.986218 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:51.216051 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:51.218730 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:51.263111 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:51.263111 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Paused (Lifecycle Event) Jun 27 02:00:51.305498 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b884baf-8f6b-4261-990e-e5e26f640000 req-85b66612-2700-41f8-b2f7-bb6139939155 service nova] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:51.305498 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:51.305498 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:00:51.438301 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:00:51.443500 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:51.460237 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:00:51.465266 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.480208 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.489878 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.533687 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.543045 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.543495 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:51.612623 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.40.100,3260] Jun 27 02:00:51.612623 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.40.100,3260] successful. Jun 27 02:00:51.612623 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.629734 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.50.100,3260] Jun 27 02:00:51.629734 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.50.100,3260] successful. Jun 27 02:00:51.629734 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.642359 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.650240 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:51.661751 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7681e90d-148b-41b4-8378-bda5fe925a28 req-9412b6c6-fc5a-474b-94cb-ff8efdb7841d service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.664199 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7681e90d-148b-41b4-8378-bda5fe925a28 req-9412b6c6-fc5a-474b-94cb-ff8efdb7841d service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.665001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7681e90d-148b-41b4-8378-bda5fe925a28 req-9412b6c6-fc5a-474b-94cb-ff8efdb7841d service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.665347 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7681e90d-148b-41b4-8378-bda5fe925a28 req-9412b6c6-fc5a-474b-94cb-ff8efdb7841d service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.665450 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7681e90d-148b-41b4-8378-bda5fe925a28 req-9412b6c6-fc5a-474b-94cb-ff8efdb7841d service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No event matching network-vif-plugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 in dict_keys([('network-vif-plugged', '1401dd8a-1a01-4629-9689-791335582698'), ('network-vif-plugged', '709dc39f-ad52-424b-b903-d6db3d30ba4e'), ('network-vif-plugged', 'ef02fa0a-81ac-4278-8a8a-4e41ef5e0007'), ('network-vif-plugged', '911ce191-d0af-4262-bf68-1b09900c9727'), ('network-vif-plugged', '3ce7ae87-1473-43ee-a91f-2730d281f4cb')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:51.665611 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-7681e90d-148b-41b4-8378-bda5fe925a28 req-9412b6c6-fc5a-474b-94cb-ff8efdb7841d service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 for instance with vm_state building and task_state spawning. Jun 27 02:00:51.668729 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.668951 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.669147 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.669364 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.670525 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:51.671265 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.671353 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.671527 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.671851 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.671851 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No event matching network-vif-plugged-1401dd8a-1a01-4629-9689-791335582698 in dict_keys([('network-vif-plugged', '709dc39f-ad52-424b-b903-d6db3d30ba4e'), ('network-vif-plugged', 'ef02fa0a-81ac-4278-8a8a-4e41ef5e0007'), ('network-vif-plugged', '911ce191-d0af-4262-bf68-1b09900c9727'), ('network-vif-plugged', '3ce7ae87-1473-43ee-a91f-2730d281f4cb')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:51.672109 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-1401dd8a-1a01-4629-9689-791335582698 for instance with vm_state building and task_state spawning. Jun 27 02:00:51.672322 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.672397 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.672578 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.672752 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.672846 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:51.673359 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.674234 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.674472 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.675126 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.675126 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No event matching network-vif-plugged-911ce191-d0af-4262-bf68-1b09900c9727 in dict_keys([('network-vif-plugged', '709dc39f-ad52-424b-b903-d6db3d30ba4e'), ('network-vif-plugged', 'ef02fa0a-81ac-4278-8a8a-4e41ef5e0007'), ('network-vif-plugged', '3ce7ae87-1473-43ee-a91f-2730d281f4cb')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:51.675126 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-c6e9c5fa-b76e-4953-bfdb-06f191d0616a req-5133147a-ce1b-4f1a-b7d4-8d87e9cc6fb6 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-911ce191-d0af-4262-bf68-1b09900c9727 for instance with vm_state building and task_state spawning. Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.678883 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.679390 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:51.680173 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:51.680173 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:51.683929 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] HCTL ('22', '-', '-', 0) found on session 20 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:51.684262 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Scanning host 22 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:51.690901 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:51.692036 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.300s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:51.692036 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:00:51.694500 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] HCTL ('23', '-', '-', 0) found on session 21 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:00:51.694500 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Scanning host 23 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:00:51.729280 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Searching for a device in session 20 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:51.729280 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:51.729280 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Searching for a device in session 21 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:00:51.729445 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:00:51.751618 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:51.761044 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:51.765982 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:51.770837 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:51.770949 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Resumed (Lifecycle Event) Jun 27 02:00:51.786010 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:51.887173 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.888001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.889849 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.890149 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.890367 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:51.890592 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.891258 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:51.892171 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:51.892171 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:51.892171 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No event matching network-vif-plugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 in dict_keys([('network-vif-plugged', '709dc39f-ad52-424b-b903-d6db3d30ba4e'), ('network-vif-plugged', '3ce7ae87-1473-43ee-a91f-2730d281f4cb')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:51.892171 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 for instance with vm_state building and task_state spawning. Jun 27 02:00:51.892389 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-changed-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:51.892924 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Refreshing instance network info cache due to event network-changed-e72cdd58-08c5-4654-abf5-4fe4f1251017. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:51.893578 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:51.894526 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:51.894526 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Refreshing network info cache for port e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:51.927399 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:00:52.140628 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:52.142202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:52.157401 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:52.157401 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:52.157401 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:52.157401 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:52.157401 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:52.161904 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:52.161904 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:52.162218 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:52.162303 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:52.162458 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No event matching network-vif-plugged-709dc39f-ad52-424b-b903-d6db3d30ba4e in dict_keys([('network-vif-plugged', '3ce7ae87-1473-43ee-a91f-2730d281f4cb')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:00:52.162644 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-709dc39f-ad52-424b-b903-d6db3d30ba4e for instance with vm_state building and task_state spawning. Jun 27 02:00:52.163107 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:52.163107 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:52.163218 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:52.163458 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:52.163511 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Processing event network-vif-plugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:52.163733 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-plugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:52.163783 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:52.168315 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:52.169122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.005s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:52.169122 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-plugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:52.169122 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-1ba1397d-c93c-44cc-887a-a5a56162efab req-903a8a86-cd85-4535-9513-665ac72c1292 service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received unexpected event network-vif-plugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb for instance with vm_state building and task_state spawning. Jun 27 02:00:52.170092 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:52.173510 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:52.178360 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:52.181115 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance spawned successfully. Jun 27 02:00:52.183803 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:52.212748 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:52.271938 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No BDM found with device name sda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:52.272157 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:52.272256 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:52.272357 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] No VIF found with MAC fa:16:3e:b4:7c:ae, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:52.275699 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:52.284366 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:52.390089 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:00:52.398015 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:52.414998 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:52.701374 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:52.701710 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:52.702147 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:52.702668 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:52.703239 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:52.703672 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:52.791425 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:52.791728 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] VM Started (Lifecycle Event) Jun 27 02:00:52.998472 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:53.000174 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance network_info: |[{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:00:53.002369 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Start _get_guest_xml network_info=[{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:00:53.010846 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:53.015821 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-466675542', uuid='380fe23b-73a4-4b4f-9349-fce0f62ae5fb'), owner=OwnerMeta(userid='12040f7bfd874cd086b002bc598c80d4', username='tempest-ServerRescueNegativeTestJSON-438392507-project-member', projectid='d6a76767ddc64ede879746f16624d287', projectname='tempest-ServerRescueNegativeTestJSON-438392507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525653.0135028) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:00:53.018328 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:00:53.020255 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:00:53.022921 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:00:53.023405 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:00:53.025652 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:00:53.025838 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:00:53.026706 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:00:53.026847 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:00:53.027050 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:00:53.027151 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:00:53.027302 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:00:53.027655 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:00:53.027655 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:00:53.027749 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:00:53.027793 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:00:53.030000 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:00:53.041159 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:53.050389 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-466675542',display_name='tempest-ServerRescueNegativeTestJSON-server-466675542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-466675542',id=10,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOWcHKr2sV1pVsFqegtL35TZyjw+YDsVcv4HxAV4SjpPhm7qYGnOIWc8DKa7ZT4fCcZCCrFaeDpuMcOJQ5Rm77CW+noQsbRhgebEOm3DGhWdWFAWXw8EC+EBsVmTAHemA==',key_name='tempest-keypair-783663957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-6z0b75xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12040f7bfd874cd086b002bc598c80d4',uuid=380fe23b-73a4-4b4f-9349-fce0f62ae5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:00:53.050660 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:53.051982 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:53.052888 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'pci_devices' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:53.211913 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Took 39.80 seconds to spawn the instance on the hypervisor. Jun 27 02:00:53.212551 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:53.242958 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updated VIF entry in instance network info cache for port e72cdd58-08c5-4654-abf5-4fe4f1251017. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:53.242958 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:53.295861 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:53.297672 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:53.411412 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Found WWN 33000000025fd2296 for multipath device dm-11 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:00:53.411724 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:53.411796 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '33000000025fd2296', 'path': '/dev/dm-11', 'multipath_id': '33000000025fd2296'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:53.411907 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000025fd2296', 'path': '/dev/dm-11', 'multipath_id': '33000000025fd2296'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:00:53.418097 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lazy-loading 'flavor' on Instance uuid c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] End _get_guest_xml xml= Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: instance-0000000a Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 196608 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-server-466675542 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 2026-06-27 02:00:53 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 192 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: True Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: bare Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 0 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: virtio Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507-project-member Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: hvm Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 128 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: 1 Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: Jun 27 02:00:53.556618 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Preparing to wait for external event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-466675542',display_name='tempest-ServerRescueNegativeTestJSON-server-466675542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-466675542',id=10,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOWcHKr2sV1pVsFqegtL35TZyjw+YDsVcv4HxAV4SjpPhm7qYGnOIWc8DKa7ZT4fCcZCCrFaeDpuMcOJQ5Rm77CW+noQsbRhgebEOm3DGhWdWFAWXw8EC+EBsVmTAHemA==',key_name='tempest-keypair-783663957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-6z0b75xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12040f7bfd874cd086b002bc598c80d4',uuid=380fe23b-73a4-4b4f-9349-fce0f62ae5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:00:53.560166 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.560743 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:53.560743 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:00:53.562310 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.562310 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13db7bfa-cdc8-58a6-90c9-09663ba5bca8', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:53.566964 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.566964 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:53.566964 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.569297 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.569558 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8363c61e-3b, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:53.570092 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8363c61e-3b, col_values=(('qos', UUID('90b9d927-340e-4c2e-8ead-4836f8494dfc')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:53.570318 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8363c61e-3b, col_values=(('external_ids', {'iface-id': '8363c61e-3b4a-44fe-be22-75f45bc63c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:c2:bb', 'vm-uuid': '380fe23b-73a4-4b4f-9349-fce0f62ae5fb'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:00:53.572890 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.572890 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:00:53.583097 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:53.583699 np0000003818 nova-compute[98971]: INFO os_vif [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') Jun 27 02:00:53.727898 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Took 54.76 seconds to build instance. Jun 27 02:00:53.743063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-51f0c7e6-51f1-493b-a407-148d46483e69 req-150c5ab4-e000-473d-bdfc-f48f4f9780a2 service nova] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:53.784422 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-changed-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:53.784422 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing instance network info cache due to event network-changed-94af59a9-6083-4695-95fd-a6d5a45d3081. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:53.784570 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] Acquiring lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:53.785782 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] Acquired lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:53.785782 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Refreshing network info cache for port 94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:53.800375 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:53.800504 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] VM Paused (Lifecycle Event) Jun 27 02:00:53.861224 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8ed09066-0983-47f2-8d5f-7ec0263431d3 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.911s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:53.924208 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Attempting to attach volume 9621ee79-a08c-4f4a-8f70-d868ebe57324 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] attach device xml: Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: 9621ee79-a08c-4f4a-8f70-d868ebe57324 Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: Jun 27 02:00:53.926581 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:00:54.015485 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.015668 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.015918 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.016119 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.016327 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.017122 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.017122 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.017122 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 02:00:54.017122 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:00:54.231304 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2d0223dd-a037-498b-95bf-31d7aee89479 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 56.297s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:54.288174 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:54.304939 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:54.307601 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:54.307745 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] VM Resumed (Lifecycle Event) Jun 27 02:00:54.524419 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:54.524645 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:54.524818 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:54.524954 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 02:00:54.800237 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:54.811086 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:54.821665 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:54.836862 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-changed-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:54.839381 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing instance network info cache due to event network-changed-7405eae2-5d9a-4d94-9d70-578a9f29cae1. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:00:54.839552 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] Acquiring lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:00:54.840270 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] Acquired lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:00:54.840270 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Refreshing network info cache for port 7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:00:55.011664 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updated VIF entry in instance network info cache for port 94af59a9-6083-4695-95fd-a6d5a45d3081. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:55.011664 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [{"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:55.110109 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:55.111997 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:55.112358 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:7d:c2:bb, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:55.113532 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Using config drive Jun 27 02:00:55.350468 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:55.406001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:55.406320 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:55.513531 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cbafcff8-e986-4b8a-8318-81fcb722e669 req-385d9ed5-fcd9-4452-9ecf-f2875cb20422 service nova] Releasing lock "refresh_cache-1600aedd-362f-49f5-ab76-7a79cabf4d3f" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:55.577988 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:55.606627 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:55.606816 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:55.607009 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:00:55.607060 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] No VIF found with MAC fa:16:3e:2a:ec:1a, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:00:55.622997 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:55.669092 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:55.670090 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:55.775408 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:55.777266 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-10 (sdc) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:55.786481 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:55.871004 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:00:55.883259 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Creating config drive at /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.config Jun 27 02:00:55.889033 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1juragy5 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:55.906834 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json" returned: 0 in 0.119s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:55.908714 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:55.914524 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Detaching volume f1f3011c-af04-4d71-91b7-7345f6b36811 Jun 27 02:00:55.938833 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1juragy5" returned: 0 in 0.048s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:56.000370 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Attempting to driver detach volume f1f3011c-af04-4d71-91b7-7345f6b36811 from mountpoint /dev/sdc Jun 27 02:00:56.011471 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Found disk sdc by alias ua-f1f3011c-af04-4d71-91b7-7345f6b36811 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:00:56.013648 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Found disk sdc by alias ua-f1f3011c-af04-4d71-91b7-7345f6b36811 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:00:56.013841 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Attempting to detach device sdc from instance 117bc011-c34c-4a7e-8083-a032031054cb from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] detach device xml: Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: f1f3011c-af04-4d71-91b7-7345f6b36811 Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]:
Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: Jun 27 02:00:56.014200 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:00:56.021416 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json" returned: 0 in 0.113s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:56.022299 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:56.036755 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Successfully detached device sdc from instance 117bc011-c34c-4a7e-8083-a032031054cb from the persistent domain config. Jun 27 02:00:56.037989 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] (1/8): Attempting to detach device sdc with device alias ua-f1f3011c-af04-4d71-91b7-7345f6b36811 from instance 117bc011-c34c-4a7e-8083-a032031054cb from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] detach device xml: Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: f1f3011c-af04-4d71-91b7-7345f6b36811 Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]:
Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: Jun 27 02:00:56.039568 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:00:56.122138 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:56.122664 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:56.138411 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updated VIF entry in instance network info cache for port 7405eae2-5d9a-4d94-9d70-578a9f29cae1. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:00:56.139955 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [{"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:00:56.210547 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:56.494520 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-f1f3011c-af04-4d71-91b7-7345f6b36811> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:00:56.497491 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-f1f3011c-af04-4d71-91b7-7345f6b36811 for instance 117bc011-c34c-4a7e-8083-a032031054cb {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:00:56.503228 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Successfully detached device sdc from instance 117bc011-c34c-4a7e-8083-a032031054cb from the live domain config. Jun 27 02:00:56.506812 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:00:56.507568 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1f3011c-af04-4d71-91b7-7345f6b36811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:00:56.508002 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:00:56.508799 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:00:56.508799 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1f3011c-af04-4d71-91b7-7345f6b36811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:00:56.509034 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '9')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:00:56.547037 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', '18')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:00:56.548656 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811', '19')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:00:56.550567 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Resulting device map defaultdict(. at 0x7decc04b99e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'): ({'sdo'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:00:56.550867 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Removing multipathed devices sdp, sdo {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:00:56.551214 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Flush multipath device 3300000008ae92577 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:00:56.604092 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:00:56.647723 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:56.662331 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac1e96e2-aedf-485b-896c-7522c3895245 req-8e29d470-dc2b-4835-9812-d4b4d0d94e2b service nova] Releasing lock "refresh_cache-e9a68589-d76c-48cf-afd7-a1021c6d38e6" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:00:56.667485 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:00:56.694106 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:56.724835 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:56.724835 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Checking to see if SCSI volumes sdp, sdo have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:00:56.724835 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] SCSI volumes sdp, sdo have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:00:56.730683 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Checking to see if device paths {'sdp', 'sdo'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:00:56.745770 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Device paths {'sdp', 'sdo'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:00:56.746412 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:00:56.765619 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:56.834254 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.40.100,3260] Jun 27 02:00:56.834254 np0000003818 nova-compute[98971]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.40.100,3260] successful. Jun 27 02:00:56.834254 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:56.878272 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:56.897806 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:56.900058 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:56.900806 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:56.964732 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.50.100,3260] Jun 27 02:00:56.964732 np0000003818 nova-compute[98971]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-f1f3011c-af04-4d71-91b7-7345f6b36811, portal: 192.168.50.100,3260] successful. Jun 27 02:00:56.964732 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:57.000497 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:00:57.000497 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:00:57.000903 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] <== disconnect_volume: return (492ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:00:57.001047 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:00:57.009706 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.121668 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-66a77c46-90b5-467d-aa06-a990fbc3fb75 req-b79961cc-5e4e-42b6-8d80-ff8811eb7150 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:57.122049 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-66a77c46-90b5-467d-aa06-a990fbc3fb75 req-b79961cc-5e4e-42b6-8d80-ff8811eb7150 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:57.122811 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-66a77c46-90b5-467d-aa06-a990fbc3fb75 req-b79961cc-5e4e-42b6-8d80-ff8811eb7150 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:57.122811 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-66a77c46-90b5-467d-aa06-a990fbc3fb75 req-b79961cc-5e4e-42b6-8d80-ff8811eb7150 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:57.122927 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-66a77c46-90b5-467d-aa06-a990fbc3fb75 req-b79961cc-5e4e-42b6-8d80-ff8811eb7150 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Processing event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:00:57.124226 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.125546 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.216637 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:57.221834 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.230523 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.324734 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.325483 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.412382 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3c06f75-f8dc-4c9d-8d91-6cea10fd9d83 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.066s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:57.431019 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.440912 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.541463 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.542213 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.636409 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.636819 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:57.642553 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:57.643181 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:57.643335 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:57.648011 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lazy-loading 'flavor' on Instance uuid 117bc011-c34c-4a7e-8083-a032031054cb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:57.651785 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.759580 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.760604 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.862954 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.868232 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:57.963574 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:57.965407 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:58.063831 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:58.073960 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:58.074252 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:58.074407 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-8 (vdc) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:00:58.078574 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:00:58.081114 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:00:58.117124 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.036s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:00:58.117983 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=50513MB free_disk=74.42996215820312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 02:00:58.118436 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:58.118982 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:58.411790 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:58.412807 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:00:58.412965 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Started (Lifecycle Event) Jun 27 02:00:58.417021 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:00:58.423046 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance spawned successfully. Jun 27 02:00:58.423046 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:00:58.528910 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] volume_snapshot_create: create_info: {'snapshot_id': '591a70b3-881b-49bb-bc2a-29e098d71f64', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98971) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3759}} Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] snap xml: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: Jun 27 02:00:58.532926 np0000003818 nova-compute[98971]: {{(pid=98971) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3700}} Jun 27 02:00:58.533423 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] Lazy-loading 'system_metadata' on Instance uuid c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:00:58.573838 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:58.641019 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-9c3e0540-db1c-4b94-9afa-21af4c5d4540 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] volume_snapshot_delete: delete_info: {'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324'} {{(pid=98971) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3867}} Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [None req-9c3e0540-db1c-4b94-9afa-21af4c5d4540 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Traceback (most recent call last): Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] self._volume_snapshot_delete(context, instance, volume_id, Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] if delete_info['type'] != 'qcow2': Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] ~~~~~~~~~~~^^^^^^^^ Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] KeyError: 'type' Jun 27 02:00:58.650693 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [None req-9c3e0540-db1c-4b94-9afa-21af4c5d4540 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4880b7aa-a003-464c-acc9-c0f9df20415a) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 27 02:00:58.686951 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:58.689473 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0418a13b-b909-4c82-8da9-9ce1f65d7991 tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.278s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server [None req-9c3e0540-db1c-4b94-9afa-21af4c5d4540 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] Exception during message handling: KeyError: 'type' Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server raise self.value Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4043, in volume_snapshot_delete Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server raise self.value Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jun 27 02:00:58.715611 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server Jun 27 02:00:58.921410 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:58.931085 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:00:58.936776 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:58.937490 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:58.938102 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:58.938847 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:58.939805 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:58.939805 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:00:59.037022 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Traceback (most recent call last): Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.044854 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Traceback (most recent call last): Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] self._volume_snapshot_create(context, instance, guest, Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.046189 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 591a70b3-881b-49bb-bc2a-29e098d71f64 could not be found. Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 591a70b3-881b-49bb-bc2a-29e098d71f64 could not be found. (HTTP 404) (Request-ID: req-eba2867b-5b41-4e3e-a44b-3f24ab9352a6) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 591a70b3-881b-49bb-bc2a-29e098d71f64 could not be found. Jun 27 02:00:59.082654 np0000003818 nova-compute[98971]: ERROR nova.virt.libvirt.driver Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server [None req-0926fbe6-ec48-400a-89e9-cfe70bfe4447 tempest-VolumesAssistedSnapshotsTest-1791647716 tempest-VolumesAssistedSnapshotsTest-1791647716-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server raise self.value Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3780, in volume_snapshot_create Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server raise self.value Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 27 02:00:59.088865 np0000003818 nova-compute[98971]: ERROR oslo_messaging.rpc.server Jun 27 02:00:59.109420 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:59.109420 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:59.109697 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:59.109757 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:59.110459 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:59.113062 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Terminating instance Jun 27 02:00:59.223106 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-9c51dcbd-a58d-42ae-8b24-510949b80a3c req-d77c635e-9515-41ba-9786-d02e38d3121f service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:00:59.223275 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9c51dcbd-a58d-42ae-8b24-510949b80a3c req-d77c635e-9515-41ba-9786-d02e38d3121f service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:59.224019 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9c51dcbd-a58d-42ae-8b24-510949b80a3c req-d77c635e-9515-41ba-9786-d02e38d3121f service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:59.224019 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9c51dcbd-a58d-42ae-8b24-510949b80a3c req-d77c635e-9515-41ba-9786-d02e38d3121f service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:00:59.224019 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-9c51dcbd-a58d-42ae-8b24-510949b80a3c req-d77c635e-9515-41ba-9786-d02e38d3121f service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:00:59.224176 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-9c51dcbd-a58d-42ae-8b24-510949b80a3c req-d77c635e-9515-41ba-9786-d02e38d3121f service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state building and task_state spawning. Jun 27 02:00:59.228983 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance ea1483cd-9799-4aa0-b0c3-540d9ec1835e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.229394 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.229550 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 117bc011-c34c-4a7e-8083-a032031054cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.229788 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.229897 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.230863 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.230863 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.230863 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance ad0aa6e6-31be-4a5b-b89c-152d732f755e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.230863 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:00:59.231215 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 02:00:59.231619 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:00:58 up 29 min, 2 users, load average: 12.81, 5.75, 2.56\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_d6a76767ddc64ede879746f16624d287': '3', 'io_workload': '1', 'num_vm_rescued': '1', 'num_proj_83fd76d60c45450e986685d262adcd78': '1', 'num_proj_6f1bee9ee1c04149b8557934c3938a58': '1', 'num_proj_96c1552799934b6c80ecd7f89d497a79': '1', 'num_proj_6202ba11720e4772878029919cc6d682': '1', 'num_proj_8c59372a35d245a7b24ad6282d28e3d7': '1', 'num_proj_d687a155933b421c8c35d3a3655e35bc': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 02:00:59.434840 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:00:59.435011 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:59.440425 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Paused (Lifecycle Event) Jun 27 02:00:59.445173 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Took 9.98 seconds to spawn the instance on the hypervisor. Jun 27 02:00:59.445358 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:59.559354 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:00:59.559354 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:00:59.620187 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:00:59.658822 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:59.698582 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:59.710858 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:59.733560 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:59.761958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:00:59.915871 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:00:59.916056 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:00:59.939791 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:00:59.960474 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Took 16.16 seconds to build instance. Jun 27 02:00:59.970778 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:00:59.971089 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Resumed (Lifecycle Event) Jun 27 02:00:59.996903 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.022781 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Instance destroyed successfully. Jun 27 02:01:00.023520 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lazy-loading 'resources' on Instance uuid 117bc011-c34c-4a7e-8083-a032031054cb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:00.060995 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Detaching volume 9621ee79-a08c-4f4a-8f70-d868ebe57324 Jun 27 02:01:00.068485 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-20e4cd8c-fb71-4068-8356-6665e3270831 req-bf1657bf-8814-4118-9bad-8f1abf4a84e6 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:00.068696 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-20e4cd8c-fb71-4068-8356-6665e3270831 req-bf1657bf-8814-4118-9bad-8f1abf4a84e6 service nova] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:00.068936 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-20e4cd8c-fb71-4068-8356-6665e3270831 req-bf1657bf-8814-4118-9bad-8f1abf4a84e6 service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:00.069129 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-20e4cd8c-fb71-4068-8356-6665e3270831 req-bf1657bf-8814-4118-9bad-8f1abf4a84e6 service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:00.070248 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-20e4cd8c-fb71-4068-8356-6665e3270831 req-bf1657bf-8814-4118-9bad-8f1abf4a84e6 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] No waiting events found dispatching network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:00.071053 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-20e4cd8c-fb71-4068-8356-6665e3270831 req-bf1657bf-8814-4118-9bad-8f1abf4a84e6 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Attempting to driver detach volume 9621ee79-a08c-4f4a-8f70-d868ebe57324 from mountpoint /dev/vdb Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Found disk vdb by alias ua-9621ee79-a08c-4f4a-8f70-d868ebe57324 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Found disk vdb by alias ua-9621ee79-a08c-4f4a-8f70-d868ebe57324 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Attempting to detach device vdb from instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] detach device xml: Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: 9621ee79-a08c-4f4a-8f70-d868ebe57324 Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]:
Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: Jun 27 02:01:00.149080 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Successfully detached device vdb from instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 from the persistent domain config. Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] (1/8): Attempting to detach device vdb with device alias ua-9621ee79-a08c-4f4a-8f70-d868ebe57324 from instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] detach device xml: Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: 9621ee79-a08c-4f4a-8f70-d868ebe57324 Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]:
Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: Jun 27 02:01:00.192773 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:01:00.419942 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:00.465993 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.671s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:00.476429 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:00.485215 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:01:00.526757 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1856993571',display_name='tempest-AttachSCSIVolumeTestJSON-server-1856993571',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-attachscsivolumetestjson-server-1856993571',id=4,image_ref='7813580d-6730-4c93-aa15-fa46229391d6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ90jUdf0z3gf9wxvWe5E6IpnxVE1P6Do8je5VDSKyaFZMwI6pXNQSmTU419mli9VL8ApVkN4YEyJDzrCeHRmP2VgcilIOWf1B7ij8KT+43S4p1Iye9la7l7FpfyZb6qQ==',key_name='tempest-keypair-2007110502',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:01Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='83fd76d60c45450e986685d262adcd78',ramdisk_id='',reservation_id='r-8z40e7t6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7813580d-6730-4c93-aa15-fa46229391d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-534497572',owner_user_name='tempest-AttachSCSIVolumeTestJSON-534497572-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a7a7428581459bba5343e1a0dfc07e',uuid=117bc011-c34c-4a7e-8083-a032031054cb,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Converting VIF {"id": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "d31f8526-01c6-4ec5-ae33-f351ecee0417", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-466231212-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83fd76d60c45450e986685d262adcd78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1fcbb8-3c", "ovs_interfaceid": "7a1fcbb8-3c56-4cbe-b88e-9d824146b14a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a1fcbb8-3c, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:00.535755 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.536910 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.536910 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35d5325f-d959-4152-826d-20f0982e1c0a) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:00.539250 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.539250 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:00.539448 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:00.543636 np0000003818 nova-compute[98971]: INFO os_vif [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a,network=Network(d31f8526-01c6-4ec5-ae33-f351ecee0417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1fcbb8-3c') Jun 27 02:01:00.544245 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Deleting instance files /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb_del Jun 27 02:01:00.545438 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Deletion of /opt/stack/data/nova/instances/117bc011-c34c-4a7e-8083-a032031054cb_del complete Jun 27 02:01:00.918204 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-9621ee79-a08c-4f4a-8f70-d868ebe57324 for instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:01:00.930996 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 02:01:00.930996 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.811s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:00.930996 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.62 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:01:00.986856 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999710052000182 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:00.987579 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99930220400006 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:00.987904 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998642338000082 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:00.988708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-9621ee79-a08c-4f4a-8f70-d868ebe57324> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:01:00.991081 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Successfully detached device vdb from instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 from the live domain config. Jun 27 02:01:00.992479 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:01:00.992782 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:00.992921 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:00.993414 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:00.993775 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9621ee79-a08c-4f4a-8f70-d868ebe57324', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:01:00.993926 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:01.034600 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55054fdb-d863-4326-8e77-ef56d3c855b0', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '9')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:01:01.035441 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', '20')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:01:01.037255 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324', '21')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:01:01.038852 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Resulting device map defaultdict(. at 0x7decc02b7600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'): ({'sdr'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:01:01.039159 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Removing multipathed devices sdr, sdq {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:01:01.039432 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Flush multipath device 33000000025fd2296 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:01:01.056918 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Took 1.44 seconds to destroy the instance on the hypervisor. Jun 27 02:01:01.057255 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:01:01.058496 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:01:01.058496 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:01:01.058496 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:01.082563 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:01:01.145712 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:01:01.201578 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:01.214694 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Checking to see if SCSI volumes sdr, sdq have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:01:01.214694 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] SCSI volumes sdr, sdq have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:01:01.221449 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Checking to see if device paths {'sdr', 'sdq'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:01:01.243652 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Device paths {'sdr', 'sdq'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:01:01.243652 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:01:01.262082 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:01.322816 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.40.100,3260] Jun 27 02:01:01.322816 np0000003818 nova-compute[98971]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.40.100,3260] successful. Jun 27 02:01:01.322816 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:01.350521 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:01.364252 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:01.398135 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:01.417944 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.50.100,3260] Jun 27 02:01:01.417944 np0000003818 nova-compute[98971]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-9621ee79-a08c-4f4a-8f70-d868ebe57324, portal: 192.168.50.100,3260] successful. Jun 27 02:01:01.417944 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:01.454506 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:01.454506 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:01.454506 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] <== disconnect_volume: return (459ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:01.454506 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:01:01.551532 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:01:01.551985 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.08 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:01:01.679641 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:01.679641 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing instance network info cache due to event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:01:01.679641 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:01.679641 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:01.679641 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:01:01.900627 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] instance snapshotting Jun 27 02:01:02.038648 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Beginning live snapshot process Jun 27 02:01:02.164072 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lazy-loading 'flavor' on Instance uuid c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:02.185550 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:02.198823 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-39bf7280-3b6f-4f0b-9642-5f20e72e4f02 req-fdd8abe9-205a-4c8f-8e51-54349b6d3681 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:02.198823 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-39bf7280-3b6f-4f0b-9642-5f20e72e4f02 req-fdd8abe9-205a-4c8f-8e51-54349b6d3681 service nova] Acquiring lock "117bc011-c34c-4a7e-8083-a032031054cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:02.198823 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-39bf7280-3b6f-4f0b-9642-5f20e72e4f02 req-fdd8abe9-205a-4c8f-8e51-54349b6d3681 service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:02.198823 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-39bf7280-3b6f-4f0b-9642-5f20e72e4f02 req-fdd8abe9-205a-4c8f-8e51-54349b6d3681 service nova] Lock "117bc011-c34c-4a7e-8083-a032031054cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:02.198823 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-39bf7280-3b6f-4f0b-9642-5f20e72e4f02 req-fdd8abe9-205a-4c8f-8e51-54349b6d3681 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] No waiting events found dispatching network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:02.198823 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-39bf7280-3b6f-4f0b-9642-5f20e72e4f02 req-fdd8abe9-205a-4c8f-8e51-54349b6d3681 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-unplugged-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:01:02.225154 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:02.276924 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-37d28cae-8699-411a-90b3-183a5e8c784c req-451b7c2e-47a6-47ab-9e0b-4d5a0d35a2e8 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Received event network-vif-deleted-7a1fcbb8-3c56-4cbe-b88e-9d824146b14a {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:02.277755 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-37d28cae-8699-411a-90b3-183a5e8c784c req-451b7c2e-47a6-47ab-9e0b-4d5a0d35a2e8 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Neutron deleted interface 7a1fcbb8-3c56-4cbe-b88e-9d824146b14a; detaching it from the instance and deleting it from the info cache Jun 27 02:01:02.279515 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-37d28cae-8699-411a-90b3-183a5e8c784c req-451b7c2e-47a6-47ab-9e0b-4d5a0d35a2e8 service nova] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Detach interface failed, port_id=7a1fcbb8-3c56-4cbe-b88e-9d824146b14a, reason: Instance 117bc011-c34c-4a7e-8083-a032031054cb could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:01:02.625997 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:02.714146 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:02.832918 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updated VIF entry in instance network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:01:02.836273 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:03.160267 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-da62237a-96d9-4dbf-b197-f34d9e0cb865 tempest-VolumesAssistedSnapshotsTest-1529353610 tempest-VolumesAssistedSnapshotsTest-1529353610-project-admin] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.603s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:03.222846 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Took 2.17 seconds to deallocate network for instance. Jun 27 02:01:03.340320 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e4804d22-24c1-46de-8fb6-3e6f847d4179 req-1a1a9524-1398-4163-8b4c-8f7274adfb01 service nova] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:03.562788 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json -f qcow2 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:03.666512 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:03.667127 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json -f qcow2 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:03.731923 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:03.732437 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:03.780095 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json -f qcow2" returned: 0 in 0.098s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:03.780095 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:03.780095 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:03.780095 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:03.858512 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.088s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:03.859345 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq4ut_rd7/3e68f27f5ef7489ebf51b670bc175b95.delta 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:03.924329 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq4ut_rd7/3e68f27f5ef7489ebf51b670bc175b95.delta 1073741824" returned: 0 in 0.065s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:03.924805 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Quiescing instance not available: QEMU guest agent is not enabled. Jun 27 02:01:04.211370 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 27 02:01:04.357812 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:01:04.358154 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:01:04.716778 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] COPY block job progress, current cursor: 21430272 final cursor: 76742656 {{(pid=98971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 27 02:01:04.862464 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:05.219259 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 27 02:01:05.221285 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 27 02:01:05.252413 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:05.252604 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:05.252734 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:05.252893 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:05.253020 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:05.255431 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Terminating instance Jun 27 02:01:05.286840 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 02:01:05.287179 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq4ut_rd7/3e68f27f5ef7489ebf51b670bc175b95.delta /opt/stack/data/nova/instances/snapshots/tmpq4ut_rd7/3e68f27f5ef7489ebf51b670bc175b95 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:05.373727 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.641s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:05.472354 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Deleted allocations for instance 117bc011-c34c-4a7e-8083-a032031054cb Jun 27 02:01:05.539937 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:05.761151 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:01:05.790147 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:05.795219 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:05.822705 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:05.831209 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:05.862113 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:05.866017 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:06.042683 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b7efe6be-32fd-4a50-ae1c-df1818688b66 req-5ca69dd4-26ac-4847-8eb5-4c7d7d4b2622 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:06.042683 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b7efe6be-32fd-4a50-ae1c-df1818688b66 req-5ca69dd4-26ac-4847-8eb5-4c7d7d4b2622 service nova] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:06.042683 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b7efe6be-32fd-4a50-ae1c-df1818688b66 req-5ca69dd4-26ac-4847-8eb5-4c7d7d4b2622 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:06.042683 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b7efe6be-32fd-4a50-ae1c-df1818688b66 req-5ca69dd4-26ac-4847-8eb5-4c7d7d4b2622 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:06.042683 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b7efe6be-32fd-4a50-ae1c-df1818688b66 req-5ca69dd4-26ac-4847-8eb5-4c7d7d4b2622 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] No waiting events found dispatching network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:06.042683 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b7efe6be-32fd-4a50-ae1c-df1818688b66 req-5ca69dd4-26ac-4847-8eb5-4c7d7d4b2622 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:01:06.142222 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999597132999952 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:06.144255 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Instance destroyed successfully. Jun 27 02:01:06.144514 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lazy-loading 'resources' on Instance uuid c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:06.433462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq4ut_rd7/3e68f27f5ef7489ebf51b670bc175b95.delta /opt/stack/data/nova/instances/snapshots/tmpq4ut_rd7/3e68f27f5ef7489ebf51b670bc175b95" returned: 0 in 1.146s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:06.441710 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Snapshot extracted, beginning image upload Jun 27 02:01:06.485908 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-96acace4-568f-4bb5-b759-cea1ad7396fc tempest-AttachSCSIVolumeTestJSON-534497572 tempest-AttachSCSIVolumeTestJSON-534497572-project-member] Lock "117bc011-c34c-4a7e-8083-a032031054cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.375s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:06.647859 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-96634270',display_name='tempest-VolumesAssistedSnapshotsTest-server-96634270',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesassistedsnapshotstest-server-96634270',id=5,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRGxiDtl5FDdcjeTmvBt0hdqSPFmnwpnq56FTAgP91UPLrodZ20BGyzZHdYtHsE9XUHJI3d6bUnEdg4vhTisNQ+EHesKo7Rb7kHPs8VIexny4n73fUE/4S4Zo3WGyhRdw==',key_name='tempest-keypair-2100306775',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:07Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6f1bee9ee1c04149b8557934c3938a58',ramdisk_id='',reservation_id='r-ztbvuy3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-909756397',owner_user_name='tempest-VolumesAssistedSnapshotsTest-909756397-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='629334c529ac4873ad0ea78a432c130a',uuid=c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:01:06.648095 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Converting VIF {"id": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "address": "fa:16:3e:2a:ec:1a", "network": {"id": "abf84e22-77c6-462f-9abc-f17a87832cbc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-589172847-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f1bee9ee1c04149b8557934c3938a58", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b40d5c-59", "ovs_interfaceid": "e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:06.648840 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:06.649156 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:01:06.650787 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:06.651121 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b40d5c-59, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:06.655528 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:06.655528 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:06.656431 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:06.656683 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67a2272c-7b20-4ce8-8cb3-4296e56b5b96) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:06.658302 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:06.660068 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:06.661765 np0000003818 nova-compute[98971]: INFO os_vif [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:ec:1a,bridge_name='br-int',has_traffic_filtering=True,id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c,network=Network(abf84e22-77c6-462f-9abc-f17a87832cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b40d5c-59') Jun 27 02:01:06.662177 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Deleting instance files /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1_del Jun 27 02:01:06.665061 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Deletion of /opt/stack/data/nova/instances/c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1_del complete Jun 27 02:01:06.687341 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:07.171825 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Took 1.41 seconds to destroy the instance on the hypervisor. Jun 27 02:01:07.172486 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:01:07.172716 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:01:07.172842 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:01:07.173130 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:07.221269 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:07.253751 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:08.130792 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f44cefee-fa65-42e7-a067-d523011f372b req-4d0b6f39-65dd-4199-a800-91392dee0279 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:08.131472 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f44cefee-fa65-42e7-a067-d523011f372b req-4d0b6f39-65dd-4199-a800-91392dee0279 service nova] Acquiring lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:08.133658 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f44cefee-fa65-42e7-a067-d523011f372b req-4d0b6f39-65dd-4199-a800-91392dee0279 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:08.133898 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f44cefee-fa65-42e7-a067-d523011f372b req-4d0b6f39-65dd-4199-a800-91392dee0279 service nova] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:08.136229 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f44cefee-fa65-42e7-a067-d523011f372b req-4d0b6f39-65dd-4199-a800-91392dee0279 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] No waiting events found dispatching network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:08.136229 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f44cefee-fa65-42e7-a067-d523011f372b req-4d0b6f39-65dd-4199-a800-91392dee0279 service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-unplugged-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:01:08.383728 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a2cc174a-1e92-4f9e-b1e2-129a5a2a41be req-07f7cce2-046d-4a31-b699-e459a212ef5f service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Received event network-vif-deleted-e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:08.384389 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-a2cc174a-1e92-4f9e-b1e2-129a5a2a41be req-07f7cce2-046d-4a31-b699-e459a212ef5f service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Neutron deleted interface e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c; detaching it from the instance and deleting it from the info cache Jun 27 02:01:08.393135 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a2cc174a-1e92-4f9e-b1e2-129a5a2a41be req-07f7cce2-046d-4a31-b699-e459a212ef5f service nova] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Detach interface failed, port_id=e4b40d5c-59c2-4ba9-86b0-19cb8a9cbb2c, reason: Instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:01:08.811720 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:09.314456 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Took 2.14 seconds to deallocate network for instance. Jun 27 02:01:09.830679 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:09.830902 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:10.380818 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:01:10.380818 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:01:10.883477 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:11.409025 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.578s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:11.421801 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Snapshot image upload complete Jun 27 02:01:11.422117 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4c006336-c036-4e8b-a454-3f55712dd6be tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Took 9.52 seconds to snapshot the instance on the hypervisor. Jun 27 02:01:11.550030 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Deleted allocations for instance c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1 Jun 27 02:01:11.658572 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:12.231619 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:12.476836 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:12.560120 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-f28f2427-f90e-420c-9044-b677fcdcd6a3 tempest-VolumesAssistedSnapshotsTest-909756397 tempest-VolumesAssistedSnapshotsTest-909756397-project-member] Lock "c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.307s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:13.985706 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:13.987197 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:14.493731 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'flavor' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:15.164063 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:01:15.508941 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.522s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:15.604395 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:15.659256 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:15.987984 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000576535999925909 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:15.987984 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:15.987984 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.154369354999972 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:15.987984 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.1542585989998315 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:15.991158 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:15.991158 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] VM Stopped (Lifecycle Event) Jun 27 02:01:16.492848 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 117bc011-c34c-4a7e-8083-a032031054cb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:16.622074 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:16.622398 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:16.622880 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attaching volume fd34a13d-e79e-44d1-bab3-eb4ad65ef01e to /dev/vdb Jun 27 02:01:16.665316 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:16.680726 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:16.693943 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:01:16.720990 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:16.756676 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:01:16.757416 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:01:16.767216 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:01:16.769567 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe58:552b', 'fe80::fc9d:c9ff:feea:6a6c', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:b215', 'fe80::fc16:3eff:fee8:66b6', 'fe80::4410:b5ff:fe74:fbb2', 'fe80::fc16:3eff:fea6:83f8', 'fe80::fc16:3eff:feff:bfd1', 'fe80::fc16:3eff:fe92:52e2', 'fe80::fc16:3eff:febf:27d3', 'fe80::fc16:3eff:fe52:676', 'fe80::980a:61ff:fe78:5465', 'fe80::fc16:3eff:fefa:8b3f', 'fe80::984c:cff:fec4:61ff', 'fe80::30fb:ceff:fe90:4fe3', 'fe80::fc16:3eff:fe07:efef', 'fe80::fc16:3eff:fe21:b7a8', 'fe80::a031:5ff:fe73:c733', 'fe80::fc16:3eff:fee1:1ebf', 'fe80::fc16:3eff:fe26:b31d', 'fe80::fc16:3eff:fe37:e1b', 'fe80::fc16:3eff:fe4b:61ca', 'fe80::6c2c:39ff:fe36:13f1', 'fe80::fc16:3eff:fe38:9043', 'fe80::8c65:53ff:fe5c:18a3', 'fe80::fc16:3eff:fe7d:c2bb'] Jun 27 02:01:16.769762 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:01:16.769919 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:01:16.770315 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:16.770515 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating existing volume attachment record: 3852393a-5c53-4e44-a8ab-8f7448714416 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:01:17.234850 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:17.353126 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:01:17.353544 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:17.353774 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:17.354455 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:17.354807 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:01:17.372665 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:17.373386 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:17.374233 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:17.374708 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:17.375185 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:17.375470 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:17.387641 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:17.387641 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:17.392573 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:17.392573 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e] added Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:17.402438 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:17.402783 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:17.402961 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:17.403191 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e] added Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:17.409303 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:17.409676 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:17.409676 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:17.409958 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:18.360298 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:18.403888 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:18.410681 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:18.419488 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:18.429664 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.436469 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.444383 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.459283 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.459774 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.469385 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.470032 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:18.523199 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.40.100,3260] Jun 27 02:01:18.523199 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.40.100,3260] successful. Jun 27 02:01:18.523199 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.534085 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.50.100,3260] Jun 27 02:01:18.534085 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.50.100,3260] successful. Jun 27 02:01:18.534085 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.543997 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.554091 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.567573 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:18.568597 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:18.570371 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] HCTL ('20', '-', '-', 0) found on session 23 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:18.570821 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.585632 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae1cf72f-e922-47b9-86e8-8a59aff120a3 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:18.587532 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:18.588903 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:18.589758 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:18.593789 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] HCTL ('21', '-', '-', 0) found on session 24 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:18.593789 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:18.599421 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching for a device in session 23 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:18.599421 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:18.623582 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching for a device in session 24 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:18.623582 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:19.375043 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:01:20.397263 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Found WWN 3300000008b3d19ae for multipath device dm-10 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:01:20.399422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:20.399422 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '3300000008b3d19ae', 'path': '/dev/dm-10', 'multipath_id': '3300000008b3d19ae'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:20.399422 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b3d19ae', 'path': '/dev/dm-10', 'multipath_id': '3300000008b3d19ae'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:01:20.402480 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'flavor' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:20.908658 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attempting to attach volume fd34a13d-e79e-44d1-bab3-eb4ad65ef01e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] attach device xml: Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: Jun 27 02:01:20.910030 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:01:21.144065 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001942960000178573 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:21.144065 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:21.144939 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:21.147557 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] VM Stopped (Lifecycle Event) Jun 27 02:01:21.307326 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:21.652439 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: c7ccd69d-f19c-4945-a2f1-8990b7d3c8b1] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:21.666170 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:22.251854 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:22.606095 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:22.606360 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:22.606360 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:22.606454 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No VIF found with MAC fa:16:3e:58:55:2b, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:01:23.292183 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:24.193563 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-247bdb6e-6347-4f44-875e-2a5e50447688 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.571s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:24.881728 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Rescuing Jun 27 02:01:24.882251 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:24.882251 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:24.882251 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:01:25.384239 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:25.747962 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:25.896926 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:26.039332 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:26.399951 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:26.674679 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:27.254444 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:27.887175 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:28.035429 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:28.039876 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:28.062761 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:28.067929 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:28.092308 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:28.336927 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-978eded1-1473-468d-a1df-a9af908c56a2 req-9fe5e4ad-36bd-415f-998a-0df4d6381859 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:28.337448 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-978eded1-1473-468d-a1df-a9af908c56a2 req-9fe5e4ad-36bd-415f-998a-0df4d6381859 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:28.337529 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-978eded1-1473-468d-a1df-a9af908c56a2 req-9fe5e4ad-36bd-415f-998a-0df4d6381859 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:28.337736 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-978eded1-1473-468d-a1df-a9af908c56a2 req-9fe5e4ad-36bd-415f-998a-0df4d6381859 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:28.337832 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-978eded1-1473-468d-a1df-a9af908c56a2 req-9fe5e4ad-36bd-415f-998a-0df4d6381859 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:28.338012 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-978eded1-1473-468d-a1df-a9af908c56a2 req-9fe5e4ad-36bd-415f-998a-0df4d6381859 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state active and task_state rescuing. Jun 27 02:01:28.363732 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.99964749500009 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:28.364068 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999193732000094 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:28.364464 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99904131900007 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:28.367898 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance destroyed successfully. Jun 27 02:01:28.368311 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'numa_topology' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:28.874002 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attempting a stable device rescue Jun 27 02:01:28.993294 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 27 02:01:28.997506 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance directory exists: not creating {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 27 02:01:28.997870 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Creating image(s) Jun 27 02:01:28.998488 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:28.998707 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:28.999882 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:29.000144 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'trusted_certs' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:29.505063 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:29.505063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:29.508676 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:29.596225 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:29.933353 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:29.933645 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:30.438173 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'flavor' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:30.443509 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-00800d4f-1869-447c-8593-31ce0b69abba req-bc4eeb20-7a91-45d9-ab8b-78dec877b80c service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:30.444837 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-00800d4f-1869-447c-8593-31ce0b69abba req-bc4eeb20-7a91-45d9-ab8b-78dec877b80c service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:30.445144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-00800d4f-1869-447c-8593-31ce0b69abba req-bc4eeb20-7a91-45d9-ab8b-78dec877b80c service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:30.445270 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-00800d4f-1869-447c-8593-31ce0b69abba req-bc4eeb20-7a91-45d9-ab8b-78dec877b80c service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:30.445479 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-00800d4f-1869-447c-8593-31ce0b69abba req-bc4eeb20-7a91-45d9-ab8b-78dec877b80c service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:30.445665 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-00800d4f-1869-447c-8593-31ce0b69abba req-bc4eeb20-7a91-45d9-ab8b-78dec877b80c service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state active and task_state rescuing. Jun 27 02:01:30.691551 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:30.691551 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:30.691551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.part --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:30.783392 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:30.796073 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.part --force-share --output=json" returned: 0 in 0.112s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:30.796310 np0000003818 nova-compute[98971]: DEBUG nova.virt.images [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] 5e040cf0-8ffa-4dd2-a82f-3a24811a368f was qcow2, converting to raw {{(pid=98971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 27 02:01:30.797484 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 02:01:30.798178 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.part /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.converted {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:31.454719 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.521s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:31.678196 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:31.702753 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.part /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.converted" returned: 0 in 0.905s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:31.719176 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.converted --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:31.813894 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6.converted --force-share --output=json" returned: 0 in 0.090s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:31.813894 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 2.304s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:31.813894 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:31.814643 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:31.818354 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:31.818354 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:31.819217 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:31.826653 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:31.826838 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6 --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:31.918456 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6 --force-share --output=json" returned: 0 in 0.091s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:31.919114 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6,backing_fmt=raw /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.rescue {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:32.003268 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6,backing_fmt=raw /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.rescue" returned: 0 in 0.084s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:32.004233 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "1f1b8a4cd44d58c4d2662c55ce1b76772ed4d2a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.187s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:32.005538 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'migration_context' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:32.204873 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:32.259932 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:32.510997 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:32.510997 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:01:32.512492 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Start _get_guest_xml network_info=[{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "vif_mac": "fa:16:3e:58:55:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue={'image_id': '5e040cf0-8ffa-4dd2-a82f-3a24811a368f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, 'status': 'reserved', 'instance': '536746ce-ca15-4708-b1f0-9aca4dc185e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'serial': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'}, 'attachment_id': '3852393a-5c53-4e44-a8ab-8f7448714416', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:01:32.513282 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'resources' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:32.716840 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:32.717490 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:32.717490 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Attaching volume 213a9d41-f273-4d1c-9412-283ee3b32c09 to /dev/vdb Jun 27 02:01:32.782284 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:32.796308 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:01:32.823217 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:32.855414 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:b215', 'fe80::fc16:3eff:fee8:66b6', 'fe80::4410:b5ff:fe74:fbb2', 'fe80::fc16:3eff:fea6:83f8', 'fe80::fc16:3eff:feff:bfd1', 'fe80::fc16:3eff:fe92:52e2', 'fe80::fc16:3eff:febf:27d3', 'fe80::fc16:3eff:fe52:676', 'fe80::980a:61ff:fe78:5465', 'fe80::fc16:3eff:fefa:8b3f', 'fe80::984c:cff:fec4:61ff', 'fe80::30fb:ceff:fe90:4fe3', 'fe80::fc16:3eff:fe07:efef', 'fe80::fc16:3eff:fe21:b7a8', 'fe80::a031:5ff:fe73:c733', 'fe80::fc16:3eff:fee1:1ebf', 'fe80::fc16:3eff:fe26:b31d', 'fe80::fc16:3eff:fe37:e1b', 'fe80::fc16:3eff:fe4b:61ca', 'fe80::6c2c:39ff:fe36:13f1', 'fe80::fc16:3eff:fe38:9043', 'fe80::8c65:53ff:fe5c:18a3', 'fe80::fc16:3eff:fe7d:c2bb'] Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:32.873162 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating existing volume attachment record: 7152ea38-5825-40c9-9e7c-8fc51adeae44 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:01:33.018661 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1697177352', uuid='536746ce-ca15-4708-b1f0-9aca4dc185e5'), owner=OwnerMeta(userid='0054898809a24ab39080e132cd20ec96', username='tempest-ServerStableDeviceRescueTest-686305345-project-member', projectid='8c59372a35d245a7b24ad6282d28e3d7', projectname='tempest-ServerStableDeviceRescueTest-686305345'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "vif_mac": "fa:16:3e:58:55:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525693.0218403) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:01:33.027886 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:01:33.028821 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:01:33.042381 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'vcpu_model' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:33.469829 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:01:33.471308 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:33.471308 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:33.472273 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:33.477370 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:01:33.489353 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:33.489777 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:33.490433 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:33.490671 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:33.500095 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:33.500095 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:33.506432 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:33.506432 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:33.508683 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:33.508683 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09] added Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:33.521487 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:33.522838 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:33.522838 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09] added Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:33.525472 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:33.528847 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:33.528847 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:33.528847 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:33.533126 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:33.544477 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:33.629618 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:33.630295 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:33.631439 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:33.631672 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "/opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:33.632064 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:01:33.632454 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:33.632667 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:34.522703 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:34.526704 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:34.535009 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:34.544801 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.556673 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.564611 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.581494 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.591080 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:34.654041 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] Jun 27 02:01:34.654041 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] successful. Jun 27 02:01:34.654041 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.660628 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] Jun 27 02:01:34.660628 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] successful. Jun 27 02:01:34.660628 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.668993 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.675916 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.701003 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.701711 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:34.702365 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:34.702365 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.702517 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:34.703068 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:34.707235 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] HCTL ('22', '-', '-', 0) found on session 26 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:34.707482 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:34.708762 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] HCTL ('23', '-', '-', 0) found on session 27 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:34.708942 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:34.726296 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 27 and hctl ['23', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:34.744085 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 26 and hctl ['22', '*', '*', 0] yield: sdr {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:34.744085 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:35.727776 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 27 and hctl ['23', '*', '*', 0] yield: sdq {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:35.727776 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:36.510270 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Found WWN 330000000032d291d for multipath device dm-11 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:01:36.510617 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:36.510792 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000032d291d', 'path': '/dev/dm-11', 'multipath_id': '330000000032d291d'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:36.510907 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000032d291d', 'path': '/dev/dm-11', 'multipath_id': '330000000032d291d'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:01:36.511734 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.879s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:36.513211 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:01:36.513984 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'flavor' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:36.530329 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:36.531339 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:36.532064 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:36.532446 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:36.532878 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:36.533151 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.startup = automatic Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.scan = manual Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:36.550303 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.startup = automatic Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.scan = manual Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:36.553480 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:36.564726 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:36.569856 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.589293 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:36.590255 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:36.590255 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:36.590705 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] HCTL ('20', '0', '0', 0) found on session 23 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:36.591761 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.594776 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:36.595493 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:36.595905 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:36.595905 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:36.596911 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] HCTL ('21', '0', '0', 0) found on session 24 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:36.597131 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:36.606181 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching for a device in session 23 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:36.606181 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:36.608296 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Searching for a device in session 24 and hctl ('21', '0', '0', 0) yield: sdp {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:36.608439 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:36.678839 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:37.019356 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Attempting to attach volume 213a9d41-f273-4d1c-9412-283ee3b32c09 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] attach device xml: Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: 213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: Jun 27 02:01:37.022360 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:01:37.265047 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:37.535429 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:01:37.591898 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:38.265049 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:38.265523 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:38.554423 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Found WWN 3300000008b3d19ae for multipath device dm-10 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:01:38.554925 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.043s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:38.555170 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] <== connect_volume: return (4922ms) {'type': 'block', 'scsi_wwn': '3300000008b3d19ae', 'path': '/dev/dm-10', 'multipath_id': '3300000008b3d19ae'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:38.555347 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b3d19ae', 'path': '/dev/dm-10', 'multipath_id': '3300000008b3d19ae'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:01:38.710291 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:38.710291 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:38.710291 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:38.710503 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No VIF found with MAC fa:16:3e:fa:8b:3f, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:01:38.771991 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'flavor' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:39.062101 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1697177352',display_name='tempest-ServerStableDeviceRescueTest-server-1697177352',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverstabledevicerescuetest-server-1697177352',id=8,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9yf02HargSaAeo/3gzQ1u/ovITL4PxYzZDhIE1ZjiQobiZLbRakEZ392FVeXytMbnK/SoojofaeCb1tmEHICneTo68Me+KYfv1eTRb1CvFmWIrdCPCMLPCZeZJHbFXtw==',key_name='tempest-keypair-638937042',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:19Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8c59372a35d245a7b24ad6282d28e3d7',ramdisk_id='',reservation_id='r-fdt0sx0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-686305345',owner_user_name='tempest-ServerStableDeviceRescueTest-686305345-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054898809a24ab39080e132cd20ec96',uuid=536746ce-ca15-4708-b1f0-9aca4dc185e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "vif_mac": "fa:16:3e:58:55:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:01:39.062363 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converting VIF {"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "vif_mac": "fa:16:3e:58:55:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:39.063729 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:39.064374 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'pci_devices' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:39.103800 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] End _get_guest_xml xml= Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: instance-00000008 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 196608 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: tempest-ServerStableDeviceRescueTest-server-1697177352 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 2026-06-27 02:01:33 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 192 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: True Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: bare Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: ide Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: pc Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: tempest-ServerStableDeviceRescueTest-686305345-project-member Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: tempest-ServerStableDeviceRescueTest-686305345 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: hvm Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 128 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance destroyed successfully. Jun 27 02:01:40.194795 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:40.298555 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cda4337f-0a81-4a72-853f-2d8840b1f0e1 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.581s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:40.662618 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:41.105429 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:41.105598 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:41.105725 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:41.105815 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:41.105926 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] No VIF found with MAC fa:16:3e:58:55:2b, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:01:41.107011 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Using config drive Jun 27 02:01:41.389816 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:41.390359 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:41.390359 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Attaching volume d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 to /dev/vdb Jun 27 02:01:41.461779 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:41.480727 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:01:41.535094 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:41.553547 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:41.573639 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:01:41.574037 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:01:41.584383 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:01:41.586665 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:b215', 'fe80::fc16:3eff:fee8:66b6', 'fe80::4410:b5ff:fe74:fbb2', 'fe80::fc16:3eff:fea6:83f8', 'fe80::fc16:3eff:feff:bfd1', 'fe80::fc16:3eff:fe92:52e2', 'fe80::fc16:3eff:febf:27d3', 'fe80::fc16:3eff:fe52:676', 'fe80::980a:61ff:fe78:5465', 'fe80::fc16:3eff:fefa:8b3f', 'fe80::984c:cff:fec4:61ff', 'fe80::30fb:ceff:fe90:4fe3', 'fe80::fc16:3eff:fe07:efef', 'fe80::fc16:3eff:fe21:b7a8', 'fe80::a031:5ff:fe73:c733', 'fe80::fc16:3eff:fee1:1ebf', 'fe80::fc16:3eff:fe26:b31d', 'fe80::fc16:3eff:fe37:e1b', 'fe80::fc16:3eff:fe4b:61ca', 'fe80::6c2c:39ff:fe36:13f1', 'fe80::fc16:3eff:fe38:9043', 'fe80::8c65:53ff:fe5c:18a3', 'fe80::fc16:3eff:fe7d:c2bb'] Jun 27 02:01:41.586904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:01:41.587105 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:01:41.587403 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:41.587700 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating existing volume attachment record: 2855d424-8a5b-48e7-b642-196de6ca1051 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:01:41.612091 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'ec2_ids' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:41.680555 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:42.120794 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:42.120996 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'keypairs' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:42.186330 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:01:42.186915 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:42.187415 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:42.188191 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:42.189048 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:01:42.203009 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:42.203844 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:42.204325 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:42.204518 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:42.205008 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:42.206022 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:42.222268 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:42.222268 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:42.233853 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:42.233853 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364] added Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:42.240940 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:42.241240 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:42.242689 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364] added Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:42.249088 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:42.249672 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:42.250029 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:42.270288 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:42.625889 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:42.630090 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:42.830954 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Creating config drive at /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config.rescue Jun 27 02:01:42.836927 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp562mp6od {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:42.881828 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp562mp6od" returned: 0 in 0.045s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:43.244796 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:43.250622 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:43.272201 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Stashing vm_state: active {{(pid=98971) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:43.279180 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:01:43.282043 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.296984 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.302080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.329591 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.330187 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.331115 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.331662 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:43.363892 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005847249999533233 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:43.364620 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:43.364986 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:43.365246 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Stopped (Lifecycle Event) Jun 27 02:01:43.422936 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.50.100,3260] Jun 27 02:01:43.422936 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.50.100,3260] successful. Jun 27 02:01:43.422936 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.433173 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.40.100,3260] Jun 27 02:01:43.433173 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.40.100,3260] successful. Jun 27 02:01:43.433173 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.435153 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.441566 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.451342 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:43.471590 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.475760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.277s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:43.482341 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:43.483894 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] HCTL ('24', '-', '-', 0) found on session 28 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:43.483894 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afcf8820-3740-4739-91bd-af59bf039099 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:43.496090 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:01:43.503481 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] HCTL ('25', '-', '-', 0) found on session 29 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:01:43.503481 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Scanning host 25 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:01:43.516183 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching for a device in session 28 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:43.516183 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:43.526648 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching for a device in session 29 and hctl ['25', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:43.579588 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.792885 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f5f37a75-a8c4-479f-a45a-0cc2e6fbf3e9 req-eefea0dd-5995-4547-b183-2c3faab2b99c service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:43.792885 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f5f37a75-a8c4-479f-a45a-0cc2e6fbf3e9 req-eefea0dd-5995-4547-b183-2c3faab2b99c service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:43.793355 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f5f37a75-a8c4-479f-a45a-0cc2e6fbf3e9 req-eefea0dd-5995-4547-b183-2c3faab2b99c service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:43.793355 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f5f37a75-a8c4-479f-a45a-0cc2e6fbf3e9 req-eefea0dd-5995-4547-b183-2c3faab2b99c service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:43.793563 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f5f37a75-a8c4-479f-a45a-0cc2e6fbf3e9 req-eefea0dd-5995-4547-b183-2c3faab2b99c service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:43.793766 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f5f37a75-a8c4-479f-a45a-0cc2e6fbf3e9 req-eefea0dd-5995-4547-b183-2c3faab2b99c service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state active and task_state rescuing. Jun 27 02:01:43.864857 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:43.865192 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:43.869515 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b5eecd27-f462-47f3-857a-3e7adae1048a tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:43.916640 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.921112 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.922768 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.926198 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:43.954939 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:44.374723 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:01:44.375179 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Claim successful on node np0000003818 Jun 27 02:01:44.527720 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching for a device in session 29 and hctl ['25', '*', '*', 0] yield: sdt {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:01:44.527921 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Connected to sdt using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:01:44.731842 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:44.734664 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-a3d5de4a-a3d1-4985-a8cb-b154a689800e tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:44.734664 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Resumed (Lifecycle Event) Jun 27 02:01:44.883098 np0000003818 nova-compute[98971]: INFO nova.compute.resource_tracker [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating resource usage from migration 8eda7e1f-5d6c-4ffa-9976-7413e948dac5 Jun 27 02:01:45.223795 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Found WWN 3300000008d80fb60 for multipath device dm-12 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:01:45.224148 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:45.224352 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008d80fb60', 'path': '/dev/dm-12', 'multipath_id': '3300000008d80fb60'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:45.224593 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008d80fb60', 'path': '/dev/dm-12', 'multipath_id': '3300000008d80fb60'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:01:45.228535 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'flavor' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:45.237255 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:45.240779 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:01:45.470763 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:01:45.471060 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:01:45.639827 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:45.732450 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Attempting to attach volume d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] attach device xml: Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: Jun 27 02:01:45.736573 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:01:45.744983 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:45.745139 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Started (Lifecycle Event) Jun 27 02:01:45.883924 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-4bf99be8-7214-4e3a-a304-1d10db617b7c req-4832d5c9-8cdd-4cf9-ae0b-2a1cca459916 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:45.883924 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4bf99be8-7214-4e3a-a304-1d10db617b7c req-4832d5c9-8cdd-4cf9-ae0b-2a1cca459916 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:45.884390 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4bf99be8-7214-4e3a-a304-1d10db617b7c req-4832d5c9-8cdd-4cf9-ae0b-2a1cca459916 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:45.884390 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4bf99be8-7214-4e3a-a304-1d10db617b7c req-4832d5c9-8cdd-4cf9-ae0b-2a1cca459916 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:45.885810 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-4bf99be8-7214-4e3a-a304-1d10db617b7c req-4832d5c9-8cdd-4cf9-ae0b-2a1cca459916 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:45.885810 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-4bf99be8-7214-4e3a-a304-1d10db617b7c req-4832d5c9-8cdd-4cf9-ae0b-2a1cca459916 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state rescued and task_state None. Jun 27 02:01:45.974259 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:46.248480 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:46.256162 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:01:46.483611 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.618s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:46.483766 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Migrating Jun 27 02:01:46.483940 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:46.484059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:46.683038 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:46.755587 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Unrescuing Jun 27 02:01:46.755837 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:46.755950 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:46.756158 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:01:46.760419 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 27 02:01:46.987760 np0000003818 nova-compute[98971]: INFO nova.compute.rpcapi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jun 27 02:01:46.988469 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:46.988719 np0000003818 nova-compute[98971]: DEBUG nova.compute.rpcapi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 27 02:01:47.259033 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:47.273920 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:47.446803 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:47.446915 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:47.447064 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:47.447162 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:7d:c2:bb, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:01:47.509663 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:47.513603 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:47.513603 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:01:47.738986 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:47.828320 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:48.015656 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:48.074402 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:48.167224 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:48.167396 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing instance network info cache due to event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:01:48.167623 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:48.435054 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:48.576807 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:48.577390 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'flavor' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:48.580955 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:48.581175 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:01:48.638580 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:01:48.638732 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Cleaning up deleted instances {{(pid=98971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} Jun 27 02:01:48.665781 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:49.084945 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0c71c821-df63-42cc-b5b1-c499f5c4fc1e tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.695s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:49.087604 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:49.138646 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:49.144289 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] There are 0 instances to clean {{(pid=98971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} Jun 27 02:01:49.144714 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:01:49.144949 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Cleaning up deleted instances with incomplete migration {{(pid=98971) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} Jun 27 02:01:49.146810 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:49.170022 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:49.182696 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:49.185706 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:49.213233 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:49.388572 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e314fdae-3a46-4dd0-a104-6190d3d82980 req-ed7a7efc-1725-425f-902e-56afe78de6d3 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:49.388572 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e314fdae-3a46-4dd0-a104-6190d3d82980 req-ed7a7efc-1725-425f-902e-56afe78de6d3 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:49.388572 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e314fdae-3a46-4dd0-a104-6190d3d82980 req-ed7a7efc-1725-425f-902e-56afe78de6d3 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:49.388572 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e314fdae-3a46-4dd0-a104-6190d3d82980 req-ed7a7efc-1725-425f-902e-56afe78de6d3 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:49.388572 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e314fdae-3a46-4dd0-a104-6190d3d82980 req-ed7a7efc-1725-425f-902e-56afe78de6d3 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:49.388572 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-e314fdae-3a46-4dd0-a104-6190d3d82980 req-ed7a7efc-1725-425f-902e-56afe78de6d3 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:01:49.469515 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999751929999775 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:49.469941 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99924830499981 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:49.470080 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999122891999832 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:49.471324 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance destroyed successfully. Jun 27 02:01:49.471768 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'numa_topology' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:49.541196 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:49.552343 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Rescuing Jun 27 02:01:49.552597 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:49.552742 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:49.552903 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:01:49.649578 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:01:49.717705 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updated VIF entry in instance network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:01:49.718013 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:49.773857 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:49.774065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:49.928761 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:49.928897 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:49.973857 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Object Instance<536746ce-ca15-4708-b1f0-9aca4dc185e5> lazy-loaded attributes: flavor,numa_topology {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:50.050334 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:50.050539 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:50.066191 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:50.150293 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:01:50.220154 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b957855-0293-48a9-8cf5-99518effca02 req-a571b0a0-f79b-4d81-b0af-692eb510d4ab service nova] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:50.225234 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:50.225621 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing instance network info cache due to event network-changed-c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:01:50.225792 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] Acquiring lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:50.225910 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] Acquired lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:50.226090 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Refreshing network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:01:50.275739 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:01:50.420406 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.438153 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:01:50.449957 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.451242 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.536961 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:50.551351 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.555014 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:01:50.685774 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Starting migrate_disk_and_power_off {{(pid=98971) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}} Jun 27 02:01:50.707654 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.711208 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.728314 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:50.733509 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.743676 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.750849 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.752961 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.760294 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:50.781338 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.782769 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.846629 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:50.846796 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:50.856414 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:01:50.856414 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Claim successful on node np0000003818 Jun 27 02:01:50.892474 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.918467 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.919326 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:50.925360 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-52557523-54bd-4ca5-95af-b566cdfba974 req-5504795b-977b-4826-9da9-bd9f35f6b12e service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:50.926703 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-52557523-54bd-4ca5-95af-b566cdfba974 req-5504795b-977b-4826-9da9-bd9f35f6b12e service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:50.926822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-52557523-54bd-4ca5-95af-b566cdfba974 req-5504795b-977b-4826-9da9-bd9f35f6b12e service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:50.926944 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-52557523-54bd-4ca5-95af-b566cdfba974 req-5504795b-977b-4826-9da9-bd9f35f6b12e service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:50.928060 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-52557523-54bd-4ca5-95af-b566cdfba974 req-5504795b-977b-4826-9da9-bd9f35f6b12e service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:50.928246 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-52557523-54bd-4ca5-95af-b566cdfba974 req-5504795b-977b-4826-9da9-bd9f35f6b12e service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state active and task_state resize_migrating. Jun 27 02:01:51.050115 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999651873000175 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:51.059851 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance destroyed successfully. Jun 27 02:01:51.062123 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:01:51.062123 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:51.063030 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:51.063424 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:01:51.073758 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:51.074908 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72cdd58-08, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:51.077318 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:51.078819 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:51.081209 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:51.081471 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb67c092-3f55-4ad6-b910-e644fc27d2f5) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:51.090654 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:51.091493 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:51.096187 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:51.099465 np0000003818 nova-compute[98971]: INFO os_vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') Jun 27 02:01:51.100680 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:01:51.101030 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:51.101209 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:51.101629 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:51.102023 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:01:51.102206 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:01:51.117061 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:51.149634 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:51.152793 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '9')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:01:51.154096 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '27')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:01:51.155887 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '26')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:01:51.156493 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Resulting device map defaultdict(. at 0x7decc0546d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'): ({'sdr'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:01:51.156649 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Removing multipathed devices sdr, sdq {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:01:51.156896 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flush multipath device 330000000032d291d {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:01:51.187316 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:01:51.251240 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:01:51.251240 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:51.263002 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:51.278723 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking to see if SCSI volumes sdr, sdq have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:01:51.278723 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] SCSI volumes sdr, sdq have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:01:51.280329 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking to see if device paths {'sdr', 'sdq'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:01:51.291685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Device paths {'sdr', 'sdq'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:01:51.291924 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:01:51.307546 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:51.353904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] Jun 27 02:01:51.353904 np0000003818 nova-compute[98971]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] successful. Jun 27 02:01:51.353904 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:51.385911 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:51.399194 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:51.415233 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updated VIF entry in instance network info cache for port c85dd54a-d4ef-48d4-bcf6-723ac647e834. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:01:51.415523 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [{"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:51.442255 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] Jun 27 02:01:51.442255 np0000003818 nova-compute[98971]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] successful. Jun 27 02:01:51.442255 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:51.449827 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:51.450334 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:51.450827 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:51.451038 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:51.451082 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:51.451264 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:01:51.451447 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:51.451639 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:51.451822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:51.451987 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:51.452154 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:51.452316 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:01:51.452471 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:51.452652 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:51.452817 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:51.453243 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:51.453393 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:51.453582 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cedf8018-cfc0-46b0-8833-23558bf9cb08 req-41db0134-d838-4ea8-a971-b3697172e181 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received unexpected event network-vif-plugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:01:51.475185 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:51.475330 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:01:51.475478 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== disconnect_volume: return (374ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:51.475670 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:01:51.478242 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:51.559362 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:51.559887 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:51.617463 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for 536746ce-ca15-4708-b1f0-9aca4dc185e5 due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:01:51.617767 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:51.618197 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Resumed (Lifecycle Event) Jun 27 02:01:51.620337 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c28c77da-1a5a-4ef7-bb8d-2c5fd04a4e23 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:51.645175 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:51.645696 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:01:51.646492 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_resize/disk /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:51.738532 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "cp -r /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_resize/disk /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk" returned: 0 in 0.092s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:51.738954 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_resize/disk.config /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:51.780291 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "cp -r /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_resize/disk.config /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config" returned: 0 in 0.041s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:51.780702 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_resize/disk.info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:51.809126 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "cp -r /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_resize/disk.info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" returned: 0 in 0.028s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:51.918292 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-be5286d4-f7fb-48d2-b478-a1388d35d3c7 req-d339d1ca-d972-40ff-b9f2-1190c84d8bc9 service nova] Releasing lock "refresh_cache-536746ce-ca15-4708-b1f0-9aca4dc185e5" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:52.121836 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:52.124054 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:01:52.144666 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:01:52.145031 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:01:52.274945 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:52.470654 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:01:52.470897 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:01:52.627045 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:01:52.627185 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Started (Lifecycle Event) Jun 27 02:01:52.650214 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:52.921259 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:52.936617 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:52.949040 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:52.977484 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:53.017920 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:53.018452 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:53.035175 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8859e963-ac0c-44b0-a853-2bd31ea91e05 req-606f4e88-1bd0-41ad-82bc-410611f9631f service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:53.035175 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8859e963-ac0c-44b0-a853-2bd31ea91e05 req-606f4e88-1bd0-41ad-82bc-410611f9631f service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:53.035175 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8859e963-ac0c-44b0-a853-2bd31ea91e05 req-606f4e88-1bd0-41ad-82bc-410611f9631f service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:53.035175 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8859e963-ac0c-44b0-a853-2bd31ea91e05 req-606f4e88-1bd0-41ad-82bc-410611f9631f service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:53.035175 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8859e963-ac0c-44b0-a853-2bd31ea91e05 req-606f4e88-1bd0-41ad-82bc-410611f9631f service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:53.035175 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-8859e963-ac0c-44b0-a853-2bd31ea91e05 req-606f4e88-1bd0-41ad-82bc-410611f9631f service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state active and task_state resize_migrating. Jun 27 02:01:53.103113 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:53.109501 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Port e72cdd58-08c5-4654-abf5-4fe4f1251017 binding to destination host np0000003818 is already ACTIVE {{(pid=98971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jun 27 02:01:53.111440 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:53.130277 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:01:53.135453 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:01:53.249455 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance destroyed successfully. Jun 27 02:01:53.249455 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'numa_topology' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:53.487734 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.641s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:53.488649 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.372s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:53.488836 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:01:53.493901 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:01:53.493901 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Claim successful on node np0000003818 Jun 27 02:01:53.505318 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:53.505869 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:53.506138 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:53.506444 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:53.506531 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:53.506793 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state rescuing. Jun 27 02:01:53.506894 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:53.508702 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:53.508702 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:53.508702 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:53.508702 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:01:53.508702 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-a91ebf5d-1165-40f9-92b5-32e785d95625 req-8dffdf9d-c2f6-434e-a703-9b1139d09c4d service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state rescuing. Jun 27 02:01:53.637884 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999724198999957 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:01:53.754592 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Attempting rescue Jun 27 02:01:53.754592 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 27 02:01:53.759422 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance directory exists: not creating {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 27 02:01:53.759631 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Creating image(s) Jun 27 02:01:53.760615 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "/opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:53.760793 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:53.761716 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "/opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:53.761998 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'trusted_certs' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:53.999696 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:01:54.002687 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:01:54.002916 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:54.003122 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:54.107015 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd09450dbdcd64a9bb7a5db858b105876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a77ac5cb944391823f39bfbbbec54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:01:54.117128 np0000003818 nova-compute[98971]: DEBUG nova.compute.rpcapi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 27 02:01:54.131551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:54.136278 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.005s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:54.137083 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:54.264307 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:54.265050 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:54.269474 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:54.272274 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:54.272680 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:54.272996 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:54.276504 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:54.276867 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:54.380057 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:54.380533 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.rescue {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:54.427743 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.rescue" returned: 0 in 0.047s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:54.428345 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.156s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:54.428865 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'migration_context' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:54.503397 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:01:54.590676 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Successfully created port: 63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:01:54.931779 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:54.932256 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:01:54.933106 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Start _get_guest_xml network_info=[{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:7d:c2:bb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue={'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:01:54.933389 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'resources' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:55.016225 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:01:55.143721 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:55.211883 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:01:55.212137 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:01:55.293730 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:55.294582 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:55.294822 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:01:55.436114 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:55.437954 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:01:55.439326 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-466675542', uuid='380fe23b-73a4-4b4f-9349-fce0f62ae5fb'), owner=OwnerMeta(userid='12040f7bfd874cd086b002bc598c80d4', username='tempest-ServerRescueNegativeTestJSON-438392507-project-member', projectid='d6a76767ddc64ede879746f16624d287', projectname='tempest-ServerRescueNegativeTestJSON-438392507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:7d:c2:bb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525715.4389572) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:01:55.440471 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:01:55.440905 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:01:55.441679 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:01:55.442992 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:01:55.444073 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:01:55.444447 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:01:55.444615 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:01:55.444760 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:01:55.445460 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:01:55.445460 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:01:55.445460 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:01:55.445460 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:01:55.445679 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:01:55.445727 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:01:55.445871 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:01:55.446062 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:01:55.446251 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:55.687031 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Successfully updated port: 63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:01:55.715056 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:55.768353 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received event network-changed-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:55.768652 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Refreshing instance network info cache due to event network-changed-63680c29-c21a-4940-a3d2-e4cf44f76519. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:01:55.768836 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] Acquiring lock "refresh_cache-598098dd-311d-470c-b88c-a825b7c12a5a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:55.769039 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] Acquired lock "refresh_cache-598098dd-311d-470c-b88c-a825b7c12a5a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:55.772286 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Refreshing network info cache for port 63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:01:55.798359 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:55.948790 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:55.964465 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-466675542',display_name='tempest-ServerRescueNegativeTestJSON-server-466675542',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-466675542',id=10,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOWcHKr2sV1pVsFqegtL35TZyjw+YDsVcv4HxAV4SjpPhm7qYGnOIWc8DKa7ZT4fCcZCCrFaeDpuMcOJQ5Rm77CW+noQsbRhgebEOm3DGhWdWFAWXw8EC+EBsVmTAHemA==',key_name='tempest-keypair-783663957',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:59Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-6z0b75xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12040f7bfd874cd086b002bc598c80d4',uuid=380fe23b-73a4-4b4f-9349-fce0f62ae5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:7d:c2:bb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:01:55.964984 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "vif_mac": "fa:16:3e:7d:c2:bb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:55.965618 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:55.966954 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'pci_devices' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:56.026664 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:01:56.026664 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:01:56.027103 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Creating image(s) Jun 27 02:01:56.027815 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "/opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:56.028163 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "/opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:56.028834 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "/opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:56.030993 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:56.034890 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:56.039477 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:56.091153 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:56.135483 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.096s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:56.136371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:56.139836 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:56.139836 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:56.140051 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:56.140825 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:56.191663 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "refresh_cache-598098dd-311d-470c-b88c-a825b7c12a5a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:56.224945 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.737s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:56.227061 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.078s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:56.227857 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:01:56.233847 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:01:56.236125 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Claim successful on node np0000003818 Jun 27 02:01:56.238124 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.097s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:56.239082 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:56.261465 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:56.274959 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:56.291875 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk 1073741824" returned: 0 in 0.051s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:56.292584 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.156s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:56.294127 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:56.377390 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.083s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:56.377752 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:01:56.378000 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:56.403891 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:01:56.465251 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:56.469271 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] End _get_guest_xml xml= Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: instance-0000000a Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 196608 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-server-466675542 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 2026-06-27 02:01:55 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 192 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: True Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: bare Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: ide Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: pc Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507-project-member Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: tempest-ServerRescueNegativeTestJSON-438392507 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: hvm Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 128 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: Jun 27 02:01:56.470859 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:01:56.473942 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:56.473942 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Cannot resize image /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:01:56.474127 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:01:56.474386 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Ensure instance console log exists: /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:01:56.474849 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:56.475379 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:56.476106 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:56.477855 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance destroyed successfully. Jun 27 02:01:56.563174 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:56.746102 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:01:56.748199 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:01:56.748733 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:56.749135 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:56.845309 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd14d8ca1a02c49228bf2cf5e40d96286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5b970bc7a4e3cb52f7a98dff98715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:01:56.973761 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:57.065213 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2d85af56-0214-4bf8-a374-e4c7a489f2d2 req-7707ddf5-288a-490b-9072-dcfd21bd7adb service nova] Releasing lock "refresh_cache-598098dd-311d-470c-b88c-a825b7c12a5a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:57.065621 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquired lock "refresh_cache-598098dd-311d-470c-b88c-a825b7c12a5a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:57.065780 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:01:57.263988 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:01:57.278507 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:57.479025 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:57.494196 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:01:57.529065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:57.574691 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:01:57.579868 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:01:57.595591 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:01:57.595591 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:b215', 'fe80::fc16:3eff:fee8:66b6', 'fe80::4410:b5ff:fe74:fbb2', 'fe80::fc16:3eff:fea6:83f8', 'fe80::fc16:3eff:feff:bfd1', 'fe80::fc16:3eff:fe92:52e2', 'fe80::fc16:3eff:febf:27d3', 'fe80::fc16:3eff:fe52:676', 'fe80::980a:61ff:fe78:5465', 'fe80::984c:cff:fec4:61ff', 'fe80::fc16:3eff:fe07:efef', 'fe80::fc16:3eff:fe21:b7a8', 'fe80::a031:5ff:fe73:c733', 'fe80::fc16:3eff:fee1:1ebf', 'fe80::fc16:3eff:fe26:b31d', 'fe80::fc16:3eff:fe37:e1b', 'fe80::fc16:3eff:fe4b:61ca', 'fe80::6c2c:39ff:fe36:13f1', 'fe80::fc16:3eff:fe38:9043', 'fe80::8c65:53ff:fe5c:18a3', 'fe80::fc16:3eff:fe58:552b', 'fe80::fc9d:c9ff:feea:6a6c'] Jun 27 02:01:57.595591 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:01:57.595591 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:01:57.595591 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:01:57.629108 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Successfully created port: d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:01:57.685065 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:01:57.756497 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:01:57.956759 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:58.004688 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:58.012917 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:58.012917 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:01:58.012917 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] No VIF found with MAC fa:16:3e:7d:c2:bb, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:01:58.012917 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Using config drive Jun 27 02:01:58.106740 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:01:58.107090 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:01:58.170232 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Updating instance_info_cache with network_info: [{"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:58.509198 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'ec2_ids' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:58.612627 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:01:58.680554 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Releasing lock "refresh_cache-598098dd-311d-470c-b88c-a825b7c12a5a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:01:58.680554 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Instance network_info: |[{"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:01:58.680554 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Start _get_guest_xml network_info=[{"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:01:58.680554 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:01:58.693849 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-787198093', uuid='598098dd-311d-470c-b88c-a825b7c12a5a'), owner=OwnerMeta(userid='d09450dbdcd64a9bb7a5db858b105876', username='tempest-VolumesAdminNegativeTest-1471445662-project-member', projectid='a3a77ac5cb944391823f39bfbbbec54d', projectname='tempest-VolumesAdminNegativeTest-1471445662'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525718.6818237) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:01:58.699616 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:01:58.699616 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:01:58.700679 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:01:58.701525 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:01:58.702140 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:01:58.706238 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:01:58.717902 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-787198093',display_name='tempest-VolumesAdminNegativeTest-server-787198093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesadminnegativetest-server-787198093',id=11,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3a77ac5cb944391823f39bfbbbec54d',ramdisk_id='',reservation_id='r-wnkk8u7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1471445662',owner_user_name='tempest-VolumesAdminNegativeTest-1471445662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:55Z,user_data=None,user_id='d09450dbdcd64a9bb7a5db858b105876',uuid=598098dd-311d-470c-b88c-a825b7c12a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:01:58.717902 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Converting VIF {"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:58.718486 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:58.719588 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lazy-loading 'pci_devices' on Instance uuid 598098dd-311d-470c-b88c-a825b7c12a5a {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:58.728855 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Successfully updated port: d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:01:58.772297 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:01:58.773917 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:01:58.774742 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Creating image(s) Jun 27 02:01:58.775439 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "/opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:58.775696 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "/opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:58.776258 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "/opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:58.776908 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:58.782205 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:58.783350 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:58.810295 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-changed-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:01:58.810295 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Refreshing instance network info cache due to event network-changed-d3c30573-faba-4d86-a21a-731096280755. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:01:58.810295 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] Acquiring lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:58.810295 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] Acquired lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:01:58.810295 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Refreshing network info cache for port d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:01:58.864537 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.081s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:58.864949 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:58.865359 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:58.865800 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:58.870306 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:01:58.870670 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:58.896148 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Starting finish_migration {{(pid=98971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}} Jun 27 02:01:58.900628 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance directory exists: not creating {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 27 02:01:58.900628 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Creating image(s) Jun 27 02:01:58.900628 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:58.959998 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.088s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:58.960627 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:58.998564 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.098s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.009625 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:01:59.009625 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:59.015447 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:59.015758 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'keypairs' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:01:59.038184 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk 1073741824" returned: 0 in 0.077s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.039316 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.174s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.039588 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:59.083697 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.084139 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Cannot resize image /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:01:59.123437 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.898s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.124169 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:01:59.128102 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 6.478s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.128729 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.135462 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 02:01:59.145595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.106s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.145969 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:01:59.146273 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] End _get_guest_xml xml= Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 598098dd-311d-470c-b88c-a825b7c12a5a Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: instance-0000000b Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 196608 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: tempest-VolumesAdminNegativeTest-server-787198093 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 2026-06-27 02:01:58 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 192 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: True Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: bare Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 0 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: virtio Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: tempest-VolumesAdminNegativeTest-1471445662-project-member Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: tempest-VolumesAdminNegativeTest-1471445662 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 598098dd-311d-470c-b88c-a825b7c12a5a Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 598098dd-311d-470c-b88c-a825b7c12a5a Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: hvm Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 128 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: 1 Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Preparing to wait for external event network-vif-plugged-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-787198093',display_name='tempest-VolumesAdminNegativeTest-server-787198093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesadminnegativetest-server-787198093',id=11,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3a77ac5cb944391823f39bfbbbec54d',ramdisk_id='',reservation_id='r-wnkk8u7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1471445662',owner_user_name='tempest-VolumesAdminNegativeTest-1471445662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:55Z,user_data=None,user_id='d09450dbdcd64a9bb7a5db858b105876',uuid=598098dd-311d-470c-b88c-a825b7c12a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Converting VIF {"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eac27ef-9176-54eb-94f3-0c1377dc051b', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:59.234177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.239537 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:59.247759 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.250756 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.251087 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63680c29-c2, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63680c29-c2, col_values=(('qos', UUID('03a7d0d3-e4ac-4d82-80bc-a58111dc2a5a')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63680c29-c2, col_values=(('external_ids', {'iface-id': '63680c29-c21a-4940-a3d2-e4cf44f76519', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:ed:83', 'vm-uuid': '598098dd-311d-470c-b88c-a825b7c12a5a'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Cannot resize image /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Ensure instance console log exists: /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.257342 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.257902 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.259643 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:01:59.285961 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:01:59.287426 np0000003818 nova-compute[98971]: INFO os_vif [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') Jun 27 02:01:59.317910 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:59.415587 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:01:59.521218 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:01:59.532739 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:59.587261 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Did not create local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 27 02:01:59.587461 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Ensure instance console log exists: /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:01:59.587795 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:59.588059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.588165 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.597603 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start _get_guest_xml network_info=[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'ad0aa6e6-31be-4a5b-b89c-152d732f755e', 'attached_at': '2026-06-27T02:01:58.000000', 'detached_at': '', 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'serial': '213a9d41-f273-4d1c-9412-283ee3b32c09'}, 'attachment_id': '2a414b93-b8ad-4229-a1f8-7d24ff53e279', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:01:59.601881 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:01:59.606588 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1976611999', uuid='ad0aa6e6-31be-4a5b-b89c-152d732f755e'), owner=OwnerMeta(userid='7d0ea64538644b3c8b1194033f822216', username='tempest-ServerActionsTestOtherB-461891651-project-member', projectid='d687a155933b421c8c35d3a3655e35bc', projectname='tempest-ServerActionsTestOtherB-461891651'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525719.6030698) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:01:59.609203 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:01:59.611152 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:01:59.612284 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:01:59.613245 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:01:59.614360 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:01:59.614759 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:01:59.614934 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:01:59.617782 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:01:59.619239 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:01:59.619841 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:01:59.635859 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:01:59.636095 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:01:59.636383 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:59.636842 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:01:59.644910 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:01:59.655935 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:59.750923 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Creating config drive at /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.config.rescue Jun 27 02:01:59.753705 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config --force-share --output=json" returned: 0 in 0.098s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.754599 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:59.754876 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.755670 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.756020 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:01:59.756430 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:01:59.756569 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:59.756965 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:59.757270 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:01:59.762070 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqu3h737k {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:01:59.783572 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd14d8ca1a02c49228bf2cf5e40d96286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb5b970bc7a4e3cb52f7a98dff98715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:01:59.787010 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:59.787866 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:01:59.789358 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:59.790072 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:01:59.790288 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:01:59.790667 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:01:59.806338 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:59.806338 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:59.811822 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:01:59.811822 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09] added Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:59.822527 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:59.827814 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:59.827814 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:59.827814 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09] added Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:01:59.828243 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:01:59.828597 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:01:59.828597 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:01:59.832001 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:01:59.832001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqu3h737k" returned: 0 in 0.068s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:01:59.864182 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:59.864440 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.864806 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:01:59.865015 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:01:59.865166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:01:59.868432 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Terminating instance Jun 27 02:02:00.151532 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:02:00.154715 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8398fcdf-4042-416e-9287-8a89a44d5f09 req-44cb775d-8f0b-4e9b-a463-bf6e081b0206 service nova] Releasing lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:00.155852 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquired lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:00.157070 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:00.202620 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.305687 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:00.306588 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.374653 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:02:00.397424 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.427996 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json" returned: 0 in 0.112s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:00.427996 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.481671 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.537561 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:00.538809 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.630891 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.657400 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:00.661462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:02:00.679147 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.686993 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.701922 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.791486 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.rescue --force-share --output=json" returned: 0 in 0.104s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:00.791486 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.824359 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cff9c437-95be-4d8e-83f1-308a30c0c7a4 req-1ec11d56-353b-4dbd-b2f3-e23811482cb6 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:00.824821 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cff9c437-95be-4d8e-83f1-308a30c0c7a4 req-1ec11d56-353b-4dbd-b2f3-e23811482cb6 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:00.825236 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cff9c437-95be-4d8e-83f1-308a30c0c7a4 req-1ec11d56-353b-4dbd-b2f3-e23811482cb6 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:00.825885 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-cff9c437-95be-4d8e-83f1-308a30c0c7a4 req-1ec11d56-353b-4dbd-b2f3-e23811482cb6 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:00.829557 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:02:00.830509 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-cff9c437-95be-4d8e-83f1-308a30c0c7a4 req-1ec11d56-353b-4dbd-b2f3-e23811482cb6 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:00.831079 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-cff9c437-95be-4d8e-83f1-308a30c0c7a4 req-1ec11d56-353b-4dbd-b2f3-e23811482cb6 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state rescuing. Jun 27 02:02:00.833419 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.834309 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:02:00.840900 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:00.841131 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:00.841360 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] No VIF found with MAC fa:16:3e:79:ed:83, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:02:00.842237 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Using config drive Jun 27 02:02:00.854506 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:02:00.859839 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk.rescue --force-share --output=json" returned: 0 in 0.087s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:00.880750 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:00.890493 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:00.911805 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:00.911805 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.929242 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac779727-410f-44c2-be83-db3938569d0b req-22978c83-f9b4-452d-8afe-4b7075d05a36 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.939854 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.940470 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:00.940989 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:00.953084 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac779727-410f-44c2-be83-db3938569d0b req-22978c83-f9b4-452d-8afe-4b7075d05a36 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:00.953084 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac779727-410f-44c2-be83-db3938569d0b req-22978c83-f9b4-452d-8afe-4b7075d05a36 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:00.953084 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac779727-410f-44c2-be83-db3938569d0b req-22978c83-f9b4-452d-8afe-4b7075d05a36 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:00.953084 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac779727-410f-44c2-be83-db3938569d0b req-22978c83-f9b4-452d-8afe-4b7075d05a36 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:00.953084 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac779727-410f-44c2-be83-db3938569d0b req-22978c83-f9b4-452d-8afe-4b7075d05a36 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4fcc673e-9697-4b65-b801-ba54a85d563b for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:00.955584 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Successfully created port: 14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.986950 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:00.988369 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:00.997178 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.009013 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6df1abe9-cf16-4770-a400-ecb6194478ff req-847ee0bf-9566-49b7-bfb2-7c235624d18b service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:01.009233 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6df1abe9-cf16-4770-a400-ecb6194478ff req-847ee0bf-9566-49b7-bfb2-7c235624d18b service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:01.010060 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6df1abe9-cf16-4770-a400-ecb6194478ff req-847ee0bf-9566-49b7-bfb2-7c235624d18b service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:01.010060 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6df1abe9-cf16-4770-a400-ecb6194478ff req-847ee0bf-9566-49b7-bfb2-7c235624d18b service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:01.010060 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6df1abe9-cf16-4770-a400-ecb6194478ff req-847ee0bf-9566-49b7-bfb2-7c235624d18b service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:01.010795 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6df1abe9-cf16-4770-a400-ecb6194478ff req-847ee0bf-9566-49b7-bfb2-7c235624d18b service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:01.021147 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.021147 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.059949 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] Jun 27 02:02:01.059949 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] successful. Jun 27 02:02:01.059949 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:01.098229 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:01.109584 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] Jun 27 02:02:01.109584 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] successful. Jun 27 02:02:01.109584 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:01.154314 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:01.165772 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.173439 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.174017 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.195229 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.195229 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.197584 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.198939 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:01.213573 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.217880 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.444s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.435s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] HCTL ('19', '-', '-', 0) found on session 30 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:02:01.244122 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:02:01.280436 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.998326472999906 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:01.356242 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Instance destroyed successfully. Jun 27 02:02:01.356242 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lazy-loading 'resources' on Instance uuid 1600aedd-362f-49f5-ab76-7a79cabf4d3f {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:01.356242 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 30 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:01.356242 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:02:01.356242 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.388121 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:01.408696 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.411071 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.457820 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] HCTL ('22', '-', '-', 0) found on session 31 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:02:01.465842 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:02:01.494426 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.513227 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 31 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:01.513227 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:02:01.541726 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.542170 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.560109 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.574140 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.629464 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:01.634554 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.707265 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.707515 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.792370 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:02:01.828789 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:02:01.831694 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:02:01.831694 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.831694 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Creating image(s) Jun 27 02:02:01.834140 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "/opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:01.834140 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "/opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:01.834140 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "/opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:01.834603 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:01.837522 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:01.838880 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.867048 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.867339 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.867588 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-8 (vdc) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:02:01.873569 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:01.874290 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "94af59a9-6083-4695-95fd-a6d5a45d3081", "address": "fa:16:3e:58:b2:15", "network": {"id": "58f800c8-4749-4746-9da0-8dad435007b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1715272038-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94af59a9-60", "ovs_interfaceid": "94af59a9-6083-4695-95fd-a6d5a45d3081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:01.877061 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:01.884581 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:01.888330 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.888839 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94af59a9-60, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:01.891154 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:01.894452 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:01.950489 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:01.950489 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:01.975765 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.129s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:01.975765 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:01.975765 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.002151 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:02.002151 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:02.002151 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:02.021701 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e0f670c2-2c02-4358-b99f-2017af4d46e4 req-e5b2be8e-fd7c-4921-a448-4c10782ae9a1 service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received event network-vif-unplugged-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:02.021701 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e0f670c2-2c02-4358-b99f-2017af4d46e4 req-e5b2be8e-fd7c-4921-a448-4c10782ae9a1 service nova] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.022864 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.024901 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.068s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e0f670c2-2c02-4358-b99f-2017af4d46e4 req-e5b2be8e-fd7c-4921-a448-4c10782ae9a1 service nova] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e0f670c2-2c02-4358-b99f-2017af4d46e4 req-e5b2be8e-fd7c-4921-a448-4c10782ae9a1 service nova] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.007s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5720f37a-501f-4008-930a-62aa9ade17a3) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=51009MB free_disk=74.1604118347168GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e0f670c2-2c02-4358-b99f-2017af4d46e4 req-e5b2be8e-fd7c-4921-a448-4c10782ae9a1 service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] No event matching network-vif-unplugged-63680c29-c21a-4940-a3d2-e4cf44f76519 in dict_keys([('network-vif-plugged', '63680c29-c21a-4940-a3d2-e4cf44f76519')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-e0f670c2-2c02-4358-b99f-2017af4d46e4 req-e5b2be8e-fd7c-4921-a448-4c10782ae9a1 service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received unexpected event network-vif-unplugged-63680c29-c21a-4940-a3d2-e4cf44f76519 for instance with vm_state building and task_state spawning. Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.045958 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.074521 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Creating config drive at /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk.config Jun 27 02:02:02.104324 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.117s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:02.105903 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:02.131672 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgda_pybs {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:02.147094 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.171932 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Updating instance_info_cache with network_info: [{"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:02.184590 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:b2:15,bridge_name='br-int',has_traffic_filtering=True,id=94af59a9-6083-4695-95fd-a6d5a45d3081,network=Network(58f800c8-4749-4746-9da0-8dad435007b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94af59a9-60') Jun 27 02:02:02.187509 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:02.187509 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "4fcc673e-9697-4b65-b801-ba54a85d563b", "address": "fa:16:3e:e8:66:b6", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fcc673e-96", "ovs_interfaceid": "4fcc673e-9697-4b65-b801-ba54a85d563b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.188434 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.189719 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:02.190484 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgda_pybs" returned: 0 in 0.060s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:02.194785 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.194785 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fcc673e-96, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.210739 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.210739 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk 1073741824" returned: 0 in 0.095s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:02.210739 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.210739 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.230s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.210739 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:02.235941 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.240328 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.240710 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b38f109-f0b2-4811-9a1b-c2b8d79b60ba) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.242763 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.244183 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.286194 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.300399 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.093s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:02.301422 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:66:b6,bridge_name='br-int',has_traffic_filtering=True,id=4fcc673e-9697-4b65-b801-ba54a85d563b,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fcc673e-96') Jun 27 02:02:02.303167 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:02:02.307275 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:02.307275 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:02.317003 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "address": "fa:16:3e:a6:83:f8", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bae04-be", "ovs_interfaceid": "1f4bae04-be71-4886-bb62-cb8bad0230c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.319038 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.319817 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:02.325381 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.327745 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4bae04-be, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.340462 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.340462 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.386733 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.386733 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.386733 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c4db3d8-fb9c-4bda-b895-113bea3a11d9) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.386733 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.386733 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.401147 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.403530 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:83:f8,bridge_name='br-int',has_traffic_filtering=True,id=1f4bae04-be71-4886-bb62-cb8bad0230c6,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f4bae04-be') Jun 27 02:02:02.407941 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:02.407941 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "address": "fa:16:3e:ff:bf:d1", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc55294-ac", "ovs_interfaceid": "5cc55294-ac9c-469c-b1cf-642609e8d5f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.407941 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.407941 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:02.407941 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.407941 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc55294-ac, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.409424 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.411181 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.411666 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:02.419852 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Cannot resize image /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:02:02.419852 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:02:02.419852 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Ensure instance console log exists: /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:02:02.419852 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.419852 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.419852 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.437290 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.439214 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.439560 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06fc8882-95c1-4c87-8f06-bc54bbaa5d94) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.440372 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.440949 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.480798 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.483641 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bf:d1,bridge_name='br-int',has_traffic_filtering=True,id=5cc55294-ac9c-469c-b1cf-642609e8d5f9,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc55294-ac') Jun 27 02:02:02.485103 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:02.485345 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "address": "fa:16:3e:92:52:e2", "network": {"id": "da66687b-1e12-4987-9df0-14d16158501c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2086314560", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaa5778-27", "ovs_interfaceid": "bcaa5778-2722-4e86-ade0-a7f551f92cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.486522 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.487099 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:02.490150 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.490483 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcaa5778-27, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.492109 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.493407 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.517719 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.519308 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.520308 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06d48d56-8bde-428a-a69c-328fa0b45647) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.530424 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.531256 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.550520 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.558114 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:52:e2,bridge_name='br-int',has_traffic_filtering=True,id=bcaa5778-2722-4e86-ade0-a7f551f92cde,network=Network(da66687b-1e12-4987-9df0-14d16158501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaa5778-27') Jun 27 02:02:02.559245 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:02.559470 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "address": "fa:16:3e:bf:27:d3", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeceed2c-66", "ovs_interfaceid": "feceed2c-66b6-4b32-ad15-e5b1cac20ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.560200 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.560809 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:02.561690 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.561865 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeceed2c-66, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.571647 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.579322 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.579844 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.580085 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fd74552-496c-4814-a75a-c2b8ac3a5fa4) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.580990 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.581643 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.589824 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.598925 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.598925 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.598925 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.598925 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.598925 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Terminating instance Jun 27 02:02:02.599296 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:d3,bridge_name='br-int',has_traffic_filtering=True,id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeceed2c-66') Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-187080806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-187080806',id=6,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI/IVQrRMPZkoiY1HT2oQoNSUr6T7WmmEL2aCNM5lS7Td6PlhlTlqDrcGbj+8Tv+UlMJ5VAIw1VaxMuSzQFfbYq7IVyffHjY+vLQyUBySHa8UzqUe/UBR494GaXK9gbXw==',key_name='tempest-keypair-537585317',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='96c1552799934b6c80ecd7f89d497a79',ramdisk_id='',reservation_id='r-78pwgwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-112727879',owner_user_name='tempest-TaggedBootDevicesTest-112727879-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59f6ef5fcd66441e91a33a1c88bad260',uuid=1600aedd-362f-49f5-ab76-7a79cabf4d3f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converting VIF {"id": "4cae5406-fc0f-4b98-ae36-437f32645e33", "address": "fa:16:3e:52:06:76", "network": {"id": "2ad6c910-3048-42d5-bd70-478868b08629", "bridge": "br-int", "label": "tempest-device-tagging-net2-2057980616", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "96c1552799934b6c80ecd7f89d497a79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cae5406-fc", "ovs_interfaceid": "4cae5406-fc0f-4b98-ae36-437f32645e33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.613202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cae5406-fc, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.614042 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.616174 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.624394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.625960 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.626537 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b7bd917-487a-41b1-8f7f-1d671591724d) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:02.628003 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.628498 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:02.635108 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.637501 np0000003818 nova-compute[98971]: INFO os_vif [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:06:76,bridge_name='br-int',has_traffic_filtering=True,id=4cae5406-fc0f-4b98-ae36-437f32645e33,network=Network(2ad6c910-3048-42d5-bd70-478868b08629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cae5406-fc') Jun 27 02:02:02.650476 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:02.650476 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:02.651190 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:02.680761 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Releasing lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:02.681360 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Instance network_info: |[{"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:02:02.683592 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Start _get_guest_xml network_info=[{"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:02:02.705690 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:02.705690 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-395301706-1', uuid='b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c'), owner=OwnerMeta(userid='d14d8ca1a02c49228bf2cf5e40d96286', username='tempest-TestMultiAttachVolumeSwap-204905735-project-member', projectid='0bb5b970bc7a4e3cb52f7a98dff98715', projectname='tempest-TestMultiAttachVolumeSwap-204905735'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525722.6861467) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:02:02.713796 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:02:02.714266 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:02:02.721913 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:02:02.721913 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:02:02.723754 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:02:02.723754 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:02:02.723754 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:02:02.724835 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:02:02.724835 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:02:02.724835 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:02:02.724835 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:02:02.724835 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:02:02.736295 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:02:02.736295 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:02:02.736295 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:02:02.736295 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:02:02.742930 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-395301706-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-testmultiattachvolumeswap-server-395301706-1',id=12,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaqSefSzTm8DXg/yRns6r1nitn0rB0dyv3+j3FQ3EhGRvrToPIf6C079yqdJZL+t8wJ2FskHzY3MTkox7eQFUQTGCH1uJeh+oNr0x7m7uEQKRBruBsjjwxU2e7BJh7lIg==',key_name='tempest-keypair-1735265842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb5b970bc7a4e3cb52f7a98dff98715',ramdisk_id='',reservation_id='r-s6gt121q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-204905735',owner_user_name='tempest-TestMultiAttachVolumeSwap-204905735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d14d8ca1a02c49228bf2cf5e40d96286',uuid=b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:02.742930 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converting VIF {"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:02.750892 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:02.750892 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'pci_devices' on Instance uuid b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:02.812839 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Found WWN 330000000032d291d for multipath device dm-11 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:02:02.813466 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:02.813743 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== connect_volume: return (3056ms) {'type': 'block', 'scsi_wwn': '330000000032d291d', 'path': '/dev/dm-11', 'multipath_id': '330000000032d291d'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:02.813933 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000032d291d', 'path': '/dev/dm-11', 'multipath_id': '330000000032d291d'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:02:02.814567 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.164s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:02.826043 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:02.826043 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:02.853080 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Successfully updated port: 14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7 (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '9')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '5')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7', '6')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Resulting device map defaultdict(. at 0x7decc0594400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'): ({'sdc'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Removing multipathed devices sdb, sdc {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:02.870376 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Flush multipath device 330000000589f2015 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:02.903330 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:02.937787 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:02.939044 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.940305 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.946305 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for 380fe23b-73a4-4b4f-9349-fce0f62ae5fb due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:02:02.952454 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.005s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.955249 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Resumed (Lifecycle Event) Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-22f08aa6-b75e-4e96-8b76-642b078892f6 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state rescuing. Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:02.962747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:02.963409 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b317b028-a5f4-4e73-99dc-e5b8d22d93d8 req-a8085aba-c206-4155-8478-881ba2665f3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:02.964885 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:03.023503 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2055b898-3e38-4170-bf5d-908da0a02577 req-3977c909-512c-4a4b-9f97-8a3b87cbdf86 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:03.023503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2055b898-3e38-4170-bf5d-908da0a02577 req-3977c909-512c-4a4b-9f97-8a3b87cbdf86 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:03.023503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2055b898-3e38-4170-bf5d-908da0a02577 req-3977c909-512c-4a4b-9f97-8a3b87cbdf86 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:03.023503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2055b898-3e38-4170-bf5d-908da0a02577 req-3977c909-512c-4a4b-9f97-8a3b87cbdf86 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:03.023503 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2055b898-3e38-4170-bf5d-908da0a02577 req-3977c909-512c-4a4b-9f97-8a3b87cbdf86 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-4fcc673e-9697-4b65-b801-ba54a85d563b {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:03.023503 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2055b898-3e38-4170-bf5d-908da0a02577 req-3977c909-512c-4a4b-9f97-8a3b87cbdf86 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4fcc673e-9697-4b65-b801-ba54a85d563b for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:03.043756 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:03.058415 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.075367 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Applying migration context for instance ad0aa6e6-31be-4a5b-b89c-152d732f755e as it has an incoming, in-progress migration 8eda7e1f-5d6c-4ffa-9976-7413e948dac5. Migration status is post-migrating {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 27 02:02:03.076547 np0000003818 nova-compute[98971]: INFO nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating resource usage from migration 8eda7e1f-5d6c-4ffa-9976-7413e948dac5 Jun 27 02:02:03.102261 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:03.102261 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:03.102261 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:03.119054 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:02:03.119054 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:03.119054 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:03.136877 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.155705 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.168443 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.173638 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance ea1483cd-9799-4aa0-b0c3-540d9ec1835e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.173638 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.173638 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.173638 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.173638 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.174329 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.174329 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Migration 8eda7e1f-5d6c-4ffa-9976-7413e948dac5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 27 02:02:03.174329 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance ad0aa6e6-31be-4a5b-b89c-152d732f755e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.174329 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.175075 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 502e62b6-a346-41c3-917c-758e2d30274d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.175075 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 598098dd-311d-470c-b88c-a825b7c12a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:02:03.175230 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 11 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 02:02:03.175381 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=2688MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:02:01 up 30 min, 2 users, load average: 10.60, 6.57, 3.07\n', 'num_instances': '10', 'num_vm_active': '6', 'num_task_None': '3', 'num_os_type_None': '10', 'num_proj_d6a76767ddc64ede879746f16624d287': '3', 'io_workload': '4', 'num_vm_rescued': '1', 'num_task_deleting': '2', 'num_proj_96c1552799934b6c80ecd7f89d497a79': '1', 'num_proj_6202ba11720e4772878029919cc6d682': '1', 'num_proj_8c59372a35d245a7b24ad6282d28e3d7': '1', 'num_task_resize_finish': '1', 'num_proj_d687a155933b421c8c35d3a3655e35bc': '1', 'num_task_rescuing': '1', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_a3a77ac5cb944391823f39bfbbbec54d': '1', 'num_proj_0bb5b970bc7a4e3cb52f7a98dff98715': '2'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 02:02:03.211283 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.40.100,3260] Jun 27 02:02:03.211283 np0000003818 nova-compute[98971]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.40.100,3260] successful. Jun 27 02:02:03.211283 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.224226 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.229763 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] End _get_guest_xml xml= Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: instance-0000000c Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 196608 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: tempest-TestMultiAttachVolumeSwap-server-395301706-1 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 2026-06-27 02:02:02 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 192 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: True Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: bare Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: tempest-TestMultiAttachVolumeSwap-204905735-project-member Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: tempest-TestMultiAttachVolumeSwap-204905735 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Preparing to wait for external event network-vif-plugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:03.249750 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-395301706-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-testmultiattachvolumeswap-server-395301706-1',id=12,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaqSefSzTm8DXg/yRns6r1nitn0rB0dyv3+j3FQ3EhGRvrToPIf6C079yqdJZL+t8wJ2FskHzY3MTkox7eQFUQTGCH1uJeh+oNr0x7m7uEQKRBruBsjjwxU2e7BJh7lIg==',key_name='tempest-keypair-1735265842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb5b970bc7a4e3cb52f7a98dff98715',ramdisk_id='',reservation_id='r-s6gt121q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-204905735',owner_user_name='tempest-TestMultiAttachVolumeSwap-204905735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d14d8ca1a02c49228bf2cf5e40d96286',uuid=b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converting VIF {"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.259344 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f9b8253-377c-5d6f-ad57-8af8f213a5ff', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.262160 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.262160 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:03.277830 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.293048 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.303280 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.309883 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.359363 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003818',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:03.359819 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:03.360805 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:03.365797 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:03.374578 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquired lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] End _get_guest_xml xml= Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: instance-00000009 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 262144 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-server-1976611999 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 2026-06-27 02:01:59 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 256 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: True Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: bare Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: ide Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: pc Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-461891651-project-member Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-461891651 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: 213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: Jun 27 02:02:03.375750 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:03.380618 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:03.382878 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:48Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003818',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:03.383907 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-422651892-network", "vif_mac": "fa:16:3e:fa:8b:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:03.388295 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:03.388295 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:03.390905 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.50.100,3260] Jun 27 02:02:03.390905 np0000003818 nova-compute[98971]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-a4e1d475-3f13-4676-9ac6-2a4b730a0ed7, portal: 192.168.50.100,3260] successful. Jun 27 02:02:03.390905 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.395836 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.398720 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.408592 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.408592 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:03.408592 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.414986 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.414986 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd77ee4f1-7d33-56c9-a54c-c1be99b9b654', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.418331 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:03.437054 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.437054 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.622s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:03.437905 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== disconnect_volume: return (787ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:03.437905 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:03.446568 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:03.446568 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:03.446568 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:03.446568 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:03.446568 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd0833d39-4314-447f-8696-58f17281209d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:03.447599 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:03.464076 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:03.468693 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:03.496140 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d (non-flash) Jun 27 02:02:03.497068 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:03.497635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '9')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:03.497635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '9')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:03.498951 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d', '10')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:03.500202 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Resulting device map defaultdict(. at 0x7decc82c49a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'): ({'sdg'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:03.501830 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Removing multipathed devices sdf, sdg {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:03.508277 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:03.508473 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:03.512049 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:03.512203 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:03.514553 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:03.514751 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-1f4bae04-be71-4886-bb62-cb8bad0230c6 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:03.514947 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:03.523057 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.528555 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Flush multipath device 330000000dea61d01 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:03.532436 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:03.535732 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.019s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:03.535732 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:03.535732 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:03.535732 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-94af59a9-6083-4695-95fd-a6d5a45d3081 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:03.535732 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:03.539327 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:03.539327 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:03.539327 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:03.539327 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:03.539327 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8efb433c-47ad-4880-8030-f759f16c3368 req-f9c139d3-22fe-48d0-8599-3d4d51f43bc6 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-94af59a9-6083-4695-95fd-a6d5a45d3081 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:03.561329 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.564736 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:03.587217 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.587217 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.587217 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3c30573-fa, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.587217 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3c30573-fa, col_values=(('qos', UUID('a75598dd-2783-49a6-8b3c-0ec1cd41028e')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.587217 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3c30573-fa, col_values=(('external_ids', {'iface-id': 'd3c30573-faba-4d86-a21a-731096280755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:79:56', 'vm-uuid': 'b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.592006 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.600062 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:03.618848 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:03.649809 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.650031 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.669543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:03.672377 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:03.676871 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:03.699940 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:03.700618 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:03.724867 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.728985 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.730208 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.734634 np0000003818 nova-compute[98971]: INFO os_vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') Jun 27 02:02:03.741107 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape72cdd58-08, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.741107 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape72cdd58-08, col_values=(('qos', UUID('98cc5b96-716d-4e1e-8061-26327d95f661')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.741107 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape72cdd58-08, col_values=(('external_ids', {'iface-id': 'e72cdd58-08c5-4654-abf5-4fe4f1251017', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:8b:3f', 'vm-uuid': 'ad0aa6e6-31be-4a5b-b89c-152d732f755e'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:03.749544 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:03.803930 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.848446 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.40.100,3260] Jun 27 02:02:03.848446 np0000003818 nova-compute[98971]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.40.100,3260] successful. Jun 27 02:02:03.848446 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.882329 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Instance destroyed successfully. Jun 27 02:02:03.882329 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lazy-loading 'resources' on Instance uuid e9a68589-d76c-48cf-afd7-a1021c6d38e6 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:03.887701 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.891485 np0000003818 nova-compute[98971]: INFO os_vif [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') Jun 27 02:02:03.896029 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.921762 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:03.993489 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:03.995134 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:03.995134 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Started (Lifecycle Event) Jun 27 02:02:03.998763 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.50.100,3260] Jun 27 02:02:03.998763 np0000003818 nova-compute[98971]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-d0833d39-4314-447f-8696-58f17281209d, portal: 192.168.50.100,3260] successful. Jun 27 02:02:03.998763 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.037834 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.037834 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.592s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:04.038140 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== disconnect_volume: return (592ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:04.038681 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:04.041989 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:04.042504 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:04.042504 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:04.042723 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:04.044577 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd300a977-f409-4d83-9498-6151a32ce522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:04.044577 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:04.050249 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:04.072670 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:04.099849 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:04.100395 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:04.100705 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:04.100705 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '13')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:04.102110 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522', '14')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:04.103583 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Resulting device map defaultdict(. at 0x7decc04b9f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'): ({'sdk'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:04.103846 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Removing multipathed devices sdk, sdj {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:04.104033 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Flush multipath device 3300000007292ac48 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:04.141485 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:04.145750 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:04.145750 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:04.145984 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:04.146288 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:04.146472 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:04.146659 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:04.146989 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:04.147159 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:04.147467 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:04.148031 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:04.148210 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:04.148489 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-5cc55294-ac9c-469c-b1cf-642609e8d5f9 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:04.148545 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received event network-vif-plugged-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:04.148820 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:04.148937 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:04.156587 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.007s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:04.164023 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-419ffdf4-e77c-45a3-a978-e1c341936b83 req-aaa34f84-4476-42bc-85ee-9afdfc7d03fb service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Processing event network-vif-plugged-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:02:04.171136 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.187859 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:04.228276 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.256802 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:04.256802 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:04.260722 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:04.281200 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:04.281200 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:04.300657 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.301080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.335707 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:04.336367 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:04.350063 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.40.100,3260] Jun 27 02:02:04.350063 np0000003818 nova-compute[98971]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.40.100,3260] successful. Jun 27 02:02:04.350063 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.383235 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.388231 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:04.388511 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "address": "fa:16:3e:07:ef:ef", "network": {"id": "6e8461f5-115b-4fea-a9e2-9d541fe91956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-414122250-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7405eae2-5d", "ovs_interfaceid": "7405eae2-5d9a-4d94-9d70-578a9f29cae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:04.389334 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:04.389599 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:04.391264 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.392176 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7405eae2-5d, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.398354 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.400125 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.424701 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.459829 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.469964 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000664297000184888 future=) was cancelled during its delay period, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:04.470275 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:04.470354 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.5793779050000012 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:04.471361 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.5792284980000204 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:04.479007 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:04.482324 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.50.100,3260] Jun 27 02:02:04.482324 np0000003818 nova-compute[98971]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-d300a977-f409-4d83-9498-6151a32ce522, portal: 192.168.50.100,3260] successful. Jun 27 02:02:04.482324 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.498329 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:04.502912 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:04.511064 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:04.511317 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:04.512206 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] <== disconnect_volume: return (468ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:04.512206 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:04.512637 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Deleting instance files /opt/stack/data/nova/instances/1600aedd-362f-49f5-ab76-7a79cabf4d3f_del Jun 27 02:02:04.513434 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Deletion of /opt/stack/data/nova/instances/1600aedd-362f-49f5-ab76-7a79cabf4d3f_del complete Jun 27 02:02:04.523016 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.526024 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.526256 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3507064e-274c-4285-a949-74a149234cb4) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.529015 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.530081 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.645318 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.652421 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ef:ef,bridge_name='br-int',has_traffic_filtering=True,id=7405eae2-5d9a-4d94-9d70-578a9f29cae1,network=Network(6e8461f5-115b-4fea-a9e2-9d541fe91956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7405eae2-5d') Jun 27 02:02:04.653677 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:04.653677 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "address": "fa:16:3e:21:b7:a8", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19364ba-31", "ovs_interfaceid": "f19364ba-31e7-48cd-bacf-e0028ac86cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:04.655736 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:04.657199 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:04.660170 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.660466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf19364ba-31, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.664603 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.668372 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.736576 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.738656 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.738956 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0f35001-7440-4398-90e2-10f9de4d3c3f) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.742174 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.743639 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.746604 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:02:04.752472 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:02:04.756949 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Instance spawned successfully. Jun 27 02:02:04.757279 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:02:04.787590 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.790935 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=f19364ba-31e7-48cd-bacf-e0028ac86cb8,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf19364ba-31') Jun 27 02:02:04.791826 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:04.792676 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "1401dd8a-1a01-4629-9689-791335582698", "address": "fa:16:3e:e1:1e:bf", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1401dd8a-1a", "ovs_interfaceid": "1401dd8a-1a01-4629-9689-791335582698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:04.793810 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:04.794010 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:04.799651 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.799651 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1401dd8a-1a, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.802136 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.843125 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:04.849500 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.852186 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.857406 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc60d4a0-3478-4f1b-a6e5-d881372efb96) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.861862 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.902259 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.905562 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:bf,bridge_name='br-int',has_traffic_filtering=True,id=1401dd8a-1a01-4629-9689-791335582698,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1401dd8a-1a') Jun 27 02:02:04.906607 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:04.906861 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "address": "fa:16:3e:26:b3:1d", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap709dc39f-ad", "ovs_interfaceid": "709dc39f-ad52-424b-b903-d6db3d30ba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:04.907687 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:04.907999 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:04.914297 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.914297 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap709dc39f-ad, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.917021 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.917536 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.938106 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updating instance_info_cache with network_info: [{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:04.952690 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.955926 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.957137 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3425a60b-fa8d-48d0-9154-892ccb1598f8) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:04.959743 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:04.959892 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:04.995824 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.004451 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b3:1d,bridge_name='br-int',has_traffic_filtering=True,id=709dc39f-ad52-424b-b903-d6db3d30ba4e,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap709dc39f-ad') Jun 27 02:02:05.006721 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:05.007041 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "address": "fa:16:3e:37:0e:1b", "network": {"id": "cfe58ae0-a644-44db-9489-a7fbc23d811f", "bridge": "br-int", "label": "tempest-device-tagging-net1-831961964", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef02fa0a-81", "ovs_interfaceid": "ef02fa0a-81ac-4278-8a8a-4e41ef5e0007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:05.009839 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:05.010312 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.998484284999904 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:05.010580 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:05.011022 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:05.014550 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] VM Started (Lifecycle Event) Jun 27 02:02:05.016095 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.016297 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef02fa0a-81, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:05.025200 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:05.032308 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-changed-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:05.032603 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Refreshing instance network info cache due to event network-changed-14c670f2-d304-4427-9bcf-58d43a34dc40. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:05.032897 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] Acquiring lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:05.033692 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Took 4.66 seconds to destroy the instance on the hypervisor. Jun 27 02:02:05.036442 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:02:05.044951 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:02:05.045255 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:02:05.045477 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:05.052464 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.057689 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.060194 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d9e20a1-b297-43b1-b57f-02d7459eb825) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:05.069109 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:05.099300 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.103886 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:0e:1b,bridge_name='br-int',has_traffic_filtering=True,id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007,network=Network(cfe58ae0-a644-44db-9489-a7fbc23d811f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef02fa0a-81') Jun 27 02:02:05.105462 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:05.105760 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "911ce191-d0af-4262-bf68-1b09900c9727", "address": "fa:16:3e:4b:61:ca", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap911ce191-d0", "ovs_interfaceid": "911ce191-d0af-4262-bf68-1b09900c9727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:05.106464 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:05.107327 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:05.109001 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.109309 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap911ce191-d0, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:05.112088 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.114938 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:05.136146 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.138677 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.138677 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2740687-6c62-4216-9f41-a87a023d1f86) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:05.143033 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.143033 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:05.147223 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:05.150249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:05.150249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-bcaa5778-2722-4e86-ade0-a7f551f92cde for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:05.151181 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-bcaa5778-2722-4e86-ade0-a7f551f92cde for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:05.152278 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:05.153253 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4a273ea-69c3-4172-aa71-c34cd4b354cd req-20cb6963-7a17-4908-88c3-4d10f319d005 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4cae5406-fc0f-4b98-ae36-437f32645e33 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:05.163536 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.165920 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:61:ca,bridge_name='br-int',has_traffic_filtering=True,id=911ce191-d0af-4262-bf68-1b09900c9727,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911ce191-d0') Jun 27 02:02:05.166901 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1779297975',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1779297975',id=7,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVx60ErnVoEgEMCNidkkZyJP0xPumWh4VClzi929K8tVHM5AuWqR26DExZQBGjr9I0FfA2XMmUIsyfrnLq5G5Ed2F5a2Gq4SkUoD14ki/Qk0UiJKnYnkrYhYESJI1BJTA==',key_name='tempest-keypair-1217383137',keypairs=,launch_index=0,launched_at=2026-06-27T02:00:53Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6202ba11720e4772878029919cc6d682',ramdisk_id='',reservation_id='r-yzrnxc0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-991946975',owner_user_name='tempest-TaggedBootDevicesTest_v242-991946975-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f496e8289a4abc80ec16cc9d3cba52',uuid=e9a68589-d76c-48cf-afd7-a1021c6d38e6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:05.167263 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converting VIF {"id": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "address": "fa:16:3e:38:90:43", "network": {"id": "a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-2103250542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6202ba11720e4772878029919cc6d682", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce7ae87-14", "ovs_interfaceid": "3ce7ae87-1473-43ee-a91f-2730d281f4cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:05.167866 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:05.168184 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:05.169083 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.171419 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce7ae87-14, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:05.172523 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.174442 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:05.185202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.189906 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.190219 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b285bfb-f48d-4bcb-a5b6-23851c9797f5) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:05.193725 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:05.208713 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:05.212687 np0000003818 nova-compute[98971]: INFO os_vif [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:90:43,bridge_name='br-int',has_traffic_filtering=True,id=3ce7ae87-1473-43ee-a91f-2730d281f4cb,network=Network(a4d7e31e-2f5e-4bf5-8f2f-c42630fa06fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce7ae87-14') Jun 27 02:02:05.217241 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:05.217583 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:05.217715 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:05.218153 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:05.219026 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3163a61c-cd01-446e-8d32-a22592dd81b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:05.219026 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:05.270732 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '15')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:05.271900 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9', '16')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:05.272518 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Resulting device map defaultdict(. at 0x7decc0678d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'): ({'sdm'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:05.273059 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Removing multipathed devices sdm, sdl {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:05.273798 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Flush multipath device 3300000000e62c91b {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:05.281893 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:05.281893 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:05.282684 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:05.283620 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:05.283620 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:05.283823 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:05.308050 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:05.308266 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:05.308400 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No VIF found with MAC fa:16:3e:04:79:56, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:02:05.308842 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Using config drive Jun 27 02:02:05.318916 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:05.364402 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 02:02:05.364402 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.334s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:05.364799 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:02:05.370945 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:05.375138 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:05.436999 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:05.437515 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:05.438765 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:05.439441 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:05.439838 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:05.440346 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:05.441004 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Releasing lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:05.441872 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] No VIF found with MAC fa:16:3e:fa:8b:3f, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:02:05.442454 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Instance network_info: |[{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:02:05.443226 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Using config drive Jun 27 02:02:05.445845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] Acquired lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:05.446124 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Refreshing network info cache for port 14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:05.450338 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Start _get_guest_xml network_info=[{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:02:05.453564 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:05.454071 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:05.461761 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:05.462663 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-395301706-2', uuid='502e62b6-a346-41c3-917c-758e2d30274d'), owner=OwnerMeta(userid='d14d8ca1a02c49228bf2cf5e40d96286', username='tempest-TestMultiAttachVolumeSwap-204905735-project-member', projectid='0bb5b970bc7a4e3cb52f7a98dff98715', projectname='tempest-TestMultiAttachVolumeSwap-204905735'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525725.4620283) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:02:05.467311 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:02:05.468669 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:02:05.470827 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:05.474393 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:02:05.475361 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:02:05.475941 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:02:05.476510 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:02:05.476678 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:02:05.476810 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:02:05.477154 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:02:05.477318 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:02:05.477403 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:02:05.477711 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:02:05.477801 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:02:05.477890 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:02:05.478114 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:02:05.478223 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:02:05.509132 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-395301706-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-testmultiattachvolumeswap-server-395301706-2',id=13,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaqSefSzTm8DXg/yRns6r1nitn0rB0dyv3+j3FQ3EhGRvrToPIf6C079yqdJZL+t8wJ2FskHzY3MTkox7eQFUQTGCH1uJeh+oNr0x7m7uEQKRBruBsjjwxU2e7BJh7lIg==',key_name='tempest-keypair-1735265842',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb5b970bc7a4e3cb52f7a98dff98715',ramdisk_id='',reservation_id='r-s6gt121q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-204905735',owner_user_name='tempest-TestMultiAttachVolumeSwap-204905735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d14d8ca1a02c49228bf2cf5e40d96286',uuid=502e62b6-a346-41c3-917c-758e2d30274d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:05.509453 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converting VIF {"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:05.510329 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:05.510913 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'pci_devices' on Instance uuid 502e62b6-a346-41c3-917c-758e2d30274d {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:05.522425 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.40.100,3260] Jun 27 02:02:05.522425 np0000003818 nova-compute[98971]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.40.100,3260] successful. Jun 27 02:02:05.522425 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:05.531765 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:05.534482 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:05.555278 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:05.568343 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Unrescuing Jun 27 02:02:05.568343 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:05.568853 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:05.568898 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:05.586506 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:05.617414 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:05.617917 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:05.617917 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:05.617917 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:05.618189 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:05.618435 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:05.619110 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:05.619465 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:05.619708 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:05.619824 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:05.620028 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:05.620165 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-699ef59b-e030-4c5c-9db8-622335db8b54 req-6601aba2-3a84-4dc6-b860-7f6b721b7d9e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-f19364ba-31e7-48cd-bacf-e0028ac86cb8 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:05.634311 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.50.100,3260] Jun 27 02:02:05.634311 np0000003818 nova-compute[98971]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-3163a61c-cd01-446e-8d32-a22592dd81b9, portal: 192.168.50.100,3260] successful. Jun 27 02:02:05.634311 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:05.665446 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:05.666807 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:05.666911 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== disconnect_volume: return (449ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:05.668242 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:05.672118 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:05.672118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:05.672118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:05.672118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:05.672118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a722800-5408-438a-9b21-7df978337edb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:05.672118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb (non-flash) Jun 27 02:02:05.723667 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:05.724333 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:05.724333 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '8')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:05.726277 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb', '7')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:05.728748 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Resulting device map defaultdict(. at 0x7decc0679d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'): ({'sdd'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:05.728748 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Removing multipathed devices sde, sdd {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:05.728748 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Flush multipath device 330000000958f74ed {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:05.792794 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Took 9.77 seconds to spawn the instance on the hypervisor. Jun 27 02:02:05.793062 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:05.797066 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:05.818981 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:05.856862 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:05.857491 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:05.858077 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:05.858625 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:05.859809 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:05.860236 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:05.860991 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 02:02:05.861059 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.78 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:02:05.865561 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:05.918060 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:05.918202 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:05.919630 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:05.936158 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:05.936476 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:05.952653 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:05.959253 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.013556 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.40.100,3260] Jun 27 02:02:06.013556 np0000003818 nova-compute[98971]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.40.100,3260] successful. Jun 27 02:02:06.013556 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] End _get_guest_xml xml= Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 502e62b6-a346-41c3-917c-758e2d30274d Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: instance-0000000d Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 196608 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: tempest-TestMultiAttachVolumeSwap-server-395301706-2 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 2026-06-27 02:02:05 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 192 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: True Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: bare Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: tempest-TestMultiAttachVolumeSwap-204905735-project-member Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: tempest-TestMultiAttachVolumeSwap-204905735 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 502e62b6-a346-41c3-917c-758e2d30274d Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 502e62b6-a346-41c3-917c-758e2d30274d Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: Jun 27 02:02:06.017318 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:06.020068 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Preparing to wait for external event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:02:06.020068 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:06.020068 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:06.020068 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:06.022172 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-395301706-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-testmultiattachvolumeswap-server-395301706-2',id=13,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaqSefSzTm8DXg/yRns6r1nitn0rB0dyv3+j3FQ3EhGRvrToPIf6C079yqdJZL+t8wJ2FskHzY3MTkox7eQFUQTGCH1uJeh+oNr0x7m7uEQKRBruBsjjwxU2e7BJh7lIg==',key_name='tempest-keypair-1735265842',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bb5b970bc7a4e3cb52f7a98dff98715',ramdisk_id='',reservation_id='r-s6gt121q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-204905735',owner_user_name='tempest-TestMultiAttachVolumeSwap-204905735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d14d8ca1a02c49228bf2cf5e40d96286',uuid=502e62b6-a346-41c3-917c-758e2d30274d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:06.023486 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converting VIF {"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:06.023486 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:06.023486 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:06.024414 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.024414 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:06.025728 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:06.027856 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.028621 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fdd666a-aaae-5f9b-bce4-f2c841d3dd8a', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:06.030695 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.031835 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:06.043084 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:02:06.044865 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:06.044865 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] VM Paused (Lifecycle Event) Jun 27 02:02:06.046545 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.051659 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.052755 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0027280819999759842 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.054799 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.054799 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.583565441000019 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.054799 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=2.5834041020000313 future=) was cancelled while queued, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.058503 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:06.059222 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.059468 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.219155467999826 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.059621 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.21896466499993 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:06.059788 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Stopped (Lifecycle Event) Jun 27 02:02:06.061857 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.062139 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14c670f2-d3, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:06.063439 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14c670f2-d3, col_values=(('qos', UUID('d00f1a8e-60b7-4942-bd8e-ab8a6608c320')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:06.063439 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14c670f2-d3, col_values=(('external_ids', {'iface-id': '14c670f2-d304-4427-9bcf-58d43a34dc40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:b8:15', 'vm-uuid': '502e62b6-a346-41c3-917c-758e2d30274d'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:06.070008 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:06.073472 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:06.082656 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.083075 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.092229 np0000003818 nova-compute[98971]: INFO os_vif [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') Jun 27 02:02:06.132001 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.140826 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.50.100,3260] Jun 27 02:02:06.140826 np0000003818 nova-compute[98971]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-5a722800-5408-438a-9b21-7df978337edb, portal: 192.168.50.100,3260] successful. Jun 27 02:02:06.140826 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.171999 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Creating config drive at /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk.config Jun 27 02:02:06.178233 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.178553 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.507s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:06.178810 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== disconnect_volume: return (507ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:06.178959 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:06.182734 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:06.183150 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:06.183389 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:06.183853 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:06.184401 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f382398a-3059-47ac-a0ef-27af21f0c12b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:06.184556 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:06.190048 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcotorkyv {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:06.249890 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcotorkyv" returned: 0 in 0.058s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:06.254952 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '12')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:06.269511 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b', '11')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:06.269511 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Resulting device map defaultdict(. at 0x7decc05479c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'): ({'sdh'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:06.269511 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Removing multipathed devices sdh, sdi {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:06.269511 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Flush multipath device 330000000f40dfbe7 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:06.269511 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.312671 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Took 15.53 seconds to build instance. Jun 27 02:02:06.322732 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:06.367306 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:06.405550 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:06.405904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:06.407316 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:06.419223 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received event network-vif-plugged-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:06.428750 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:06.443489 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:06.444190 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.015s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:06.445298 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.014s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:06.445704 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] No waiting events found dispatching network-vif-plugged-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:06.447361 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received unexpected event network-vif-plugged-63680c29-c21a-4940-a3d2-e4cf44f76519 for instance with vm_state active and task_state None. Jun 27 02:02:06.447361 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:06.447728 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:06.448339 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:06.448339 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:06.449131 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:06.454007 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1d49bd46-522a-4dac-80fb-57c68df1c4a9 req-108e6007-2014-4ce0-92fc-cf2ad92d90ae service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:06.467474 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.531327 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.40.100,3260] Jun 27 02:02:06.531327 np0000003818 nova-compute[98971]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.40.100,3260] successful. Jun 27 02:02:06.531327 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.551041 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:06.557683 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.562097 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:06.562097 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] VM Resumed (Lifecycle Event) Jun 27 02:02:06.564687 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-393632f6-e04d-4e3c-bcc0-1c62ade106dd None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:06.576253 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.625522 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.50.100,3260] Jun 27 02:02:06.625522 np0000003818 nova-compute[98971]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-f382398a-3059-47ac-a0ef-27af21f0c12b, portal: 192.168.50.100,3260] successful. Jun 27 02:02:06.625522 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.630941 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.644914 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:06.645693 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:06.646289 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] <== disconnect_volume: return (462ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:06.646570 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:06.647073 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Deleting instance files /opt/stack/data/nova/instances/e9a68589-d76c-48cf-afd7-a1021c6d38e6_del Jun 27 02:02:06.647673 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.650329 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Deletion of /opt/stack/data/nova/instances/e9a68589-d76c-48cf-afd7-a1021c6d38e6_del complete Jun 27 02:02:06.655339 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.686158 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.702031 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.761034 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:06.823755 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-08c7d8ae-7684-4e77-95f0-7222ba623b4b tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.050s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:06.903678 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:06.945415 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.018613 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.039387 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:07.058215 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.065698 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:07.073551 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:07.100742 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updated VIF entry in instance network info cache for port 14c670f2-d304-4427-9bcf-58d43a34dc40. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:02:07.101426 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updating instance_info_cache with network_info: [{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:07.154425 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.154425 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.154425 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.154425 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.154425 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.154425 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.154771 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.155046 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.157166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.157166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.157166 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.157166 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-7405eae2-5d9a-4d94-9d70-578a9f29cae1 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.157166 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.157166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.157458 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.157486 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.158754 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.158754 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-709dc39f-ad52-424b-b903-d6db3d30ba4e for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.158754 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.158754 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.158754 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.160054 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.160092 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.160261 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-709dc39f-ad52-424b-b903-d6db3d30ba4e for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.160713 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.167857 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.169242 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.170870 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.171271 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6943b562-e840-4b97-b95a-418750443fab req-b2c4e87f-975c-4c3b-a11a-30cbba85753b service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-3ce7ae87-1473-43ee-a91f-2730d281f4cb for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.176224 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Took 4.06 seconds to destroy the instance on the hypervisor. Jun 27 02:02:07.177220 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:02:07.177801 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:02:07.179687 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:02:07.179687 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Acquiring lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] No waiting events found dispatching network-vif-unplugged-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-unplugged-4cae5406-fc0f-4b98-ae36-437f32645e33 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-1401dd8a-1a01-4629-9689-791335582698 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.268103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.268877 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-1401dd8a-1a01-4629-9689-791335582698 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.268877 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-1401dd8a-1a01-4629-9689-791335582698 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.268877 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.270249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.270249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.270249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.270249 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:07.270249 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-d052eb53-e80b-4717-9fda-a3fd14fb8f22 req-43f32e92-e1e1-4f8a-a04d-11edfe5570de service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-911ce191-d0af-4262-bf68-1b09900c9727 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:07.289728 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.305680 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:07.371667 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:07.457156 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.470011 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.503816 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.508219 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.606313 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0b707a5e-7add-43fa-a0f0-8388c22c897a req-921f4758-d454-426b-a220-849fd94e3886 service nova] Releasing lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:07.639271 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:07.640098 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:07.640098 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No VIF found with MAC fa:16:3e:ef:b8:15, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:02:07.640098 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Using config drive Jun 27 02:02:07.656042 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:07.744547 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c0ef8b39-b67d-493a-8749-d7b4886306ef req-236c8e89-f54b-4894-ba84-1efb6c368cbb service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-plugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:07.745899 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c0ef8b39-b67d-493a-8749-d7b4886306ef req-236c8e89-f54b-4894-ba84-1efb6c368cbb service nova] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:07.745899 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c0ef8b39-b67d-493a-8749-d7b4886306ef req-236c8e89-f54b-4894-ba84-1efb6c368cbb service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:07.745899 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c0ef8b39-b67d-493a-8749-d7b4886306ef req-236c8e89-f54b-4894-ba84-1efb6c368cbb service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:07.745899 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c0ef8b39-b67d-493a-8749-d7b4886306ef req-236c8e89-f54b-4894-ba84-1efb6c368cbb service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Processing event network-vif-plugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:02:07.876519 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:07.877632 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'flavor' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:07.974573 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:07.974573 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Resumed (Lifecycle Event) Jun 27 02:02:07.977026 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance event wait completed in 0 seconds for {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:02:07.989051 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance running successfully. Jun 27 02:02:07.997002 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Failed to set time: agent not configured {{(pid=98971) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 27 02:02:07.997002 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2ef7f9f9-42f2-40a7-b334-18b74231476c tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] finish_migration finished successfully. {{(pid=98971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}} Jun 27 02:02:08.153699 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:08.374666 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Creating config drive at /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk.config Jun 27 02:02:08.375719 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:02:08.382078 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:02:08.390257 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Instance spawned successfully. Jun 27 02:02:08.390614 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:02:08.397420 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmroi5fmy {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:08.436765 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.446821 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.465860 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmroi5fmy" returned: 0 in 0.068s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:08.475166 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.483923 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:08.490229 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:08.678661 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.695921 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.854051 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.900007 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.901962 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.907430 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.911250 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:08.911250 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:08.911250 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:08.911250 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:08.911250 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:08.915180 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:08.928307 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:08.994576 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 27 02:02:08.995212 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:08.995212 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Started (Lifecycle Event) Jun 27 02:02:09.036306 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance destroyed successfully. Jun 27 02:02:09.036607 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'numa_topology' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:09.111744 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.131128 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.197803 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.244040 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.365398 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.425490 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Took 10.65 seconds to spawn the instance on the hypervisor. Jun 27 02:02:09.425693 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:09.438614 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.444088 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.452500 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.452500 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:09.452500 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:09.452500 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:09.452762 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:09.452896 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:02:09.452933 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.453217 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:09.454009 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:09.454009 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:09.454009 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:09.454009 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-8f4e6b0a-6a35-41bd-9719-cf72c6cd9bc1 req-0a967157-53d8-4fcd-be02-4ce253496735 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:02:09.500987 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:09.508768 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:09.543769 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Object Instance<380fe23b-73a4-4b4f-9349-fce0f62ae5fb> lazy-loaded attributes: flavor,numa_topology {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Acquiring lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] No waiting events found dispatching network-vif-unplugged-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-unplugged-911ce191-d0af-4262-bf68-1b09900c9727 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:09.620462 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.621170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:09.622065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:09.622065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:09.622065 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:09.622065 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state resized and task_state None. Jun 27 02:02:09.622232 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.623014 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:09.623205 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:09.623345 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:09.623488 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:09.623633 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-8bf52725-9476-4355-b95f-25e8a2ae415d req-794c1cf3-7c48-4b3c-879f-a0e70c13081a service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state resized and task_state None. Jun 27 02:02:09.691998 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.701084 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:09.885880 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-plugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.888131 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:09.888425 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:09.888662 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:09.888749 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] No waiting events found dispatching network-vif-plugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:09.890329 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received unexpected event network-vif-plugged-d3c30573-faba-4d86-a21a-731096280755 for instance with vm_state active and task_state None. Jun 27 02:02:09.890518 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-deleted-5cc55294-ac9c-469c-b1cf-642609e8d5f9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.890658 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Neutron deleted interface 5cc55294-ac9c-469c-b1cf-642609e8d5f9; detaching it from the instance and deleting it from the info cache Jun 27 02:02:09.893416 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-014833fb-add7-4c3a-946d-5ef0f3e82155 req-2d5a8ac4-70fa-4c3d-93c7-0793f032dd57 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Detach interface failed, port_id=5cc55294-ac9c-469c-b1cf-642609e8d5f9, reason: Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:09.905915 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-05663824-35bd-4e71-adf8-17b007eb519c req-f652eb27-b36e-4c54-8347-42dcfdd83b3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-deleted-94af59a9-6083-4695-95fd-a6d5a45d3081 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:09.906128 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-05663824-35bd-4e71-adf8-17b007eb519c req-f652eb27-b36e-4c54-8347-42dcfdd83b3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Neutron deleted interface 94af59a9-6083-4695-95fd-a6d5a45d3081; detaching it from the instance and deleting it from the info cache Jun 27 02:02:09.909529 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-05663824-35bd-4e71-adf8-17b007eb519c req-f652eb27-b36e-4c54-8347-42dcfdd83b3a service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Detach interface failed, port_id=94af59a9-6083-4695-95fd-a6d5a45d3081, reason: Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:09.949144 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Took 19.01 seconds to build instance. Jun 27 02:02:10.010215 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:10.010215 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] VM Started (Lifecycle Event) Jun 27 02:02:10.100574 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:10.100780 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:10.101049 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:10.101229 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:10.101370 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:10.107761 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Terminating instance Jun 27 02:02:10.139410 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.166740 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.171925 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.287596 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.354400 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.355536 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.366770 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:10.451861 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.523s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:10.515087 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:10.526759 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:10.609875 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:10.610264 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:10.610611 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:10.617413 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:02:10.645633 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.649542 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.675679 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.695112 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.728224 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Port e72cdd58-08c5-4654-abf5-4fe4f1251017 binding to destination host np0000003818 is already ACTIVE {{(pid=98971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jun 27 02:02:10.729833 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:10.733777 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:10.733777 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:10.733777 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:10.996649 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Instance destroyed successfully. Jun 27 02:02:10.996865 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lazy-loading 'resources' on Instance uuid 598098dd-311d-470c-b88c-a825b7c12a5a {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:11.035888 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:11.036318 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] VM Paused (Lifecycle Event) Jun 27 02:02:11.079214 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:11.236105 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:11.397734 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-1c08de5c-c3c7-4516-908c-c97d9cb0af07 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:11.507270 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-787198093',display_name='tempest-VolumesAdminNegativeTest-server-787198093',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesadminnegativetest-server-787198093',id=11,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:02:05Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a3a77ac5cb944391823f39bfbbbec54d',ramdisk_id='',reservation_id='r-wnkk8u7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1471445662',owner_user_name='tempest-VolumesAdminNegativeTest-1471445662-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:06Z,user_data=None,user_id='d09450dbdcd64a9bb7a5db858b105876',uuid=598098dd-311d-470c-b88c-a825b7c12a5a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:11.507547 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Converting VIF {"id": "63680c29-c21a-4940-a3d2-e4cf44f76519", "address": "fa:16:3e:79:ed:83", "network": {"id": "8f2f15d9-ed96-4e36-aca9-dc4e6a519d96", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1786027332-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3a77ac5cb944391823f39bfbbbec54d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63680c29-c2", "ovs_interfaceid": "63680c29-c21a-4940-a3d2-e4cf44f76519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:11.508662 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:11.509197 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:11.511819 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:11.512127 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63680c29-c2, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:11.515312 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:11.517295 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:11.518246 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:11.518541 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03a7d0d3-e4ac-4d82-80bc-a58111dc2a5a) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:11.519722 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:11.520417 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:11.520821 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:11.525537 np0000003818 nova-compute[98971]: INFO os_vif [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ed:83,bridge_name='br-int',has_traffic_filtering=True,id=63680c29-c21a-4940-a3d2-e4cf44f76519,network=Network(8f2f15d9-ed96-4e36-aca9-dc4e6a519d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63680c29-c2') Jun 27 02:02:11.525960 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Deleting instance files /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a_del Jun 27 02:02:11.527776 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Deletion of /opt/stack/data/nova/instances/598098dd-311d-470c-b88c-a825b7c12a5a_del complete Jun 27 02:02:11.539789 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:11.543814 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:11.543967 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] VM Resumed (Lifecycle Event) Jun 27 02:02:11.603246 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.604747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.605006 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.605171 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.605327 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.605905 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state None. Jun 27 02:02:11.606312 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.607769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.607833 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.608506 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.608563 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.608795 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state None. Jun 27 02:02:11.608916 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.609229 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.609517 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.609581 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.609734 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.609914 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state None. Jun 27 02:02:11.610157 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.610331 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.610460 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.610586 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.610724 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.610931 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state None. Jun 27 02:02:11.611317 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-deleted-bcaa5778-2722-4e86-ade0-a7f551f92cde {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.612096 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Neutron deleted interface bcaa5778-2722-4e86-ade0-a7f551f92cde; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.613665 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Detach interface failed, port_id=bcaa5778-2722-4e86-ade0-a7f551f92cde, reason: Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:11.613817 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.613965 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.614114 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.614216 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.614320 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.614459 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state None. Jun 27 02:02:11.614572 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.614680 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.614854 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.614955 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.615096 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.615223 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received unexpected event network-vif-plugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with vm_state active and task_state None. Jun 27 02:02:11.615343 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-deleted-feceed2c-66b6-4b32-ad15-e5b1cac20ad1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.615475 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Neutron deleted interface feceed2c-66b6-4b32-ad15-e5b1cac20ad1; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.617710 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ddf17a23-7b96-42b0-9c9c-4114cd8be85c req-037c5d0d-7b88-4c7e-a5f3-113e0d7a2e34 service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Detach interface failed, port_id=feceed2c-66b6-4b32-ad15-e5b1cac20ad1, reason: Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:11.696062 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.696651 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.696905 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.697160 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.697411 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Processing event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:02:11.697411 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.697546 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:11.697805 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:11.697805 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:11.697891 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:11.698008 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received unexpected event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with vm_state building and task_state spawning. Jun 27 02:02:11.698113 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-deleted-3ce7ae87-1473-43ee-a91f-2730d281f4cb {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.698234 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Neutron deleted interface 3ce7ae87-1473-43ee-a91f-2730d281f4cb; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.698906 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:02:11.702502 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1331e9f-1a75-4247-9b7f-7cac8fd32606 req-dab850ee-94de-463a-b5ab-7cfc5fcb257c service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Detach interface failed, port_id=3ce7ae87-1473-43ee-a91f-2730d281f4cb, reason: Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:11.703868 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:02:11.707258 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Instance spawned successfully. Jun 27 02:02:11.707928 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:02:11.747010 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:11.939372 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:11.975870 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-deleted-709dc39f-ad52-424b-b903-d6db3d30ba4e {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.976848 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Neutron deleted interface 709dc39f-ad52-424b-b903-d6db3d30ba4e; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.983000 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Detach interface failed, port_id=709dc39f-ad52-424b-b903-d6db3d30ba4e, reason: Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:11.983240 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-deleted-ef02fa0a-81ac-4278-8a8a-4e41ef5e0007 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.983442 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Neutron deleted interface ef02fa0a-81ac-4278-8a8a-4e41ef5e0007; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.986146 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Detach interface failed, port_id=ef02fa0a-81ac-4278-8a8a-4e41ef5e0007, reason: Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:11.986685 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-deleted-7405eae2-5d9a-4d94-9d70-578a9f29cae1 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.987079 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Neutron deleted interface 7405eae2-5d9a-4d94-9d70-578a9f29cae1; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.988244 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Detach interface failed, port_id=7405eae2-5d9a-4d94-9d70-578a9f29cae1, reason: Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:11.988458 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Received event network-vif-deleted-911ce191-d0af-4262-bf68-1b09900c9727 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:11.989130 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Neutron deleted interface 911ce191-d0af-4262-bf68-1b09900c9727; detaching it from the instance and deleting it from the info cache Jun 27 02:02:11.990342 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5403c0b9-0e4c-4630-a01f-0166266b7024 req-d1761263-2af4-407b-b6e6-52153bef6c2e service nova] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Detach interface failed, port_id=911ce191-d0af-4262-bf68-1b09900c9727, reason: Instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:12.008354 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-228e31c8-ad2f-47d4-9c23-887be5000e71 req-4cb57bd7-0f4b-41fa-9442-cf398e2b843c service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Received event network-vif-deleted-4cae5406-fc0f-4b98-ae36-437f32645e33 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:12.009077 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-228e31c8-ad2f-47d4-9c23-887be5000e71 req-4cb57bd7-0f4b-41fa-9442-cf398e2b843c service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Neutron deleted interface 4cae5406-fc0f-4b98-ae36-437f32645e33; detaching it from the instance and deleting it from the info cache Jun 27 02:02:12.013814 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-228e31c8-ad2f-47d4-9c23-887be5000e71 req-4cb57bd7-0f4b-41fa-9442-cf398e2b843c service nova] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Detach interface failed, port_id=4cae5406-fc0f-4b98-ae36-437f32645e33, reason: Instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:12.034999 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 27 02:02:12.036076 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:02:12.036698 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:02:12.036698 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:02:12.037147 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:12.048729 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:12.051208 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:12.100771 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:12.180477 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:12.216591 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:12.216591 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:12.216873 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:12.217584 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:12.223796 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:12.224240 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:12.272341 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:12.300077 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:12.443703 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:12.554825 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999571144000129 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:12.555436 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:12.555436 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] VM Started (Lifecycle Event) Jun 27 02:02:12.604095 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Took 7.56 seconds to deallocate network for instance. Jun 27 02:02:12.738819 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Took 10.91 seconds to spawn the instance on the hypervisor. Jun 27 02:02:12.738819 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:12.789220 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Took 5.60 seconds to deallocate network for instance. Jun 27 02:02:12.947056 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Creating tmpfile /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/tmpsq1croe_ to verify with other compute node that the instance is on the same shared storage. {{(pid=98971) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10568}} Jun 27 02:02:12.947056 np0000003818 nova-compute[98971]: DEBUG nova.compute.rpcapi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 27 02:02:13.058191 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:13.062796 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:13.264760 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Took 22.21 seconds to build instance. Jun 27 02:02:13.275667 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:13.476411 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.491585 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.521597 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.523123 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.551486 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.566654 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:13.566654 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] VM Paused (Lifecycle Event) Jun 27 02:02:13.768668 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.718s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:13.782067 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Took 1.74 seconds to deallocate network for instance. Jun 27 02:02:13.791667 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2089b3f1-0c8e-4d94-941c-80efc82f8009 req-fc30612f-7c0a-45c5-bc78-0073ac4f9fa2 service nova] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Received event network-vif-deleted-63680c29-c21a-4940-a3d2-e4cf44f76519 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:13.797788 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.824193 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:13.853777 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance destroyed successfully. Jun 27 02:02:13.853777 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'resources' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:14.069487 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:14.075608 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.99972531000003 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:14.075828 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for 380fe23b-73a4-4b4f-9349-fce0f62ae5fb due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:02:14.076109 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:14.076174 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Resumed (Lifecycle Event) Jun 27 02:02:14.102455 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:14.102455 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing instance network info cache due to event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:14.102455 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:14.105012 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:14.118874 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:14.286321 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:14.286657 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:14.361556 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:08Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000003818',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:14.361556 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:14.361556 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:14.361556 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:14.364612 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:14.364947 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72cdd58-08, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:14.368616 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:14.368616 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:14.368616 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:14.368616 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:14.368616 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98cc5b96-716d-4e1e-8061-26327d95f661) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: INFO os_vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:14.389638 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:14.390147 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:14.390147 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:14.390341 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d', '32')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '30')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '31')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Resulting device map defaultdict(. at 0x7decc06d6520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'): ({'sdq'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Removing multipathed devices sdn, sdq {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:14.427479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flush multipath device 330000000032d291d {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:14.455336 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:14.496949 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:14.515162 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Refreshing inventories for resource provider e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jun 27 02:02:14.525760 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Took 1.92 seconds to detach 3 volumes for instance. Jun 27 02:02:14.542640 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking to see if SCSI volumes sdn, sdq have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:14.542860 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] SCSI volumes sdn, sdq have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:14.543899 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking to see if device paths {'sdn', 'sdq'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:14.556220 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Device paths {'sdn', 'sdq'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:14.556503 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:14.590744 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:14.590744 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:14.604725 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:14.609502 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:14.629521 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Updating ProviderTree inventory for provider e15e7dcd-705b-4a74-b310-f650a880c622 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jun 27 02:02:14.629730 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Updating inventory in ProviderTree for provider e15e7dcd-705b-4a74-b310-f650a880c622 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 27 02:02:14.640926 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] Jun 27 02:02:14.640926 np0000003818 nova-compute[98971]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] successful. Jun 27 02:02:14.640926 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:14.681440 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:14.691101 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:14.711555 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Refreshing aggregate associations for resource provider e15e7dcd-705b-4a74-b310-f650a880c622, aggregates: None {{(pid=98971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jun 27 02:02:14.722746 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Took 1.94 seconds to detach 3 volumes for instance. Jun 27 02:02:14.736762 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] Jun 27 02:02:14.736762 np0000003818 nova-compute[98971]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] successful. Jun 27 02:02:14.736762 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:14.755817 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:14.755817 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:14.755817 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== disconnect_volume: return (366ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:14.755937 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:14.799685 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Refreshing trait associations for resource provider e15e7dcd-705b-4a74-b310-f650a880c622, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_USB,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_PPC64LE,HW_ARCH_X86_64,COMPUTE_TRUSTED_CERTS,COMPUTE_ARCH_RISCV64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_IGB,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_ICH9,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE41,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_SOUND_MODEL_SB16,COMPUTE_STORAGE_BUS_IDE {{(pid=98971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jun 27 02:02:14.891469 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-changed-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:14.891959 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Refreshing instance network info cache due to event network-changed-14c670f2-d304-4427-9bcf-58d43a34dc40. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:14.892380 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] Acquiring lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:14.892819 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] Acquired lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:14.894067 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Refreshing network info cache for port 14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:15.031520 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:15.084986 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:15.085482 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Started (Lifecycle Event) Jun 27 02:02:15.129793 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:15.267518 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:15.357156 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updated VIF entry in instance network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:02:15.359255 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:15.395848 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:15.588742 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:15.590756 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:15.655251 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:15.655599 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:15.869684 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:15.869900 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:15.870079 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing instance network info cache due to event network-changed-8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:15.870180 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] Acquiring lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:15.870270 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] Acquired lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:15.870385 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Refreshing network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:15.898042 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:15.898618 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:15.898784 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:15.898897 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:15.899498 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:15.899634 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state resized and task_state resize_reverting. Jun 27 02:02:15.899744 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:15.899857 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:15.899983 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:15.900108 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:15.900219 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:15.900318 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-9cfa769a-eed6-412d-a269-a2662a5aea9d req-eafa7d94-c6b8-40cf-a17d-e8fd1b4a61a5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state resized and task_state resize_reverting. Jun 27 02:02:16.012195 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:16.040548 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:16.097444 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:16.098037 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] VM Resumed (Lifecycle Event) Jun 27 02:02:16.160410 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:16.189116 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updated VIF entry in instance network info cache for port 14c670f2-d304-4427-9bcf-58d43a34dc40. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:02:16.189428 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updating instance_info_cache with network_info: [{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:16.279095 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004449620000741561 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:16.279747 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:16.279994 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:16.280262 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] VM Stopped (Lifecycle Event) Jun 27 02:02:16.280843 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.7278363430000354 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:16.281522 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.727142965999974 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:16.375378 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:16.600844 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:16.607253 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:16.669644 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.383s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:16.671199 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.640s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:16.692369 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ed5aa21f-b55a-4606-a3ea-e921017fba6c req-7fe9ac1e-7a9f-4c84-9e6d-108158e8ffbf service nova] Releasing lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:16.784250 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:16.786813 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 1600aedd-362f-49f5-ab76-7a79cabf4d3f] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:16.807600 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Deleted allocations for instance 598098dd-311d-470c-b88c-a825b7c12a5a Jun 27 02:02:16.966298 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updated VIF entry in instance network info cache for port 8363c61e-3b4a-44fe-be22-75f45bc63c31. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:02:16.966782 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [{"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:17.112967 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999742712999932 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:17.301687 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:17.327821 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:17.328102 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:17.469069 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fb8b0410-ce81-4e88-93aa-25b54182fb1a req-491aba75-b0c4-4878-8844-70c12bc76206 service nova] Releasing lock "refresh_cache-380fe23b-73a4-4b4f-9349-fce0f62ae5fb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:17.819214 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d343547d-2ef6-44d0-b944-a8a4bb767b2c tempest-VolumesAdminNegativeTest-1471445662 tempest-VolumesAdminNegativeTest-1471445662-project-member] Lock "598098dd-311d-470c-b88c-a825b7c12a5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.718s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:17.830880 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:18.338902 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.668s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:18.341216 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.072s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:18.446562 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Deleted allocations for instance 1600aedd-362f-49f5-ab76-7a79cabf4d3f Jun 27 02:02:18.840179 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:18.840470 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:19.343636 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:19.369759 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:19.460851 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0886af2b-2ed8-4bd0-87b1-d5192ba409d8 tempest-TaggedBootDevicesTest-112727879 tempest-TaggedBootDevicesTest-112727879-project-member] Lock "1600aedd-362f-49f5-ab76-7a79cabf4d3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 19.596s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:19.852630 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.513s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:19.856427 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 3.814s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:19.926909 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Deleted allocations for instance e9a68589-d76c-48cf-afd7-a1021c6d38e6 Jun 27 02:02:20.009135 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004351850000148261 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.009960 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.009960 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.544604860000163 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.009960 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=7.544512259000157 future=) was cancelled while queued, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.009960 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.009960 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.065473376 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.010200 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:20.010433 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] VM Stopped (Lifecycle Event) Jun 27 02:02:20.011612 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.063717816999997 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:20.357052 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'migration_context' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:20.516266 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: e9a68589-d76c-48cf-afd7-a1021c6d38e6] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:20.864922 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Object Instance lazy-loaded attributes: resources,migration_context {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:02:20.942056 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a99c90b2-2e9e-4be2-bc29-580cfd332853 tempest-TaggedBootDevicesTest_v242-991946975 tempest-TaggedBootDevicesTest_v242-991946975-project-member] Lock "e9a68589-d76c-48cf-afd7-a1021c6d38e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 18.352s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:20.954441 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:21.574169 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:21.574169 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:22.077044 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:22.307609 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:23.103720 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.250s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:23.104963 np0000003818 nova-compute[98971]: DEBUG nova.compute.rpcapi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 27 02:02:24.325202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:24.371722 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:24.740680 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Swapping old allocation on dict_keys(['e15e7dcd-705b-4a74-b310-f650a880c622']) held by migration 8eda7e1f-5d6c-4ffa-9976-7413e948dac5 for instance Jun 27 02:02:24.901609 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Overwriting current allocation {'allocations': {'e15e7dcd-705b-4a74-b310-f650a880c622': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 17}}, 'project_id': 'd687a155933b421c8c35d3a3655e35bc', 'user_id': '7d0ea64538644b3c8b1194033f822216', 'consumer_generation': 1} on consumer ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jun 27 02:02:25.240374 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:25.320660 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:25.320866 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:25.414359 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:25.415025 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquired lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:25.415025 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:25.823617 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Detaching volume fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:02:25.868522 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Attempting to driver detach volume fd34a13d-e79e-44d1-bab3-eb4ad65ef01e from mountpoint /dev/vdb Jun 27 02:02:25.871670 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Found disk vdb by alias ua-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:02:25.873045 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Found disk vdb by alias ua-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:02:25.873184 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Attempting to detach device vdb from instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] detach device xml: Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]:
Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: Jun 27 02:02:25.873428 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:02:25.881084 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Successfully detached device vdb from instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 from the persistent domain config. Jun 27 02:02:25.881396 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] (1/8): Attempting to detach device vdb with device alias ua-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e from instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] detach device xml: Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: fd34a13d-e79e-44d1-bab3-eb4ad65ef01e Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]:
Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: Jun 27 02:02:25.881688 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:02:25.917468 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:26.437221 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:26.605455 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:02:26.606158 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e for instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:02:26.611076 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Successfully detached device vdb from instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 from the live domain config. Jun 27 02:02:26.613166 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:26.613166 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:26.614310 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:26.614310 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:26.614658 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:26.614830 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:26.645698 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:26.645698 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:26.645698 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:26.645698 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:26.645698 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:26.645698 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e (non-flash) Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d', '32')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:26.646125 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '23')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:26.646917 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e', '24')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:26.647805 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Resulting device map defaultdict(. at 0x7decc0578900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'): ({'sdp'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:26.648212 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Removing multipathed devices sdp, sdo {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:26.648541 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Flush multipath device 3300000008b3d19ae {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:26.684906 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:26.693482 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:26.736131 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:26.795305 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Checking to see if SCSI volumes sdp, sdo have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:26.795546 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] SCSI volumes sdp, sdo have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:26.796650 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Checking to see if device paths {'sdp', 'sdo'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:26.810381 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Device paths {'sdp', 'sdo'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:26.810657 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:26.833808 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:26.865755 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.40.100,3260] Jun 27 02:02:26.865755 np0000003818 nova-compute[98971]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.40.100,3260] successful. Jun 27 02:02:26.865755 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:26.881116 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:26.893198 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:26.931121 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.50.100,3260] Jun 27 02:02:26.931121 np0000003818 nova-compute[98971]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-fd34a13d-e79e-44d1-bab3-eb4ad65ef01e, portal: 192.168.50.100,3260] successful. Jun 27 02:02:26.931121 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:26.945142 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:26.945488 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:26.945685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] <== disconnect_volume: return (331ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:26.945841 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:27.196628 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Releasing lock "refresh_cache-ad0aa6e6-31be-4a5b-b89c-152d732f755e" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:27.198676 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:27.217117 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:02:27.254489 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:27.306687 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:27.312538 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:02:27.312854 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:02:27.327748 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:02:27.329410 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe58:552b', 'fe80::fc9d:c9ff:feea:6a6c', 'fe80::fc16:3eff:fe04:7956', 'fe80::50a9:bfff:fe5b:aead', 'fe80::fc16:3eff:feef:b815', 'fe80::fc16:3eff:fe7d:c2bb'] Jun 27 02:02:27.329592 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:02:27.329771 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:02:27.330591 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:27.543175 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'flavor' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:27.924323 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:28.485884 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Starting finish_revert_migration {{(pid=98971) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12953}} Jun 27 02:02:28.522343 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start _get_guest_xml network_info=[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'ad0aa6e6-31be-4a5b-b89c-152d732f755e', 'attached_at': '2026-06-27T02:02:27.000000', 'detached_at': '', 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'serial': '213a9d41-f273-4d1c-9412-283ee3b32c09'}, 'attachment_id': 'dfd82ad5-29fa-4f04-bf1e-bbd6fd8cfa25', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:02:28.530174 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:28.531778 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1976611999', uuid='ad0aa6e6-31be-4a5b-b89c-152d732f755e'), owner=OwnerMeta(userid='7d0ea64538644b3c8b1194033f822216', username='tempest-ServerActionsTestOtherB-461891651-project-member', projectid='d687a155933b421c8c35d3a3655e35bc', projectname='tempest-ServerActionsTestOtherB-461891651'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525748.531235) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:02:28.535524 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:02:28.536159 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:02:28.538699 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:02:28.539193 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:02:28.543703 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:02:28.543703 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:02:28.544440 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:02:28.544440 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:02:28.544440 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:02:28.546483 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:02:28.546483 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:02:28.546483 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:02:28.546483 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:02:28.547021 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:02:28.547189 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:02:28.547360 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:02:28.547547 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:28.553511 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d7072428-b67a-4f17-bfae-8dc148125cd4 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.232s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:28.787480 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:29.070439 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:29.091870 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.016364613999940048 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:29.091870 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:29.092720 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.020580728999903 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:29.092720 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.020425871999805 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:29.093210 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:29.093210 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] VM Stopped (Lifecycle Event) Jun 27 02:02:29.181571 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.config --force-share --output=json" returned: 0 in 0.111s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:29.182119 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:29.182529 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:29.183245 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "/opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:29.184140 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:02:29.184676 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:29.184985 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:29.185514 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:29.185852 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:02:29.208605 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:29.209034 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:29.209240 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:02:29.210867 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:29.212196 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:29.212606 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:02:29.223427 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:02:29.223427 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:29.230436 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:02:29.230436 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09] added Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:29.242351 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:29.243687 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:02:29.243687 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:02:29.243687 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09] added Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:29.253583 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:02:29.253926 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:02:29.254657 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:02:29.375071 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:29.603670 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 598098dd-311d-470c-b88c-a825b7c12a5a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:30.243537 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:02:30.255411 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:02:30.262424 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:02:30.277730 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.293446 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.297001 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.310212 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.310212 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.310212 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.310212 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:30.310709 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.310709 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.310709 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.310709 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:30.321608 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.321608 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.321608 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.321608 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:30.321829 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.321829 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.321829 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.321829 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:30.354674 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] Jun 27 02:02:30.354674 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] successful. Jun 27 02:02:30.354674 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.373992 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] Jun 27 02:02:30.373992 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] successful. Jun 27 02:02:30.373992 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.380728 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.394206 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:30.412018 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.412018 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.412018 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.412018 np0000003818 nova-compute[98971]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.412018 np0000003818 nova-compute[98971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.412018 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:30.412775 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:02:30.413785 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] HCTL ('8', '-', '-', 0) found on session 33 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:02:30.413948 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:02:30.414792 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.414792 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.414792 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.414792 np0000003818 nova-compute[98971]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.414792 np0000003818 nova-compute[98971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.414792 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:30.415026 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.415026 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:30.415026 np0000003818 nova-compute[98971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c7af976-c2ad-4d15-8970-b121e2e5af5d (non-flash) Jun 27 02:02:30.415026 np0000003818 nova-compute[98971]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.415026 np0000003818 nova-compute[98971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:30.415026 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:30.415391 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:30.415479 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:02:30.416626 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] HCTL ('9', '-', '-', 0) found on session 34 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:02:30.416626 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:02:30.444443 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 33 and hctl ['8', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:30.456801 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 34 and hctl ['9', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:30.759086 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:30.759086 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:30.759086 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:30.759086 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:30.759086 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:30.762831 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Terminating instance Jun 27 02:02:31.125083 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:31.270647 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:02:31.305670 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:31.308610 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:31.335632 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:31.342801 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:31.379386 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:31.445447 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 33 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:31.445613 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:02:31.457858 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Searching for a device in session 34 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:31.458108 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:02:31.588884 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-159dd541-7f6f-41fb-a560-2f9da4bff326 req-bd717233-2f1e-45c8-8f26-586465a8f9e3 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:31.589156 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-159dd541-7f6f-41fb-a560-2f9da4bff326 req-bd717233-2f1e-45c8-8f26-586465a8f9e3 service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:31.589266 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-159dd541-7f6f-41fb-a560-2f9da4bff326 req-bd717233-2f1e-45c8-8f26-586465a8f9e3 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:31.589435 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-159dd541-7f6f-41fb-a560-2f9da4bff326 req-bd717233-2f1e-45c8-8f26-586465a8f9e3 service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:31.589793 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-159dd541-7f6f-41fb-a560-2f9da4bff326 req-bd717233-2f1e-45c8-8f26-586465a8f9e3 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:31.590179 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-159dd541-7f6f-41fb-a560-2f9da4bff326 req-bd717233-2f1e-45c8-8f26-586465a8f9e3 service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:31.673162 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999666820999892 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:31.678788 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Instance destroyed successfully. Jun 27 02:02:31.678788 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lazy-loading 'resources' on Instance uuid 536746ce-ca15-4708-b1f0-9aca4dc185e5 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:32.106224 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:32.114280 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004325680001784349 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:32.114280 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:32.114280 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.555247523999924 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:32.114280 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.555149582000013 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:32.114280 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:32.114280 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Stopped (Lifecycle Event) Jun 27 02:02:32.181203 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1697177352',display_name='tempest-ServerStableDeviceRescueTest-server-1697177352',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverstabledevicerescuetest-server-1697177352',id=8,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9yf02HargSaAeo/3gzQ1u/ovITL4PxYzZDhIE1ZjiQobiZLbRakEZ392FVeXytMbnK/SoojofaeCb1tmEHICneTo68Me+KYfv1eTRb1CvFmWIrdCPCMLPCZeZJHbFXtw==',key_name='tempest-keypair-638937042',keypairs=,launch_index=0,launched_at=2026-06-27T02:01:44Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8c59372a35d245a7b24ad6282d28e3d7',ramdisk_id='',reservation_id='r-fdt0sx0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-686305345',owner_user_name='tempest-ServerStableDeviceRescueTest-686305345-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:01:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054898809a24ab39080e132cd20ec96',uuid=536746ce-ca15-4708-b1f0-9aca4dc185e5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:32.181688 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converting VIF {"id": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "address": "fa:16:3e:58:55:2b", "network": {"id": "62e34bfd-e54a-480d-a475-13b77507f465", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-660237034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c59372a35d245a7b24ad6282d28e3d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc85dd54a-d4", "ovs_interfaceid": "c85dd54a-d4ef-48d4-bcf6-723ac647e834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:32.182912 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:32.183111 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:32.184943 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:32.185338 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc85dd54a-d4, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:32.187166 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:32.188607 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:32.189542 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:32.189985 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a198d73-2616-49c7-8ff5-fe847d092dd1) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:32.190419 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:32.191770 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:32.194856 np0000003818 nova-compute[98971]: INFO os_vif [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:55:2b,bridge_name='br-int',has_traffic_filtering=True,id=c85dd54a-d4ef-48d4-bcf6-723ac647e834,network=Network(62e34bfd-e54a-480d-a475-13b77507f465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc85dd54a-d4') Jun 27 02:02:32.195212 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Deleting instance files /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5_del Jun 27 02:02:32.196254 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Deletion of /opt/stack/data/nova/instances/536746ce-ca15-4708-b1f0-9aca4dc185e5_del complete Jun 27 02:02:32.213707 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:02:32.309480 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:32.619063 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8a1e430d-56a9-4c72-ab22-a077f5073df7 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:32.703491 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Took 1.43 seconds to destroy the instance on the hypervisor. Jun 27 02:02:32.704201 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:02:32.704535 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:02:32.704749 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:02:32.705237 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:32.810158 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:33.238963 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Found WWN 330000000032d291d for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:02:33.238963 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.053s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:33.241887 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== connect_volume: return (4054ms) {'type': 'block', 'scsi_wwn': '330000000032d291d', 'path': '/dev/dm-0', 'multipath_id': '330000000032d291d'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:33.241887 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000032d291d', 'path': '/dev/dm-0', 'multipath_id': '330000000032d291d'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:02:33.639350 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b51a27a8-962e-40f5-a552-30f9f661f5d6 req-4527023a-5b10-4e6a-85a5-4d6f14fd9ffe service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-deleted-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:33.639350 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-b51a27a8-962e-40f5-a552-30f9f661f5d6 req-4527023a-5b10-4e6a-85a5-4d6f14fd9ffe service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Neutron deleted interface c85dd54a-d4ef-48d4-bcf6-723ac647e834; detaching it from the instance and deleting it from the info cache Jun 27 02:02:33.641335 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b51a27a8-962e-40f5-a552-30f9f661f5d6 req-4527023a-5b10-4e6a-85a5-4d6f14fd9ffe service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Detach interface failed, port_id=c85dd54a-d4ef-48d4-bcf6-723ac647e834, reason: Instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:33.683577 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-746c9d05-e672-463f-ade8-4e0babe4719b req-a2ac5ca8-e322-47cf-a040-9c565cdcc8ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:33.683808 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-746c9d05-e672-463f-ade8-4e0babe4719b req-a2ac5ca8-e322-47cf-a040-9c565cdcc8ab service nova] Acquiring lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:33.684090 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-746c9d05-e672-463f-ade8-4e0babe4719b req-a2ac5ca8-e322-47cf-a040-9c565cdcc8ab service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:33.684177 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-746c9d05-e672-463f-ade8-4e0babe4719b req-a2ac5ca8-e322-47cf-a040-9c565cdcc8ab service nova] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:33.684348 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-746c9d05-e672-463f-ade8-4e0babe4719b req-a2ac5ca8-e322-47cf-a040-9c565cdcc8ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] No waiting events found dispatching network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:33.684458 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-746c9d05-e672-463f-ade8-4e0babe4719b req-a2ac5ca8-e322-47cf-a040-9c565cdcc8ab service nova] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Received event network-vif-unplugged-c85dd54a-d4ef-48d4-bcf6-723ac647e834 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:33.750002 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:08Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003818',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:33.750002 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:33.750002 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] End _get_guest_xml xml= Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: instance-00000009 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 196608 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-server-1976611999 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 2026-06-27 02:02:28 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 192 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: True Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: bare Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: ide Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: pc Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-461891651-project-member Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherB-461891651 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: 213a9d41-f273-4d1c-9412-283ee3b32c09 Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: Jun 27 02:02:33.752530 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Preparing to wait for external event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:08Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003818',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:33.759377 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:33.760133 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:33.760928 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:33.761230 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:33.761505 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:33.762579 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:33.763121 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd77ee4f1-7d33-56c9-a54c-c1be99b9b654', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:33.764381 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:33.765427 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:33.768285 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:33.768285 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape72cdd58-08, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:33.768743 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape72cdd58-08, col_values=(('qos', UUID('93c6eb6c-40b6-4be8-b98a-61ae318243ff')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:33.768990 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape72cdd58-08, col_values=(('external_ids', {'iface-id': 'e72cdd58-08c5-4654-abf5-4fe4f1251017', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:8b:3f', 'vm-uuid': 'ad0aa6e6-31be-4a5b-b89c-152d732f755e'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:33.770544 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:33.771771 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:33.783069 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:33.784906 np0000003818 nova-compute[98971]: INFO os_vif [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') Jun 27 02:02:34.069355 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:34.257500 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.304057 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.331943 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.335520 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.451093 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.572406 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Took 1.87 seconds to deallocate network for instance. Jun 27 02:02:34.739606 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.742368 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.746103 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:34.770805 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:35.081501 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:35.081679 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:35.406568 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:35.406907 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Started (Lifecycle Event) Jun 27 02:02:35.555195 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:35.555542 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:35.762065 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:35.762208 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:35.767595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:35.767595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:35.769622 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Processing event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:02:35.771182 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:35.771182 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:35.772247 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:35.772754 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:35.772754 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:35.772754 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-7dc1edc3-9501-40de-a17e-f957d1b14c24 req-eb71fc8d-a488-440c-bd2e-1635804a5003 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received unexpected event network-vif-plugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with vm_state resized and task_state resize_reverting. Jun 27 02:02:35.774194 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:02:35.781575 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance running successfully. Jun 27 02:02:35.785104 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] finish_revert_migration finished successfully. {{(pid=98971) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12999}} Jun 27 02:02:35.910014 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:35.916550 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:36.060241 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:36.342590 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:36.420237 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jun 27 02:02:36.420641 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:36.420714 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Paused (Lifecycle Event) Jun 27 02:02:36.570597 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.487s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:36.641543 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Deleted allocations for instance 536746ce-ca15-4708-b1f0-9aca4dc185e5 Jun 27 02:02:36.847902 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-57e53a64-8816-4729-8024-ea3fbc386172 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance to original state: 'active' Jun 27 02:02:36.923885 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:36.925545 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:36.925735 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Resumed (Lifecycle Event) Jun 27 02:02:37.312471 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:37.428736 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:37.433385 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:37.656393 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7ef2dab2-efd4-423f-b7ae-90b4f35ef628 tempest-ServerStableDeviceRescueTest-686305345 tempest-ServerStableDeviceRescueTest-686305345-project-member] Lock "536746ce-ca15-4708-b1f0-9aca4dc185e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.900s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:38.181773 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:38.324129 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:38.324225 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:38.326007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:38.326007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:38.326007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:38.327233 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Terminating instance Jun 27 02:02:38.771455 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:38.831625 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:02:38.854270 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:38.857876 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:38.882697 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:38.885422 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:38.913465 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.152332 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.163859 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.166647 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-acc954ff-87bd-4c99-8cb0-94798b44436b req-e0755696-6292-49e8-ad5e-99499239536b service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:39.167765 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-acc954ff-87bd-4c99-8cb0-94798b44436b req-e0755696-6292-49e8-ad5e-99499239536b service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:39.168286 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-acc954ff-87bd-4c99-8cb0-94798b44436b req-e0755696-6292-49e8-ad5e-99499239536b service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:39.168286 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-acc954ff-87bd-4c99-8cb0-94798b44436b req-e0755696-6292-49e8-ad5e-99499239536b service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:39.168767 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-acc954ff-87bd-4c99-8cb0-94798b44436b req-e0755696-6292-49e8-ad5e-99499239536b service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:39.168767 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-acc954ff-87bd-4c99-8cb0-94798b44436b req-e0755696-6292-49e8-ad5e-99499239536b service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:39.195154 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.99965032 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:39.198350 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Instance destroyed successfully. Jun 27 02:02:39.199343 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lazy-loading 'resources' on Instance uuid ad0aa6e6-31be-4a5b-b89c-152d732f755e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:39.324303 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.701842 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1976611999',display_name='tempest-ServerActionsTestOtherB-server-1976611999',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestotherb-server-1976611999',id=9,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9yKx+61gmdtKfyhieT/PYZD+YThXd2J1J+qEjQTTAnf5KqVkdaG53xUBJWyBQtBHBufOWCHFxPEjdyG88NZCDte6KMOwNZd897Fr4GZ4GoVFGmvAc+IFiRfcyO60rhvA==',key_name='tempest-keypair-1098753668',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:36Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d687a155933b421c8c35d3a3655e35bc',ramdisk_id='',reservation_id='r-3t2fc67h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-461891651',owner_user_name='tempest-ServerActionsTestOtherB-461891651-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d0ea64538644b3c8b1194033f822216',uuid=ad0aa6e6-31be-4a5b-b89c-152d732f755e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:39.702161 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converting VIF {"id": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "address": "fa:16:3e:fa:8b:3f", "network": {"id": "ade48853-3afd-41bf-9bf0-1d77202a7d5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-422651892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d687a155933b421c8c35d3a3655e35bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape72cdd58-08", "ovs_interfaceid": "e72cdd58-08c5-4654-abf5-4fe4f1251017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:39.702773 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:39.703006 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:39.703887 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.704145 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72cdd58-08, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:39.705433 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.706480 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:39.707726 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.708487 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.708652 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93c6eb6c-40b6-4be8-b98a-61ae318243ff) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:39.709292 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.709904 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:39.710902 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:39.712879 np0000003818 nova-compute[98971]: INFO os_vif [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8b:3f,bridge_name='br-int',has_traffic_filtering=True,id=e72cdd58-08c5-4654-abf5-4fe4f1251017,network=Network(ade48853-3afd-41bf-9bf0-1d77202a7d5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72cdd58-08') Jun 27 02:02:39.714228 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:39.714588 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:39.714736 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:39.715157 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:39.715585 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '213a9d41-f273-4d1c-9412-283ee3b32c09', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:39.715757 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:39.742749 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:39.742749 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:39.742749 np0000003818 nova-compute[98971]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:39.742749 np0000003818 nova-compute[98971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:39.742749 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:39.742960 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsi session list stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:39.742960 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:39.742960 np0000003818 nova-compute[98971]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:39.742960 np0000003818 nova-compute[98971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09 (non-flash) Jun 27 02:02:39.742960 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:39.743419 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '34')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:39.743419 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '33')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:39.744106 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09', '34')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:39.744814 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Resulting device map defaultdict(. at 0x7decc057bc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'): ({'sdd'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:39.745123 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Removing multipathed devices sdd, sdc {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:39.745387 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Flush multipath device 330000000032d291d {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:39.787006 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:39.839781 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:39.888789 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:39.889072 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:39.890078 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:39.906990 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:39.907185 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:39.922597 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:39.954336 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] Jun 27 02:02:39.954336 np0000003818 nova-compute[98971]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.40.100,3260] successful. Jun 27 02:02:39.954336 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:39.966789 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:39.982866 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:40.027172 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] Jun 27 02:02:40.027172 np0000003818 nova-compute[98971]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-213a9d41-f273-4d1c-9412-283ee3b32c09, portal: 192.168.50.100,3260] successful. Jun 27 02:02:40.027172 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:40.041449 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:40.041664 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:40.041881 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] <== disconnect_volume: return (327ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:40.041991 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:40.042348 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Deleting instance files /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_del Jun 27 02:02:40.050897 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Deletion of /opt/stack/data/nova/instances/ad0aa6e6-31be-4a5b-b89c-152d732f755e_del complete Jun 27 02:02:40.559299 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Took 1.73 seconds to destroy the instance on the hypervisor. Jun 27 02:02:40.560137 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:02:40.561921 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:02:40.562071 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:02:40.562364 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:41.074600 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:41.103419 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:41.269184 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1372e3b-a92a-454a-a7af-07813c3b0544 req-7b6650c0-4231-411a-a245-bf9e3f0d4994 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:41.269686 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1372e3b-a92a-454a-a7af-07813c3b0544 req-7b6650c0-4231-411a-a245-bf9e3f0d4994 service nova] Acquiring lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:41.269907 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1372e3b-a92a-454a-a7af-07813c3b0544 req-7b6650c0-4231-411a-a245-bf9e3f0d4994 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:41.270091 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f1372e3b-a92a-454a-a7af-07813c3b0544 req-7b6650c0-4231-411a-a245-bf9e3f0d4994 service nova] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:41.270250 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1372e3b-a92a-454a-a7af-07813c3b0544 req-7b6650c0-4231-411a-a245-bf9e3f0d4994 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] No waiting events found dispatching network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:41.270448 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f1372e3b-a92a-454a-a7af-07813c3b0544 req-7b6650c0-4231-411a-a245-bf9e3f0d4994 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-unplugged-e72cdd58-08c5-4654-abf5-4fe4f1251017 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:41.671263 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:42.299791 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-680d35b2-7450-428b-af77-fdf182bccd79 req-132a7d10-77c1-4656-adf2-82a5969ff7d5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Received event network-vif-deleted-e72cdd58-08c5-4654-abf5-4fe4f1251017 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:42.300338 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-680d35b2-7450-428b-af77-fdf182bccd79 req-132a7d10-77c1-4656-adf2-82a5969ff7d5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Neutron deleted interface e72cdd58-08c5-4654-abf5-4fe4f1251017; detaching it from the instance and deleting it from the info cache Jun 27 02:02:42.300927 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-680d35b2-7450-428b-af77-fdf182bccd79 req-132a7d10-77c1-4656-adf2-82a5969ff7d5 service nova] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Detach interface failed, port_id=e72cdd58-08c5-4654-abf5-4fe4f1251017, reason: Instance ad0aa6e6-31be-4a5b-b89c-152d732f755e could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:02:42.313548 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:42.473758 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:42.712206 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:43.217989 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Took 2.66 seconds to deallocate network for instance. Jun 27 02:02:43.548128 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:43.548696 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:43.583631 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:43.583814 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:43.810996 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Took 0.59 seconds to detach 1 volumes for instance. Jun 27 02:02:44.050655 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:02:44.087145 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:02:44.322782 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:44.322954 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:44.327423 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:44.419730 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Deleted allocations for instance ad0aa6e6-31be-4a5b-b89c-152d732f755e Jun 27 02:02:44.486253 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:44.626626 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:44.627040 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:44.630513 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:02:44.630744 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Claim successful on node np0000003818 Jun 27 02:02:44.659780 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:44.710220 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:44.989007 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:45.441657 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b4ffdb6b-62d6-4d0e-8977-2d9b6f0ffc08 tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Lock "ad0aa6e6-31be-4a5b-b89c-152d732f755e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.117s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:46.112170 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:46.112170 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:46.614030 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:46.669331 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00039481099997829006 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:46.669435 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:46.669548 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.525190070000008 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:46.669628 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.525101797000161 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:46.670239 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:46.670424 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] VM Stopped (Lifecycle Event) Jun 27 02:02:47.025364 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:47.127164 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.500s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:47.128207 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.468s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:47.129087 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:02:47.134184 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:02:47.134424 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Claim successful on node np0000003818 Jun 27 02:02:47.173145 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4fb4019e-a70b-4cbb-94f3-0c461768acea tempest-ServerActionsTestOtherB-461891651 tempest-ServerActionsTestOtherB-461891651-project-member] [instance: 536746ce-ca15-4708-b1f0-9aca4dc185e5] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:47.317002 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:47.634540 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:02:47.634740 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:02:47.634961 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:47.635169 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:47.765385 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4788dadfeb774abf9fee57347b923c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df8f123bc7c456c8acd8f2c8eb3897b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:02:48.147401 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:02:48.640884 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:48.640884 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:48.644472 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:02:48.773760 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Successfully created port: 21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:02:49.150335 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:49.665606 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:02:49.667202 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.540s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:49.669147 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:02:49.682451 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:02:49.682451 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Creating image(s) Jun 27 02:02:49.682451 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "/opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:49.682451 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "/opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:49.682451 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "/opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.011s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:49.684333 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:49.690575 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:49.693132 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:49.712131 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:49.792476 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.099s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:49.793297 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:49.793693 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:49.794616 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:49.797720 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:49.798445 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:49.900226 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:49.905357 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:50.007356 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk 1073741824" returned: 0 in 0.106s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:50.008051 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.214s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:50.008520 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:50.120170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.102s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:50.120170 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:02:50.120170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:50.188026 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:02:50.188026 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:02:50.188649 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:50.189419 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:50.235088 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:50.239001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:50.239001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:50.239001 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Cannot resize image /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:02:50.239001 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:02:50.239001 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Ensure instance console log exists: /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:02:50.239001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:50.239666 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:50.239666 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:50.473444 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48172c20aca946a5b61e2dee61b95de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6450727e8a4a3dbb864e0616d363d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:02:50.526694 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Successfully updated port: 21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:02:50.583170 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-changed-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:50.583170 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Refreshing instance network info cache due to event network-changed-21ce8e42-2991-4b03-b851-02161a45c5e5. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:50.583170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] Acquiring lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:50.583170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] Acquired lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:50.583170 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Refreshing network info cache for port 21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:50.637345 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:50.637835 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:02:50.692580 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:02:50.740218 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:02:50.818490 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:50.818703 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:51.031588 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:51.093671 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:51.167882 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:51.205391 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:02:51.279370 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Successfully created port: 46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:02:51.321356 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Detaching volume d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 Jun 27 02:02:51.363706 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:51.363706 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:51.384507 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:02:51.384677 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Claim successful on node np0000003818 Jun 27 02:02:51.403891 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:51.406646 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Attempting to driver detach volume d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 from mountpoint /dev/vdb Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Found disk vdb by alias ua-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Found disk vdb by alias ua-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Attempting to detach device vdb from instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] detach device xml: Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]:
Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: Jun 27 02:02:51.412008 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully detached device vdb from instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb from the persistent domain config. Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] (1/8): Attempting to detach device vdb with device alias ua-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 from instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] detach device xml: Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]:
Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: Jun 27 02:02:51.447324 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:02:51.632997 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:51.633398 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:02:51.638668 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:51.907934 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-48c087c0-6a63-4d68-96c8-0dacefc46b54 req-16dc5ecc-a5da-4d1c-8a3d-4fc04c66fbf4 service nova] Releasing lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:51.909566 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquired lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:51.909790 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:52.117733 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:02:52.118182 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 for instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:02:52.122887 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully detached device vdb from instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb from the live domain config. Jun 27 02:02:52.125201 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:02:52.125630 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:52.126276 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:52.126664 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:52.127114 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:02:52.127350 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:02:52.155640 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Successfully updated port: 46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:02:52.158365 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:52.158365 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:52.158365 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:52.158632 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsi session list stdout=tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:52.158632 np0000003818 nova-compute[98971]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364 (non-flash) Jun 27 02:02:52.158632 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:52.158848 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:02:52.159087 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '29')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:52.160340 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364', '28')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:02:52.162167 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Resulting device map defaultdict(. at 0x7decc02b7b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'): ({'sdt'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'): ({'sds'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:02:52.162621 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Removing multipathed devices sds, sdt {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:02:52.164883 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Flush multipath device 3300000008d80fb60 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:02:52.201072 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:52.207525 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:02:52.212793 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:02:52.212793 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Creating image(s) Jun 27 02:02:52.213453 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "/opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:52.213710 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:52.215277 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:52.215277 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:52.229611 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:52.232644 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:52.263697 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Received event network-changed-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:52.263697 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Refreshing instance network info cache due to event network-changed-46eb7bbb-8ff7-4483-9026-4b2d1de542a0. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:52.263697 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] Acquiring lock "refresh_cache-24314451-30b5-4e28-a144-5dc2c9ceb1ca" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:52.263697 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] Acquired lock "refresh_cache-24314451-30b5-4e28-a144-5dc2c9ceb1ca" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:52.263697 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Refreshing network info cache for port 46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:52.272560 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Remove SCSI device /dev/sdt with /sys/block/sdt/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:02:52.319287 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:52.336999 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Checking to see if SCSI volumes sds, sdt have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:02:52.336999 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] SCSI volumes sds, sdt have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:02:52.338109 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Checking to see if device paths {'sds', 'sdt'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:02:52.350714 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.118s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:52.351080 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:52.351572 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:52.352123 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:52.357016 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:52.358465 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:52.371080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Device paths {'sds', 'sdt'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:02:52.371728 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:02:52.386746 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:52.403661 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-changed-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:52.403790 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Refreshing instance network info cache due to event network-changed-14c670f2-d304-4427-9bcf-58d43a34dc40. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:52.403909 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] Acquiring lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:52.404071 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] Acquired lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:52.404303 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Refreshing network info cache for port 14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:52.430800 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.40.100,3260] Jun 27 02:02:52.430800 np0000003818 nova-compute[98971]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.40.100,3260] successful. Jun 27 02:02:52.430800 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:52.449374 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:52.465166 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.108s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:52.465657 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:52.493593 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:52.525503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk 1073741824" returned: 0 in 0.058s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:52.525503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.172s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:52.525503 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:52.525503 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.50.100,3260] Jun 27 02:02:52.525503 np0000003818 nova-compute[98971]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-d9bdfb8b-a883-49fe-8c3a-82ba0e5c9364, portal: 192.168.50.100,3260] successful. Jun 27 02:02:52.525503 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:52.560954 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:52.561530 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:52.561701 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] <== disconnect_volume: return (436ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:52.562845 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:02:52.564220 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:52.629855 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.105s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:52.631045 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:02:52.631312 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:52.682933 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "refresh_cache-24314451-30b5-4e28-a144-5dc2c9ceb1ca" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:52.746624 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:52.750517 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Cannot resize image /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:02:52.752993 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:02:52.752993 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Ensure instance console log exists: /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:02:52.753213 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:52.754001 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:52.756560 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:52.772543 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:52.847318 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:52.911890 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:52.956512 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:53.101714 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Updating instance_info_cache with network_info: [{"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:53.185156 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'flavor' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:53.215297 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:53.221724 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:53.222052 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:53.387485 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:53.472759 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:53.478292 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.006s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:53.562798 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updated VIF entry in instance network info cache for port 14c670f2-d304-4427-9bcf-58d43a34dc40. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:02:53.563470 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updating instance_info_cache with network_info: [{"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:53.606386 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Releasing lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:53.606386 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Instance network_info: |[{"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:02:53.610161 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Start _get_guest_xml network_info=[{"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:02:53.613420 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:53.615765 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-383563192', uuid='e71ace91-8cd6-4723-8c23-58ac2e0101dc'), owner=OwnerMeta(userid='4788dadfeb774abf9fee57347b923c89', username='tempest-VolumesSnapshotTestJSON-1671669051-project-member', projectid='9df8f123bc7c456c8acd8f2c8eb3897b', projectname='tempest-VolumesSnapshotTestJSON-1671669051'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525773.6143339) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:02:53.618044 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:02:53.618594 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:02:53.620405 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:02:53.620590 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:02:53.621547 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:02:53.623842 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:02:53.624202 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:02:53.624405 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:02:53.624621 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:02:53.624773 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:02:53.624923 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:02:53.625878 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:02:53.626057 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:02:53.626216 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:02:53.626340 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:02:53.626655 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:02:53.638664 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:02:53.642756 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-383563192',display_name='tempest-VolumesSnapshotTestJSON-instance-383563192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumessnapshottestjson-instance-383563192',id=14,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs+oNWgWobyekuuFjBsQyk6D8N+jaRsxsYoUGaW6mmd2sVA1tr/DduodEseHg5nzwYJ0jMPNYlDaI+8zSGVj5IMpNxjEhzZoB0Q1shG6RYNuBuo0QtyhsM9pLU2FbhFQw==',key_name='tempest-keypair-1182090929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df8f123bc7c456c8acd8f2c8eb3897b',ramdisk_id='',reservation_id='r-lvix3pnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1671669051',owner_user_name='tempest-VolumesSnapshotTestJSON-1671669051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4788dadfeb774abf9fee57347b923c89',uuid=e71ace91-8cd6-4723-8c23-58ac2e0101dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:53.643082 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Converting VIF {"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:53.643748 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:53.644519 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lazy-loading 'pci_devices' on Instance uuid e71ace91-8cd6-4723-8c23-58ac2e0101dc {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:53.717346 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f547513d-3e72-4d58-bf1d-3d2b3b5ed13f req-6d119e09-659d-46f8-b53c-4933a2159a6f service nova] Releasing lock "refresh_cache-24314451-30b5-4e28-a144-5dc2c9ceb1ca" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:53.717773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquired lock "refresh_cache-24314451-30b5-4e28-a144-5dc2c9ceb1ca" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:53.718106 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:53.725192 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:53.984002 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'flavor' on Instance uuid 502e62b6-a346-41c3-917c-758e2d30274d {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:54.065807 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-141689cb-835c-472c-989f-b0461126f689 req-9e4aed81-4256-416f-b256-0799382e50de service nova] Releasing lock "refresh_cache-502e62b6-a346-41c3-917c-758e2d30274d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] End _get_guest_xml xml= Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: e71ace91-8cd6-4723-8c23-58ac2e0101dc Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: instance-0000000e Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 196608 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: tempest-VolumesSnapshotTestJSON-instance-383563192 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 2026-06-27 02:02:53 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 192 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: True Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: bare Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: tempest-VolumesSnapshotTestJSON-1671669051-project-member Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: tempest-VolumesSnapshotTestJSON-1671669051 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: e71ace91-8cd6-4723-8c23-58ac2e0101dc Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: e71ace91-8cd6-4723-8c23-58ac2e0101dc Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: Jun 27 02:02:54.149873 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:54.152599 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:54.152599 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Preparing to wait for external event network-vif-plugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:02:54.152599 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:54.152777 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:54.152850 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:54.153612 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-383563192',display_name='tempest-VolumesSnapshotTestJSON-instance-383563192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumessnapshottestjson-instance-383563192',id=14,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs+oNWgWobyekuuFjBsQyk6D8N+jaRsxsYoUGaW6mmd2sVA1tr/DduodEseHg5nzwYJ0jMPNYlDaI+8zSGVj5IMpNxjEhzZoB0Q1shG6RYNuBuo0QtyhsM9pLU2FbhFQw==',key_name='tempest-keypair-1182090929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df8f123bc7c456c8acd8f2c8eb3897b',ramdisk_id='',reservation_id='r-lvix3pnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1671669051',owner_user_name='tempest-VolumesSnapshotTestJSON-1671669051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4788dadfeb774abf9fee57347b923c89',uuid=e71ace91-8cd6-4723-8c23-58ac2e0101dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:54.153765 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Converting VIF {"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:54.154643 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:54.154643 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:54.155083 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.155390 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:54.155691 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:54.156461 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.156630 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d55e2d4-214f-5c76-aaea-fec60eafd6c1', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:54.157566 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.158479 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:54.160087 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.162484 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.162656 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21ce8e42-29, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:54.163032 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21ce8e42-29, col_values=(('qos', UUID('9219a68e-bdc7-4ef0-83ba-a9f770f0248d')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:54.163236 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21ce8e42-29, col_values=(('external_ids', {'iface-id': '21ce8e42-2991-4b03-b851-02161a45c5e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:dd:54', 'vm-uuid': 'e71ace91-8cd6-4723-8c23-58ac2e0101dc'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:54.165622 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.167647 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:54.174525 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:54.175523 np0000003818 nova-compute[98971]: INFO os_vif [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') Jun 27 02:02:54.193093 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d81b73ab-1663-4c35-aaad-3dee063e18f3 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.373s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:54.195194 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003998779998255486 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:54.195881 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:54.197219 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:54.198188 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] VM Stopped (Lifecycle Event) Jun 27 02:02:54.232507 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.869s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:54.233038 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:02:54.237005 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.085s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:54.237711 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:54.237711 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 02:02:54.323870 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:54.468350 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-changed-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:54.468545 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Refreshing instance network info cache due to event network-changed-d3c30573-faba-4d86-a21a-731096280755. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:54.468715 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] Acquiring lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:54.468830 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] Acquired lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:54.468960 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Refreshing network info cache for port d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:54.525003 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-deddacdb-31a0-41d6-983c-276411f70b05 req-21bf7f7a-9cfb-4105-9572-20041a243b5b service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Received event network-vif-unplugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:54.525296 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-deddacdb-31a0-41d6-983c-276411f70b05 req-21bf7f7a-9cfb-4105-9572-20041a243b5b service nova] Acquiring lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:54.525539 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-deddacdb-31a0-41d6-983c-276411f70b05 req-21bf7f7a-9cfb-4105-9572-20041a243b5b service nova] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:54.525613 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-deddacdb-31a0-41d6-983c-276411f70b05 req-21bf7f7a-9cfb-4105-9572-20041a243b5b service nova] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:54.525761 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-deddacdb-31a0-41d6-983c-276411f70b05 req-21bf7f7a-9cfb-4105-9572-20041a243b5b service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] No waiting events found dispatching network-vif-unplugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:54.525908 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-deddacdb-31a0-41d6-983c-276411f70b05 req-21bf7f7a-9cfb-4105-9572-20041a243b5b service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Received unexpected event network-vif-unplugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 for instance with vm_state building and task_state spawning. Jun 27 02:02:54.559074 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:54.700475 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: ad0aa6e6-31be-4a5b-b89c-152d732f755e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:54.724877 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Updating instance_info_cache with network_info: [{"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:54.741030 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:02:54.741720 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:02:54.741877 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:54.742142 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:54.846497 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59e076ee8a5642f288724654a145b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30ec721e042b98cd1456baeea0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:02:54.971207 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:54.995103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.517s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:55.080331 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:55.080502 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:55.226552 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Releasing lock "refresh_cache-24314451-30b5-4e28-a144-5dc2c9ceb1ca" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:55.226760 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Instance network_info: |[{"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:02:55.229054 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Start _get_guest_xml network_info=[{"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:02:55.234829 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:55.236301 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-829802265', uuid='24314451-30b5-4e28-a144-5dc2c9ceb1ca'), owner=OwnerMeta(userid='48172c20aca946a5b61e2dee61b95de7', username='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member', projectid='fb6450727e8a4a3dbb864e0616d363d4', projectname='tempest-ServerBootFromVolumeStableRescueTest-1593948765'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525775.2358952) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:02:55.237865 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:02:55.238284 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:02:55.239053 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:02:55.239317 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:02:55.240065 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:02:55.240363 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:02:55.240489 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:02:55.240599 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:02:55.240748 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:02:55.240862 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:02:55.240993 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:02:55.241201 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:02:55.241333 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:02:55.241457 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:02:55.241553 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:02:55.241661 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:02:55.249010 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:02:55.258251 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829802265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverbootfromvolumestablerescuetest-server-829802265',id=15,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb6450727e8a4a3dbb864e0616d363d4',ramdisk_id='',reservation_id='r-vanqy4l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:51Z,user_data=None,user_id='48172c20aca946a5b61e2dee61b95de7',uuid=24314451-30b5-4e28-a144-5dc2c9ceb1ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:55.258844 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converting VIF {"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:55.259825 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:9e:e6,bridge_name='br-int',has_traffic_filtering=True,id=46eb7bbb-8ff7-4483-9026-4b2d1de542a0,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46eb7bbb-8f') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:55.261501 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'pci_devices' on Instance uuid 24314451-30b5-4e28-a144-5dc2c9ceb1ca {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:55.279142 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:55.311669 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:55.313531 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:55.314276 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:55.314464 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:55.314724 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:55.319073 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Terminating instance Jun 27 02:02:55.380124 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:55.380561 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:55.399587 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:55.421287 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Successfully created port: bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:02:55.468850 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:55.473427 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:55.565300 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json" returned: 0 in 0.092s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:55.565945 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:55.584988 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:02:55.603624 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Updated VIF entry in instance network info cache for port d3c30573-faba-4d86-a21a-731096280755. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:02:55.604161 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Updating instance_info_cache with network_info: [{"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:55.655870 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk.rescue --force-share --output=json" returned: 0 in 0.090s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:55.656350 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:55.695094 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:55.695355 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:55.695512 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No VIF found with MAC fa:16:3e:c8:dd:54, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:02:55.696300 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Using config drive Jun 27 02:02:55.741334 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:55.741923 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:55.764942 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] End _get_guest_xml xml= Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 24314451-30b5-4e28-a144-5dc2c9ceb1ca Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: instance-0000000f Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 196608 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-server-829802265 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 2026-06-27 02:02:55 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 192 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: True Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: bare Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-1593948765 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 24314451-30b5-4e28-a144-5dc2c9ceb1ca Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 24314451-30b5-4e28-a144-5dc2c9ceb1ca Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: Jun 27 02:02:55.771195 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Preparing to wait for external event network-vif-plugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829802265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverbootfromvolumestablerescuetest-server-829802265',id=15,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb6450727e8a4a3dbb864e0616d363d4',ramdisk_id='',reservation_id='r-vanqy4l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:51Z,user_data=None,user_id='48172c20aca946a5b61e2dee61b95de7',uuid=24314451-30b5-4e28-a144-5dc2c9ceb1ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converting VIF {"id": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "address": "fa:16:3e:87:9e:e6", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap46eb7bbb-8f", "ovs_interfaceid": "46eb7bbb-8ff7-4483-9026-4b2d1de542a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:55.775497 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:9e:e6,bridge_name='br-int',has_traffic_filtering=True,id=46eb7bbb-8ff7-4483-9026-4b2d1de542a0,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46eb7bbb-8f') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:55.776652 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:9e:e6,bridge_name='br-int',has_traffic_filtering=True,id=46eb7bbb-8ff7-4483-9026-4b2d1de542a0,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46eb7bbb-8f') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:55.777599 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.778629 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:55.779024 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:55.780469 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.780469 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2546e3aa-3090-5728-a58d-4fcc3d42658f', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:55.781066 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.782180 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:55.789027 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.791906 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.792567 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46eb7bbb-8f, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:55.792567 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46eb7bbb-8f, col_values=(('qos', UUID('0e1322a3-c58b-4639-b365-161b9cf5c577')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:55.792887 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46eb7bbb-8f, col_values=(('external_ids', {'iface-id': '46eb7bbb-8ff7-4483-9026-4b2d1de542a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:9e:e6', 'vm-uuid': '24314451-30b5-4e28-a144-5dc2c9ceb1ca'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:55.794155 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.795521 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:55.808327 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.808608 np0000003818 nova-compute[98971]: INFO os_vif [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:9e:e6,bridge_name='br-int',has_traffic_filtering=True,id=46eb7bbb-8ff7-4483-9026-4b2d1de542a0,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46eb7bbb-8f') Jun 27 02:02:55.826251 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:02:55.845369 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:55.867320 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.869607 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:55.892989 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.032510 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.067207 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.085927 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.111878 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:56.112294 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:56.117267 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-98411f49-6e47-4d2d-ba9c-6aa124100972 req-e6110626-dfb5-4912-a586-6985fbd865e0 service nova] Releasing lock "refresh_cache-b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:56.118105 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Attaching volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b to /dev/vdb Jun 27 02:02:56.131838 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Successfully updated port: bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:02:56.139178 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.139898 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.184960 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.998950912999817 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:56.185677 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998068744999955 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:56.185875 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997854777999919 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:02:56.196093 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Instance destroyed successfully. Jun 27 02:02:56.197701 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Received event network-changed-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:56.197701 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Refreshing instance network info cache due to event network-changed-bb939252-1591-4573-919e-cb5eca63104b. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:02:56.198134 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] Acquiring lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:56.209289 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] Acquired lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:56.209543 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Refreshing network info cache for port bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:02:56.210860 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'resources' on Instance uuid 380fe23b-73a4-4b4f-9349-fce0f62ae5fb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:56.212554 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:56.213455 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.013s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:56.219487 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:56.228630 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:02:56.230075 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:56.231664 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Claim successful on node np0000003818 Jun 27 02:02:56.245660 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:02:56.248292 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.251819 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.294380 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.334509 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:02:56.335283 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:02:56.345248 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:02:56.346337 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe04:7956', 'fe80::50a9:bfff:fe5b:aead', 'fe80::fc16:3eff:feef:b815'] Jun 27 02:02:56.346480 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:02:56.346647 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:02:56.347354 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:56.347652 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updating existing volume attachment record: c6dc403a-b447-4659-9504-72959a588026 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:02:56.351506 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.352304 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.422427 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Creating config drive at /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk.config Jun 27 02:02:56.430023 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf7wso6qv {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.443102 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.449083 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.486260 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf7wso6qv" returned: 0 in 0.056s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.539155 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.539683 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.588748 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:56.589047 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:56.589306 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:56.589486 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:56.589648 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:56.589829 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:56.589985 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:56.590170 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] Acquiring lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:56.590412 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:56.590557 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:56.590724 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] No waiting events found dispatching network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:02:56.590944 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-95f99439-23fc-496a-ad86-4c2af69a67b4 req-d793fc0d-cc68-4b9e-a2ae-bc8c210be341 service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-unplugged-8363c61e-3b4a-44fe-be22-75f45bc63c31 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:02:56.627425 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.634911 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:02:56.725831 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:00:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-466675542',display_name='tempest-ServerRescueNegativeTestJSON-server-466675542',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-466675542',id=10,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOWcHKr2sV1pVsFqegtL35TZyjw+YDsVcv4HxAV4SjpPhm7qYGnOIWc8DKa7ZT4fCcZCCrFaeDpuMcOJQ5Rm77CW+noQsbRhgebEOm3DGhWdWFAWXw8EC+EBsVmTAHemA==',key_name='tempest-keypair-783663957',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:02Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-6z0b75xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12040f7bfd874cd086b002bc598c80d4',uuid=380fe23b-73a4-4b4f-9349-fce0f62ae5fb,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:02:56.725831 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "address": "fa:16:3e:7d:c2:bb", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8363c61e-3b", "ovs_interfaceid": "8363c61e-3b4a-44fe-be22-75f45bc63c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:56.726550 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:56.726550 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:02:56.728494 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:56.736155 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.736155 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8363c61e-3b, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:56.742292 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:56.792739 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:02:56.796481 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:02:56.797453 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Creating image(s) Jun 27 02:02:56.798574 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:56.798853 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "/opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:56.799606 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "/opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:56.800562 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:56.806274 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:56.807524 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.821539 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.827040 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.827600 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90b9d927-340e-4c2e-8ead-4836f8494dfc) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:56.831566 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.831566 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:56.843441 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:56.847049 np0000003818 nova-compute[98971]: INFO os_vif [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c2:bb,bridge_name='br-int',has_traffic_filtering=True,id=8363c61e-3b4a-44fe-be22-75f45bc63c31,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8363c61e-3b') Jun 27 02:02:56.847763 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Deleting instance files /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb_del Jun 27 02:02:56.849731 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Deletion of /opt/stack/data/nova/instances/380fe23b-73a4-4b4f-9349-fce0f62ae5fb_del complete Jun 27 02:02:56.870158 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:56.906697 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.099s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:56.907801 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:56.908050 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:56.908558 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:56.913211 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:02:56.913687 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:56.942204 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:02:56.943172 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:02:56.944514 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:56.945041 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:56.945377 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:02:56.968240 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:56.968240 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:02:56.968496 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:56.968570 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:02:56.968884 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:02:56.969041 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:02:56.983588 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:02:56.983588 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:56.993438 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:02:56.993438 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:57.001710 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b] added Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:57.006875 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:57.009933 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:02:57.009933 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:02:57.009933 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b] added Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:02:57.012616 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:02:57.023300 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.109s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.023529 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:57.042542 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.098167 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk 1073741824" returned: 0 in 0.071s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.098167 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.188s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:57.098167 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:57.153929 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.163476 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:57.196716 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.197111 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:02:57.197428 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:57.230370 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:57.286989 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.286989 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Cannot resize image /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:02:57.287517 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:02:57.287517 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Ensure instance console log exists: /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:02:57.287775 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:57.291023 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:57.291023 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:57.328660 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.345201 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:57.345465 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:02:57.345542 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No VIF found with MAC fa:16:3e:87:9e:e6, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:02:57.346427 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Using config drive Jun 27 02:02:57.349101 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.349716 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:57.398621 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Took 1.57 seconds to destroy the instance on the hypervisor. Jun 27 02:02:57.400563 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:02:57.400952 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:02:57.401303 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:02:57.402449 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:57.460611 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.462333 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.473338 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:57.475435 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:57.475435 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.522307 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:57.527283 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:57.529414 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:57.529856 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=50864MB free_disk=74.1241226196289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 02:02:57.530033 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:57.668395 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-751d4578-bfea-45ae-a1b9-8cf6758c9411 req-e16ad2e4-98e5-48fa-a6da-73d672363dad service nova] Releasing lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:57.671263 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquired lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:02:57.671263 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:02:57.857296 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:58.010196 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:02:58.013339 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:02:58.024907 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:02:58.034357 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.046450 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Creating config drive at /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk.config Jun 27 02:02:58.047591 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.054205 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe1ivwbss {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:02:58.077652 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.080496 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 27 02:02:58.080496 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:58.081038 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 27 02:02:58.081038 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:58.081390 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 27 02:02:58.081390 np0000003818 nova-compute[98971]: Jun 27 02:02:58.092930 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:02:58.092930 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:02:58.097963 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 27 02:02:58.097963 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:58.097963 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 27 02:02:58.097963 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:58.098464 np0000003818 nova-compute[98971]: WARNING os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 27 02:02:58.098464 np0000003818 nova-compute[98971]: Jun 27 02:02:58.118815 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe1ivwbss" returned: 0 in 0.065s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:02:58.128864 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.50.100,3260] Jun 27 02:02:58.128864 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.50.100,3260] successful. Jun 27 02:02:58.128864 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.140887 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.40.100,3260] Jun 27 02:02:58.140887 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.40.100,3260] successful. Jun 27 02:02:58.140887 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.148354 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.165070 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:02:58.171645 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.171645 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.171645 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:58.171866 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.171866 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.171866 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:58.172596 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:58.172776 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:02:58.180472 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.180472 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.180472 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:02:58.180645 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.180645 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:02:58.180645 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:02:58.181134 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:58.181325 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:02:58.184593 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] HCTL ('7', '-', '-', 0) found on session 35 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:02:58.184593 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:02:58.184593 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] HCTL ('8', '-', '-', 0) found on session 36 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:02:58.184593 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:02:58.200044 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:58.200318 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] VM Started (Lifecycle Event) Jun 27 02:02:58.237265 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching for a device in session 35 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:58.237265 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:02:58.237265 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching for a device in session 36 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:02:58.237265 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:02:58.287081 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:02:58.293428 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5f71def5-137b-4284-b001-4a719bcd1e76 req-a5150edf-e532-4cc5-87fd-a2382e876293 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-vif-plugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:58.293855 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-5f71def5-137b-4284-b001-4a719bcd1e76 req-a5150edf-e532-4cc5-87fd-a2382e876293 service nova] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:58.294072 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-5f71def5-137b-4284-b001-4a719bcd1e76 req-a5150edf-e532-4cc5-87fd-a2382e876293 service nova] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:58.294302 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-5f71def5-137b-4284-b001-4a719bcd1e76 req-a5150edf-e532-4cc5-87fd-a2382e876293 service nova] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:58.294465 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-5f71def5-137b-4284-b001-4a719bcd1e76 req-a5150edf-e532-4cc5-87fd-a2382e876293 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Processing event network-vif-plugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:02:58.294883 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:02:58.300788 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:02:58.305504 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Instance spawned successfully. Jun 27 02:02:58.306622 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:02:58.518492 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:58.601648 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:02:58.631361 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:58.687857 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-41cb0291-c33e-4cb9-8ac7-d3fdfe47a63e req-18157c7f-a4ab-435a-84e8-7828977957fe service nova] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Received event network-vif-deleted-8363c61e-3b4a-44fe-be22-75f45bc63c31 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:02:58.687857 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:58.704088 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:58.713000 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:02:58.725698 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:58.727048 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:58.776351 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Updating instance_info_cache with network_info: [{"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:02:58.815404 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:58.815848 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:58.816507 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:58.816618 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:58.816985 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:58.818986 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:02:58.841358 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:58.972481 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:02:59.116635 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.903s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:59.117191 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:02:59.120363 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.590s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:59.135929 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Took 1.73 seconds to deallocate network for instance. Jun 27 02:02:59.155716 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.155716 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.155716 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.180412 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.224489 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:02:59.224489 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:59.224489 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] VM Paused (Lifecycle Event) Jun 27 02:02:59.261964 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.282065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Releasing lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:02:59.282440 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Instance network_info: |[{"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:02:59.285945 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Start _get_guest_xml network_info=[{"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:02:59.299732 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:02:59.302406 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-438040440', uuid='5ba18d1c-6f32-4dd9-8d18-30492aafea37'), owner=OwnerMeta(userid='59e076ee8a5642f288724654a145b455', username='tempest-ServerActionsTestOtherA-2022980580-project-member', projectid='11a30ec721e042b98cd1456baeea0208', projectname='tempest-ServerActionsTestOtherA-2022980580'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525779.3018749) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:02:59.305796 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:02:59.306814 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:02:59.310118 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:02:59.310440 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:02:59.312336 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:02:59.312760 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:02:59.313053 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:02:59.316892 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:02:59.331672 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Took 9.67 seconds to spawn the instance on the hypervisor. Jun 27 02:02:59.331672 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:59.336859 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-438040440',display_name='tempest-ServerActionsTestOtherA-server-438040440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestothera-server-438040440',id=16,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/Myt+CM4EGXKe+iLPTumUUy+heQXzQTAzteIqJVPu8kgtVcbVlwsX1mg5o8kIG80peHpcwDSoaC4QJODgc4XvxjkVv7HiPIWDij5aVelxJiIhxRZs+oIAlboKZPmH0Sw==',key_name='tempest-keypair-1853862270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30ec721e042b98cd1456baeea0208',ramdisk_id='',reservation_id='r-bv5y5vef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2022980580',owner_user_name='tempest-ServerActionsTestOtherA-2022980580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e076ee8a5642f288724654a145b455',uuid=5ba18d1c-6f32-4dd9-8d18-30492aafea37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:02:59.337123 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converting VIF {"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:59.338175 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bb939252-1591-4573-919e-cb5eca63104b,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb939252-15') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:59.340314 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ba18d1c-6f32-4dd9-8d18-30492aafea37 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:02:59.626522 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:02:59.626522 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:02:59.626522 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:59.627250 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:02:59.644036 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:59.720778 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:02:59.736660 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:02:59.736660 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] VM Resumed (Lifecycle Event) Jun 27 02:02:59.796703 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94e5a9e97c5a4c659945037d5b76976a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d7587a1e784250a212e256570f1622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] End _get_guest_xml xml= Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 5ba18d1c-6f32-4dd9-8d18-30492aafea37 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: instance-00000010 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 196608 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherA-server-438040440 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 2026-06-27 02:02:59 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 192 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: True Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: bare Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 0 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: virtio Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherA-2022980580-project-member Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherA-2022980580 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 5ba18d1c-6f32-4dd9-8d18-30492aafea37 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 5ba18d1c-6f32-4dd9-8d18-30492aafea37 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: hvm Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 128 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: 1 Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: Jun 27 02:02:59.843074 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Preparing to wait for external event network-vif-plugged-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:02:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-438040440',display_name='tempest-ServerActionsTestOtherA-server-438040440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serveractionstestothera-server-438040440',id=16,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/Myt+CM4EGXKe+iLPTumUUy+heQXzQTAzteIqJVPu8kgtVcbVlwsX1mg5o8kIG80peHpcwDSoaC4QJODgc4XvxjkVv7HiPIWDij5aVelxJiIhxRZs+oIAlboKZPmH0Sw==',key_name='tempest-keypair-1853862270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30ec721e042b98cd1456baeea0208',ramdisk_id='',reservation_id='r-bv5y5vef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2022980580',owner_user_name='tempest-ServerActionsTestOtherA-2022980580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e076ee8a5642f288724654a145b455',uuid=5ba18d1c-6f32-4dd9-8d18-30492aafea37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converting VIF {"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bb939252-1591-4573-919e-cb5eca63104b,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb939252-15') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:02:59.845941 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bb939252-1591-4573-919e-cb5eca63104b,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb939252-15') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:02:59.847517 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.847517 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:59.847517 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:02:59.853556 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.853556 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd19d13c4-58f1-5c38-ba86-60d6f59f5bd5', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:59.854601 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Took 15.30 seconds to build instance. Jun 27 02:02:59.857930 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.857930 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:59.863674 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.863674 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb939252-15, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:59.863674 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb939252-15, col_values=(('qos', UUID('dcabc3ff-5233-4e91-b5c3-68a303c45721')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:59.863674 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb939252-15, col_values=(('external_ids', {'iface-id': 'bb939252-1591-4573-919e-cb5eca63104b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:9a:13', 'vm-uuid': '5ba18d1c-6f32-4dd9-8d18-30492aafea37'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:02:59.864165 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.865934 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:02:59.873355 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:02:59.874166 np0000003818 nova-compute[98971]: INFO os_vif [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bb939252-1591-4573-919e-cb5eca63104b,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb939252-15') Jun 27 02:02:59.987596 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Found WWN 33000000099f9e8d5 for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:02:59.988010 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:02:59.988235 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '33000000099f9e8d5', 'path': '/dev/dm-0', 'multipath_id': '33000000099f9e8d5'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:02:59.988532 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000099f9e8d5', 'path': '/dev/dm-0', 'multipath_id': '33000000099f9e8d5'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:02:59.992642 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'flavor' on Instance uuid 502e62b6-a346-41c3-917c-758e2d30274d {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:00.135068 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:03:00.238330 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:00.240543 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:00.302458 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance ea1483cd-9799-4aa0-b0c3-540d9ec1835e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.302930 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.303014 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.303084 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.303197 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 502e62b6-a346-41c3-917c-758e2d30274d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.303344 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance e71ace91-8cd6-4723-8c23-58ac2e0101dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.304634 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 24314451-30b5-4e28-a144-5dc2c9ceb1ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.304720 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 5ba18d1c-6f32-4dd9-8d18-30492aafea37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.304824 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:03:00.305045 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 02:03:00.306432 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:02:57 up 31 min, 2 users, load average: 9.91, 7.16, 3.48\n', 'num_instances': '9', 'num_vm_active': '4', 'num_task_None': '5', 'num_os_type_None': '9', 'num_proj_d6a76767ddc64ede879746f16624d287': '3', 'io_workload': '4', 'num_vm_rescued': '1', 'num_task_deleting': '1', 'num_proj_0bb5b970bc7a4e3cb52f7a98dff98715': '2', 'num_vm_building': '4', 'num_task_spawning': '3', 'num_proj_9df8f123bc7c456c8acd8f2c8eb3897b': '1', 'num_proj_fb6450727e8a4a3dbb864e0616d363d4': '1', 'num_proj_11a30ec721e042b98cd1456baeea0208': '1', 'num_proj_83d7587a1e784250a212e256570f1622': '1'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 02:03:00.358812 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-dac1222e-3a02-4bb3-91d0-323ffa4206a8 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.810s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:00.447574 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0d371109-234b-4a20-b272-87af9b77592b req-e42a47dd-5890-45f4-8eb5-4e5b41345b3d service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-vif-plugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:00.448073 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0d371109-234b-4a20-b272-87af9b77592b req-e42a47dd-5890-45f4-8eb5-4e5b41345b3d service nova] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:00.448073 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0d371109-234b-4a20-b272-87af9b77592b req-e42a47dd-5890-45f4-8eb5-4e5b41345b3d service nova] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:00.448230 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-0d371109-234b-4a20-b272-87af9b77592b req-e42a47dd-5890-45f4-8eb5-4e5b41345b3d service nova] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:00.448562 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-0d371109-234b-4a20-b272-87af9b77592b req-e42a47dd-5890-45f4-8eb5-4e5b41345b3d service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] No waiting events found dispatching network-vif-plugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:00.448677 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-0d371109-234b-4a20-b272-87af9b77592b req-e42a47dd-5890-45f4-8eb5-4e5b41345b3d service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received unexpected event network-vif-plugged-21ce8e42-2991-4b03-b851-02161a45c5e5 for instance with vm_state active and task_state None. Jun 27 02:03:00.495867 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Attempting to attach volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] attach device xml: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: Jun 27 02:03:00.501573 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:03:00.641409 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:03:00.721533 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Successfully created port: f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:00.743196 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:00.746043 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] VM Started (Lifecycle Event) Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Received event network-vif-plugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] Acquiring lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Processing event network-vif-plugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Received event network-vif-plugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] Acquiring lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:00.784845 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:00.789899 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] No waiting events found dispatching network-vif-plugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:00.790880 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-b4f6dbd8-318d-4980-8142-45b06c3adba8 req-d87287d0-2b42-48ef-9a06-76aa9f9f2df2 service nova] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Received unexpected event network-vif-plugged-46eb7bbb-8ff7-4483-9026-4b2d1de542a0 for instance with vm_state building and task_state spawning. Jun 27 02:03:00.790880 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:03:00.794656 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:03:00.797587 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Instance spawned successfully. Jun 27 02:03:00.798166 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:03:00.962298 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:00.962298 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:01.249806 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:01.250545 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:01.315895 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:01.315895 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:01.315895 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:01.315895 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:01.315895 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:01.315895 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:01.411374 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:01.411517 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:01.411633 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] No VIF found with MAC fa:16:3e:0f:9a:13, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:01.412477 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Using config drive Jun 27 02:03:01.465732 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:01.634280 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Successfully updated port: f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:01.653882 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:03:01.655081 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:03:01.655523 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Creating image(s) Jun 27 02:03:01.655962 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "/opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:01.656115 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "/opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:01.656609 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "/opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:01.657341 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:01.661680 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:01.664836 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:01.713960 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-changed-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:01.716565 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Refreshing instance network info cache due to event network-changed-f579f943-1d22-4d13-8bbf-48081110ed26. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:01.716808 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] Acquiring lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:01.716915 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] Acquired lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:01.717007 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Refreshing network info cache for port f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:01.758934 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:03:01.760273 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:01.760273 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] VM Paused (Lifecycle Event) Jun 27 02:03:01.776066 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.109s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:01.781801 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:01.782928 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:01.784045 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:01.789006 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:01.789580 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:01.832764 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Took 9.62 seconds to spawn the instance on the hypervisor. Jun 27 02:03:01.833266 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:01.921933 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:01.926753 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.137s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:01.927304 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:01.976343 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 02:03:01.976343 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.856s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:01.976343 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.332s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:01.977195 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:03:01.993309 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk 1073741824" returned: 0 in 0.066s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:01.994074 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.212s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:01.994074 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:02.103989 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.110s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:02.107358 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:03:02.107358 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:02.140914 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:02.150480 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Creating config drive at /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk.config Jun 27 02:03:02.161883 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp57er9rjr {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:02.206142 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:02.206673 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Cannot resize image /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:03:02.207090 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:03:02.207319 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Ensure instance console log exists: /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:03:02.207732 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:02.207946 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:02.208094 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:02.230253 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:02.235408 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:02.235558 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:02.235695 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:02.235862 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No VIF found with MAC fa:16:3e:ef:b8:15, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:02.238691 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp57er9rjr" returned: 0 in 0.077s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:02.292935 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:02.295724 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:02.296774 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] VM Resumed (Lifecycle Event) Jun 27 02:03:02.331847 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:02.351374 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Took 17.75 seconds to build instance. Jun 27 02:03:02.399992 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:02.657924 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:02.709576 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:02.709836 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:02.735833 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:02.766402 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:02.804572 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:02.812608 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:02.855476 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "24314451-30b5-4e28-a144-5dc2c9ceb1ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.271s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:02.879355 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-changed-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:02.879488 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Refreshing instance network info cache due to event network-changed-21ce8e42-2991-4b03-b851-02161a45c5e5. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:02.879665 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] Acquiring lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:02.879767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] Acquired lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:02.879888 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Refreshing network info cache for port 21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:02.885539 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:02.975875 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:02.976297 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:02.976743 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:02.977003 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:02.977300 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:02.977486 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:02.977602 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 02:03:02.980344 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.66 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:03:03.160457 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e067bf1c-4197-471c-9b39-708650e10186 req-57f9d453-0105-4e6a-ab6e-f6311a9db83d service nova] Releasing lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:03.161365 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquired lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:03.161522 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:03.185121 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:03.192815 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:03.213879 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:03.222150 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:03.387604 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:03.666137 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:03.668241 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:03.727536 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.751s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:03.830189 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:03.845990 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:03.862052 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Deleted allocations for instance 380fe23b-73a4-4b4f-9349-fce0f62ae5fb Jun 27 02:03:03.897882 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-10e45b9c-7781-44a7-973b-1d3e7e661afe tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.786s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:04.041327 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:04.130586 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Updated VIF entry in instance network info cache for port 21ce8e42-2991-4b03-b851-02161a45c5e5. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:03:04.130845 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Updating instance_info_cache with network_info: [{"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:04.174259 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'flavor' on Instance uuid b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:04.226246 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updating instance_info_cache with network_info: [{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:04.227622 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:04.228432 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] VM Started (Lifecycle Event) Jun 27 02:03:04.465232 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:04.465718 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:04.632896 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-229b2913-78eb-4df8-850c-a8f17f61557a req-ec35ac15-aee5-42f4-8811-4e2df5bdecab service nova] Releasing lock "refresh_cache-e71ace91-8cd6-4723-8c23-58ac2e0101dc" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:04.728911 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Releasing lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:04.729350 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Instance network_info: |[{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:03:04.732343 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Start _get_guest_xml network_info=[{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:03:04.732699 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:04.737993 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:03:04.737993 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1941528237', uuid='07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed'), owner=OwnerMeta(userid='94e5a9e97c5a4c659945037d5b76976a', username='tempest-TaggedAttachmentsTest-1290144613-project-member', projectid='83d7587a1e784250a212e256570f1622', projectname='tempest-TaggedAttachmentsTest-1290144613'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525784.7366781) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:03:04.738865 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:03:04.739536 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:04.739754 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] VM Paused (Lifecycle Event) Jun 27 02:03:04.744448 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:03:04.746567 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:03:04.746803 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:03:04.750352 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:03:04.760749 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:03:04.760749 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:03:04.760749 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:03:04.777103 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941528237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1941528237',id=17,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkk4dOZVr0+BM/0KtiDI6oSfuPXm6h98+GtKifjjg2AZMju3/O9U4l3soWxnLKttK1cYfyvIg1QjrPmuFx8pjgqWwRPddThD60rOsZ1BMJK0QAJ+8IQ5v38e4beY0VUYg==',key_name='tempest-keypair-698885557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83d7587a1e784250a212e256570f1622',ramdisk_id='',reservation_id='r-esxvfb7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1290144613',owner_user_name='tempest-TaggedAttachmentsTest-1290144613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94e5a9e97c5a4c659945037d5b76976a',uuid=07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:03:04.777103 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converting VIF {"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:04.777386 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:71:dd,bridge_name='br-int',has_traffic_filtering=True,id=f579f943-1d22-4d13-8bbf-48081110ed26,network=Network(adc23d27-59ec-4784-a58d-f239e38d9ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf579f943-1d') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:04.778537 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'pci_devices' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:04.865053 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:04.869269 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-955b274e-fbe5-428e-942f-c2cb51376aa5 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "380fe23b-73a4-4b4f-9349-fce0f62ae5fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.556s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:04.963759 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Received event network-vif-plugged-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:04.967083 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] Acquiring lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:04.967083 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:04.967083 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:04.967083 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Processing event network-vif-plugged-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:03:04.967083 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Received event network-vif-plugged-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:04.971035 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] Acquiring lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:04.971035 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:04.972186 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:04.972186 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] No waiting events found dispatching network-vif-plugged-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:04.972186 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-fcb92140-bf6b-437e-8e27-5ae4a2c0086a req-138a9b26-01fc-4540-8d50-fc4daafde59e service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Received unexpected event network-vif-plugged-bb939252-1591-4573-919e-cb5eca63104b for instance with vm_state building and task_state spawning. Jun 27 02:03:04.972883 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:03:04.979947 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:03:04.985065 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:03:04.987765 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Instance spawned successfully. Jun 27 02:03:04.988219 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:03:05.060115 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:05.182458 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:05.243808 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:05.247086 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:05.247234 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] VM Resumed (Lifecycle Event) Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] End _get_guest_xml xml= Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: instance-00000011 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 196608 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: tempest-device-tagging-server-1941528237 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 2026-06-27 02:03:04 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 192 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: True Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: bare Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: tempest-TaggedAttachmentsTest-1290144613-project-member Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: tempest-TaggedAttachmentsTest-1290144613 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: hvm Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 128 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: Jun 27 02:03:05.280528 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:03:05.282878 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Preparing to wait for external event network-vif-plugged-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:03:05.282878 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:05.282878 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:05.282878 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:05.282878 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941528237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1941528237',id=17,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkk4dOZVr0+BM/0KtiDI6oSfuPXm6h98+GtKifjjg2AZMju3/O9U4l3soWxnLKttK1cYfyvIg1QjrPmuFx8pjgqWwRPddThD60rOsZ1BMJK0QAJ+8IQ5v38e4beY0VUYg==',key_name='tempest-keypair-698885557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83d7587a1e784250a212e256570f1622',ramdisk_id='',reservation_id='r-esxvfb7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1290144613',owner_user_name='tempest-TaggedAttachmentsTest-1290144613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94e5a9e97c5a4c659945037d5b76976a',uuid=07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:03:05.282878 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converting VIF {"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:71:dd,bridge_name='br-int',has_traffic_filtering=True,id=f579f943-1d22-4d13-8bbf-48081110ed26,network=Network(adc23d27-59ec-4784-a58d-f239e38d9ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf579f943-1d') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:71:dd,bridge_name='br-int',has_traffic_filtering=True,id=f579f943-1d22-4d13-8bbf-48081110ed26,network=Network(adc23d27-59ec-4784-a58d-f239e38d9ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf579f943-1d') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68371c85-211a-5fbb-a1fc-373d3dae6a6e', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:05.287466 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.287946 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:05.287946 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.289983 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.290107 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf579f943-1d, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:05.292257 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf579f943-1d, col_values=(('qos', UUID('e7b494d5-2b52-453c-a2a2-0cd332e195c5')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:05.292257 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf579f943-1d, col_values=(('external_ids', {'iface-id': 'f579f943-1d22-4d13-8bbf-48081110ed26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:71:dd', 'vm-uuid': '07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:05.292448 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.293537 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:05.298845 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:05.300033 np0000003818 nova-compute[98971]: INFO os_vif [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:71:dd,bridge_name='br-int',has_traffic_filtering=True,id=f579f943-1d22-4d13-8bbf-48081110ed26,network=Network(adc23d27-59ec-4784-a58d-f239e38d9ad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf579f943-1d') Jun 27 02:03:05.493064 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:05.493534 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:05.493534 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:05.493669 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:05.493938 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:05.494224 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:05.548103 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:05.551656 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:05.551656 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:03:05.551656 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Claim successful on node np0000003818 Jun 27 02:03:05.569862 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] instance snapshotting Jun 27 02:03:05.680399 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Beginning live snapshot process Jun 27 02:03:05.750469 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:05.751872 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:05.999254 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Took 9.21 seconds to spawn the instance on the hypervisor. Jun 27 02:03:05.999420 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:06.254896 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:03:06.284820 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:06.286819 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:06.286819 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Attaching volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b to /dev/vdb Jun 27 02:03:06.356747 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:06.368174 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:03:06.396334 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:06.436516 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:03:06.436814 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:03:06.448761 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:03:06.450843 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe6f:6ae0', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe04:7956', 'fe80::50a9:bfff:fe5b:aead', 'fe80::fc16:3eff:feef:b815', 'fe80::fc16:3eff:fec8:dd54', 'fe80::b05b:b3ff:feb5:fb37', 'fe80::fc16:3eff:fe87:9ee6', 'fe80::b8bb:79ff:fef8:7cc8', 'fe80::fc16:3eff:fe0f:9a13', 'fe80::3c5f:2aff:fe42:e4a2'] Jun 27 02:03:06.451001 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:03:06.451001 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:03:06.453926 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:06.454201 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Updating existing volume attachment record: 3c111106-5557-4a89-bccf-f8447aee20a6 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:03:06.516593 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Took 15.27 seconds to build instance. Jun 27 02:03:06.840938 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:06.856627 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:06.856627 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No VIF found with MAC fa:16:3e:75:71:dd, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:06.856627 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Using config drive Jun 27 02:03:07.017687 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-820b52cc-a4d2-4c5e-83c6-5037c9f14a4f tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "5ba18d1c-6f32-4dd9-8d18-30492aafea37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.782s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:07.074876 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:03:07.075555 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:07.075726 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:07.076236 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:07.076540 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:03:07.091415 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:07.091936 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:07.092212 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:07.093073 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:07.093757 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:07.094063 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.startup = automatic Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.scan = manual Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:07.105607 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.startup = automatic Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.scan = manual Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:07.118090 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:07.122100 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:07.127548 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:07.136850 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.136850 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.136850 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:07.137154 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.137154 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.137154 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:07.137609 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:07.137609 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:07.138273 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] HCTL ('8', '0', '0', 0) found on session 36 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:07.138442 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:07.149257 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:07.151709 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:07.151709 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:07.153228 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching for a device in session 36 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:07.154268 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] HCTL ('7', '0', '0', 0) found on session 35 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:07.154706 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:07.155242 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:07.165130 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Searching for a device in session 35 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:07.165320 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:07.206997 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json -f qcow2 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:07.313892 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json -f qcow2" returned: 0 in 0.106s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:07.313892 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json -f qcow2 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:07.338410 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:07.352542 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:07.401688 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:07.404998 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:07.409064 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:07.409756 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:07.479767 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Received event network-changed-bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:07.479943 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Refreshing instance network info cache due to event network-changed-bb939252-1591-4573-919e-cb5eca63104b. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:07.480298 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] Acquiring lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:07.480402 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] Acquired lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:07.480588 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Refreshing network info cache for port bb939252-1591-4573-919e-cb5eca63104b {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:07.504346 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Creating config drive at /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk.config Jun 27 02:03:07.505249 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.095s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:07.505916 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxcd0egwc/6f808d5b842b450ea9df6ceb9b0ff5b2.delta 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:07.525235 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr_om2j9s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:07.551824 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxcd0egwc/6f808d5b842b450ea9df6ceb9b0ff5b2.delta 1073741824" returned: 0 in 0.045s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:07.554005 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Quiescing instance not available: QEMU guest agent is not enabled. Jun 27 02:03:07.584517 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr_om2j9s" returned: 0 in 0.060s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:07.654073 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:07.818013 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 27 02:03:07.820351 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 27 02:03:07.985576 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:08.080362 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 02:03:08.080362 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxcd0egwc/6f808d5b842b450ea9df6ceb9b0ff5b2.delta /opt/stack/data/nova/instances/snapshots/tmpxcd0egwc/6f808d5b842b450ea9df6ceb9b0ff5b2 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:08.113193 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:03:08.166936 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.618s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:08.167341 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:03:08.235273 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxcd0egwc/6f808d5b842b450ea9df6ceb9b0ff5b2.delta /opt/stack/data/nova/instances/snapshots/tmpxcd0egwc/6f808d5b842b450ea9df6ceb9b0ff5b2" returned: 0 in 0.154s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:08.235273 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Snapshot extracted, beginning image upload Jun 27 02:03:08.264320 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:08.264562 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:08.264819 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:08.265004 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:08.265180 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:08.268931 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Terminating instance Jun 27 02:03:08.350540 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.396851 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.459713 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:08.482258 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.678623 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-df698521-47f9-4bca-bfb2-f3120a9dd91d req-596da1b8-9168-4a29-b186-4cd577030d41 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-vif-plugged-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:08.679067 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df698521-47f9-4bca-bfb2-f3120a9dd91d req-596da1b8-9168-4a29-b186-4cd577030d41 service nova] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:08.679209 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df698521-47f9-4bca-bfb2-f3120a9dd91d req-596da1b8-9168-4a29-b186-4cd577030d41 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:08.681314 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:03:08.682506 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-df698521-47f9-4bca-bfb2-f3120a9dd91d req-596da1b8-9168-4a29-b186-4cd577030d41 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:08.685145 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:03:08.685145 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-df698521-47f9-4bca-bfb2-f3120a9dd91d req-596da1b8-9168-4a29-b186-4cd577030d41 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Processing event network-vif-plugged-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:03:08.685145 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:08.685365 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:08.749526 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Updated VIF entry in instance network info cache for port bb939252-1591-4573-919e-cb5eca63104b. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:03:08.749964 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] [instance: 5ba18d1c-6f32-4dd9-8d18-30492aafea37] Updating instance_info_cache with network_info: [{"id": "bb939252-1591-4573-919e-cb5eca63104b", "address": "fa:16:3e:0f:9a:13", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb939252-15", "ovs_interfaceid": "bb939252-1591-4573-919e-cb5eca63104b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:08.771537 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:03:08.800261 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e2709eb59eb45f88196956b2298d596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5794cf82ab843adab5363e39a368501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:03:08.801891 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.810815 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.821644 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.830834 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.837638 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.845270 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.874592 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:08.884327 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.131530 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999427868000112 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:09.132674 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Found WWN 33000000099f9e8d5 for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:03:09.133746 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.057s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:09.133843 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] <== connect_volume: return (2058ms) {'type': 'block', 'scsi_wwn': '33000000099f9e8d5', 'path': '/dev/dm-0', 'multipath_id': '33000000099f9e8d5'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:09.134448 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000099f9e8d5', 'path': '/dev/dm-0', 'multipath_id': '33000000099f9e8d5'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:03:09.141587 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Instance destroyed successfully. Jun 27 02:03:09.141587 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'flavor' on Instance uuid b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:09.144008 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'resources' on Instance uuid 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:09.183509 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:03:09.208786 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.217763 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.254511 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-aa08c2de-0221-40a9-bb5b-dfdfc31ca125 req-a0db7de7-bb45-47cf-98cb-f2d3f3f3636c service nova] Releasing lock "refresh_cache-5ba18d1c-6f32-4dd9-8d18-30492aafea37" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:09.274599 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.524952 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Successfully created port: d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:09.576446 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:09.576618 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] VM Started (Lifecycle Event) Jun 27 02:03:09.578865 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:03:09.581523 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:03:09.584369 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Instance spawned successfully. Jun 27 02:03:09.584847 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:03:09.656440 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Attempting to attach volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] attach device xml: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: Jun 27 02:03:09.659818 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:03:09.669721 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1976442498',display_name='tempest-ServerRescueNegativeTestJSON-server-1976442498',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-1976442498',id=3,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:00:15Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-boe1ivgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:16Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=2a3c8563-52c1-48ac-b1e5-2a3ba54f4770,vcpu_model=,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:03:09.669721 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "63f73704-ae6b-45ab-bb38-54a802124fc0", "address": "fa:16:3e:6f:6a:e0", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f73704-ae", "ovs_interfaceid": "63f73704-ae6b-45ab-bb38-54a802124fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:09.670032 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:09.670209 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:03:09.673516 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.673937 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63f73704-ae, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:09.675775 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.676617 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:09.678433 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.679305 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.680612 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c29903f9-2f37-411a-8eef-e96b60bcba7f) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:09.681863 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.681863 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:09.682752 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:09.685631 np0000003818 nova-compute[98971]: INFO os_vif [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:6a:e0,bridge_name='br-int',has_traffic_filtering=True,id=63f73704-ae6b-45ab-bb38-54a802124fc0,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f73704-ae') Jun 27 02:03:09.686169 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Deleting instance files /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770_del Jun 27 02:03:09.688049 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:03:09.693447 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Deletion of /opt/stack/data/nova/instances/2a3c8563-52c1-48ac-b1e5-2a3ba54f4770_del complete Jun 27 02:03:10.079455 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:10.082002 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:10.092242 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:10.092242 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:10.092242 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:10.092784 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:10.092784 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:10.093287 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:10.200524 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Booting with volume 817d2aee-0075-45e7-aa8d-1ebda3fc52dd at /dev/vda Jun 27 02:03:10.204547 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Took 1.43 seconds to destroy the instance on the hypervisor. Jun 27 02:03:10.205566 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:03:10.207054 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:03:10.207238 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:03:10.207546 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:10.290396 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:10.305033 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:03:10.315855 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:10.341591 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:10.391619 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:03:10.392876 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:03:10.406020 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:03:10.408560 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::a0ff:e7ff:fe14:8735', 'fe80::fc16:3eff:fe93:71b7', 'fe80::fc16:3eff:fe04:7956', 'fe80::50a9:bfff:fe5b:aead', 'fe80::fc16:3eff:feef:b815', 'fe80::fc16:3eff:fec8:dd54', 'fe80::b05b:b3ff:feb5:fb37', 'fe80::fc16:3eff:fe87:9ee6', 'fe80::b8bb:79ff:fef8:7cc8', 'fe80::fc16:3eff:fe0f:9a13', 'fe80::3c5f:2aff:fe42:e4a2', 'fe80::fc16:3eff:fe75:71dd', 'fe80::c13:9cff:febe:6408'] Jun 27 02:03:10.408560 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:03:10.408560 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:03:10.409150 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:10.409768 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Updating existing volume attachment record: b6aa8580-b896-4729-805c-a68d1fac9dee {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:03:10.418525 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Successfully updated port: d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:10.585888 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:03:10.586204 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:10.586390 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] VM Paused (Lifecycle Event) Jun 27 02:03:10.604793 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Took 8.95 seconds to spawn the instance on the hypervisor. Jun 27 02:03:10.604793 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:10.770667 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-vif-plugged-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:10.771013 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:10.771102 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:10.771232 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:10.771365 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] No waiting events found dispatching network-vif-plugged-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:10.771559 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received unexpected event network-vif-plugged-f579f943-1d22-4d13-8bbf-48081110ed26 for instance with vm_state active and task_state None. Jun 27 02:03:10.771559 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:10.771713 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:10.771879 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:10.771988 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:10.772413 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:10.772532 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:10.772631 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:10.772748 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Acquiring lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:10.772862 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:10.772964 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:10.773116 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] No waiting events found dispatching network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:10.773335 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-unplugged-63f73704-ae6b-45ab-bb38-54a802124fc0 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:10.773469 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Received event network-changed-d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:10.773556 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Refreshing instance network info cache due to event network-changed-d078f7f6-7893-4f9a-a3f0-9e468c77c312. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:10.773836 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Acquiring lock "refresh_cache-b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:10.773919 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Acquired lock "refresh_cache-b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:10.774042 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Refreshing network info cache for port d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:10.778236 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-06eb5668-3b0a-44c8-beb2-821d687b436d req-636e65e3-8217-4ee5-b165-49e0b71519a5 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Received event network-vif-deleted-63f73704-ae6b-45ab-bb38-54a802124fc0 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:10.778407 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-06eb5668-3b0a-44c8-beb2-821d687b436d req-636e65e3-8217-4ee5-b165-49e0b71519a5 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Neutron deleted interface 63f73704-ae6b-45ab-bb38-54a802124fc0; detaching it from the instance and deleting it from the info cache Jun 27 02:03:10.782294 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-06eb5668-3b0a-44c8-beb2-821d687b436d req-636e65e3-8217-4ee5-b165-49e0b71519a5 service nova] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Detach interface failed, port_id=63f73704-ae6b-45ab-bb38-54a802124fc0, reason: Instance 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:03:10.923068 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "refresh_cache-b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:11.089352 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:11.094430 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:11.094598 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] VM Resumed (Lifecycle Event) Jun 27 02:03:11.122297 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Took 15.01 seconds to build instance. Jun 27 02:03:11.184217 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005031800001233933 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:11.184666 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:11.184749 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:11.184866 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.946026214000085 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:11.184937 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.945943039000213 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:11.187562 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] VM Stopped (Lifecycle Event) Jun 27 02:03:11.208287 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:11.277624 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:11.384399 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:11.390611 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:11.390741 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:11.390885 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:11.391032 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] No VIF found with MAC fa:16:3e:04:79:56, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:11.393912 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Snapshot image upload complete Jun 27 02:03:11.394281 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-95d8940f-272d-4085-859f-2becbdb7dd63 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 24314451-30b5-4e28-a144-5dc2c9ceb1ca] Took 5.82 seconds to snapshot the instance on the hypervisor. Jun 27 02:03:11.599881 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:11.604594 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:11.608336 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:11.627612 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d49d09db-68d3-453a-821a-6d9a34e7f699 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.547s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:11.691529 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-41e7ee9f-62c5-41ca-8111-4229892461e8 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 380fe23b-73a4-4b4f-9349-fce0f62ae5fb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:11.711124 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Took 1.50 seconds to deallocate network for instance. Jun 27 02:03:12.106620 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c740e70d-007b-4f7e-9569-bfab432519ff req-d0e9e629-a460-4678-9906-8b31fcbb3259 service nova] Releasing lock "refresh_cache-b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:12.107552 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquired lock "refresh_cache-b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:12.107804 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:12.224048 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:12.224048 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:12.340993 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:12.595578 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:03:12.597255 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:03:12.602690 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Creating image(s) Jun 27 02:03:12.602690 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Did not create local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 27 02:03:12.602690 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Ensure instance console log exists: /opt/stack/data/nova/instances/b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:03:12.602690 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:12.602690 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:12.602690 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:12.703440 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:12.761779 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:12.762101 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:12.861433 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-changed-f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:12.861954 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Refreshing instance network info cache due to event network-changed-f579f943-1d22-4d13-8bbf-48081110ed26. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:12.862757 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] Acquiring lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:12.862757 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] Acquired lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:12.862757 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Refreshing network info cache for port f579f943-1d22-4d13-8bbf-48081110ed26 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:12.944250 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:13.030490 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-94fb2540-24ef-462a-931b-f85ff7bbbf57 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.745s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:13.171625 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Updating instance_info_cache with network_info: [{"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:13.267046 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:13.366619 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:13.674045 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Releasing lock "refresh_cache-b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:13.674560 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Instance network_info: |[{"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:03:13.676854 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Start _get_guest_xml network_info=[{"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb', 'attached_at': '', 'detached_at': '', 'volume_id': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'serial': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'multiattach': True}, 'attachment_id': 'b6aa8580-b896-4729-805c-a68d1fac9dee', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:03:13.681252 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:03:13.684149 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-406449165', uuid='b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb'), owner=OwnerMeta(userid='5e2709eb59eb45f88196956b2298d596', username='tempest-AttachVolumeMultiAttachTest-1200701507-project-member', projectid='a5794cf82ab843adab5363e39a368501', projectname='tempest-AttachVolumeMultiAttachTest-1200701507'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525793.6828384) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:03:13.688391 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:03:13.688391 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:03:13.690817 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:03:13.690817 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:03:13.692722 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:03:13.693056 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:03:13.693392 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:03:13.693497 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:03:13.694357 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:03:13.694357 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:03:13.694728 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:03:13.694941 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:03:13.695592 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:03:13.695592 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:03:13.695592 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:03:13.695592 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:03:13.720962 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:03:13.721393 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:13.721583 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:13.722256 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:13.722569 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:03:13.760635 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:13.763710 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:03:13.763710 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd] added Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:13.774562 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:13.774860 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:03:13.775197 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:03:13.775506 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:03:13.777063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.553s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd] added Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:13.787636 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:13.787949 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:03:13.788109 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0476(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:03:13.788466 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:03:13.876898 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:13.929731 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Deleted allocations for instance 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770 Jun 27 02:03:13.975612 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:13.976422 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:14.075157 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updated VIF entry in instance network info cache for port f579f943-1d22-4d13-8bbf-48081110ed26. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:03:14.075775 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updating instance_info_cache with network_info: [{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:14.479900 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Detaching volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:14.546090 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Attempting to driver detach volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b from mountpoint /dev/vdb Jun 27 02:03:14.549495 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Found disk vdb by alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:03:14.550501 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Found disk vdb by alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:03:14.550634 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Attempting to detach device vdb from instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] detach device xml: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]:
Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: Jun 27 02:03:14.558573 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:03:14.572223 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully detached device vdb from instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c from the persistent domain config. Jun 27 02:03:14.572348 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] (1/8): Attempting to detach device vdb with device alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b from instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] detach device xml: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]:
Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: Jun 27 02:03:14.572631 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:03:14.578453 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7818ff52-f9ae-4906-bbb0-0ac52867855c req-e3ba1e0a-4bd3-49a7-8086-856c65d62a11 service nova] Releasing lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:14.681335 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:14.732357 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:14.732557 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:14.776794 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:14.789234 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.791724 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:14.804908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:14.807530 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.820724 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.820724 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.820724 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:14.821420 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.821420 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.821420 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:14.822934 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.845999 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.845999 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.845999 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:14.845999 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.845999 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.845999 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:14.863428 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd, portal: 192.168.40.100,3260] Jun 27 02:03:14.863428 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd, portal: 192.168.40.100,3260] successful. Jun 27 02:03:14.863428 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.878182 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.879600 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd, portal: 192.168.50.100,3260] Jun 27 02:03:14.879600 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd, portal: 192.168.50.100,3260] successful. Jun 27 02:03:14.879600 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.900355 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.900355 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.900355 np0000003818 nova-compute[98971]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.900355 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.900355 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:14.901205 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.901205 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.901205 np0000003818 nova-compute[98971]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.901205 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.901205 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:14.902290 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:14.903534 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:14.903879 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:14.904777 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:14.904927 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:14.922582 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:14.923644 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:14.923644 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:14.923894 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] HCTL ('10', '-', '-', 0) found on session 38 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:14.924545 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:14.937952 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:14.939893 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-b1c782d2-b6ee-41e8-b5a3-364c971b92f1 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "2a3c8563-52c1-48ac-b1e5-2a3ba54f4770" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.675s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:14.951370 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:15.166790 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:03:15.235742 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:03:15.259196 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:03:15.259582 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b for instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:03:15.268634 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully detached device vdb from instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c from the live domain config. Jun 27 02:03:15.805672 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:15.806202 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:15.809360 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:03:15.811465 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Claim successful on node np0000003818 Jun 27 02:03:15.823889 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Detected multiple connections on this host for volume: 7287b79f-a4fd-49f3-ad04-917cf6a7096b, skipping target disconnect. Jun 27 02:03:15.933536 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:15.933809 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:15.949731 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:15.950050 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '817d2aee-0075-45e7-aa8d-1ebda3fc52dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:15.957265 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:15.957603 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:15.958414 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:15.958414 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:15.959231 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:15.961314 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Terminating instance Jun 27 02:03:16.411180 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'flavor' on Instance uuid b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:16.466077 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:03:16.496261 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:16.502700 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:16.525229 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:16.538592 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:16.566308 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:16.697237 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-926dda7e-7e87-49a5-b7bc-282b89ee1b9e req-5d2e832b-f745-4eab-86f6-faa5965e1936 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:16.697237 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-926dda7e-7e87-49a5-b7bc-282b89ee1b9e req-5d2e832b-f745-4eab-86f6-faa5965e1936 service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:16.697237 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-926dda7e-7e87-49a5-b7bc-282b89ee1b9e req-5d2e832b-f745-4eab-86f6-faa5965e1936 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:16.697237 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-926dda7e-7e87-49a5-b7bc-282b89ee1b9e req-5d2e832b-f745-4eab-86f6-faa5965e1936 service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:16.697237 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-926dda7e-7e87-49a5-b7bc-282b89ee1b9e req-5d2e832b-f745-4eab-86f6-faa5965e1936 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:16.697237 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-926dda7e-7e87-49a5-b7bc-282b89ee1b9e req-5d2e832b-f745-4eab-86f6-faa5965e1936 service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:16.741248 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:03:16.806310 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999641655000005 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:16.808021 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Instance destroyed successfully. Jun 27 02:03:16.808892 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lazy-loading 'resources' on Instance uuid ea1483cd-9799-4aa0-b0c3-540d9ec1835e {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:17.313061 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T01:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-593188503',display_name='tempest-ServerRescueNegativeTestJSON-server-593188503',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverrescuenegativetestjson-server-593188503',id=2,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:00:31Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d6a76767ddc64ede879746f16624d287',ramdisk_id='',reservation_id='r-9mul9jc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-438392507',owner_user_name='tempest-ServerRescueNegativeTestJSON-438392507-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:00:37Z,user_data=None,user_id='12040f7bfd874cd086b002bc598c80d4',uuid=ea1483cd-9799-4aa0-b0c3-540d9ec1835e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:03:17.313322 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converting VIF {"id": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "address": "fa:16:3e:93:71:b7", "network": {"id": "4a79ca00-7fe1-41a1-b88b-92021cd61782", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-522947109-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d6a76767ddc64ede879746f16624d287", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd873a2d1-0f", "ovs_interfaceid": "d873a2d1-0f5a-4dc4-96df-c2cdf7c82151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:17.314312 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:17.319814 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:03:17.319814 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:17.321272 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd873a2d1-0f, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:17.323296 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:17.325177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:17.326202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:17.326381 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1f212ae-4a7f-48c0-b84b-d1fae577d033) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:17.340269 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:17.341027 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:17.341441 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:17.344596 np0000003818 nova-compute[98971]: INFO os_vif [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:71:b7,bridge_name='br-int',has_traffic_filtering=True,id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151,network=Network(4a79ca00-7fe1-41a1-b88b-92021cd61782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd873a2d1-0f') Jun 27 02:03:17.344987 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Deleting instance files /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e_del Jun 27 02:03:17.345941 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Deletion of /opt/stack/data/nova/instances/ea1483cd-9799-4aa0-b0c3-540d9ec1835e_del complete Jun 27 02:03:17.425252 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7c6e3a77-ff3e-4423-a2f4-e253ca131dd7 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.449s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:17.507659 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:17.507859 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:17.757403 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Found WWN 330000000859c6356 for multipath device dm-1 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:03:17.757607 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.036s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:17.757816 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] <== connect_volume: return (4036ms) {'type': 'block', 'scsi_wwn': '330000000859c6356', 'path': '/dev/dm-1', 'multipath_id': '330000000859c6356'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:17.757987 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000859c6356', 'path': '/dev/dm-1', 'multipath_id': '330000000859c6356'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:03:17.851887 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Took 1.39 seconds to destroy the instance on the hypervisor. Jun 27 02:03:17.853254 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:03:17.853554 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:03:17.853672 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:03:17.853892 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:17.988820 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:18.010508 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:18.264044 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-406449165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-attachvolumemultiattachtest-server-406449165',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5794cf82ab843adab5363e39a368501',ramdisk_id='',reservation_id='r-rx863he8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1200701507',owner_user_name='tempest-AttachVolumeMultiAttachTest-1200701507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:10Z,user_data=None,user_id='5e2709eb59eb45f88196956b2298d596',uuid=b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:03:18.264323 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converting VIF {"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:18.271454 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=d078f7f6-7893-4f9a-a3f0-9e468c77c312,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd078f7f6-78') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:18.271454 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lazy-loading 'pci_devices' on Instance uuid b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:18.493582 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:18.493850 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:18.519183 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.713s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:18.519645 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] End _get_guest_xml xml= Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: instance-00000012 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 196608 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-server-406449165 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 2026-06-27 02:03:13 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 192 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: True Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-1200701507-project-member Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-1200701507 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: hvm Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 128 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: 817d2aee-0075-45e7-aa8d-1ebda3fc52dd Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: Jun 27 02:03:18.773080 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:03:18.775063 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Preparing to wait for external event network-vif-plugged-d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:03:18.775063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:18.775063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:18.775063 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:18.775063 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-406449165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-attachvolumemultiattachtest-server-406449165',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5794cf82ab843adab5363e39a368501',ramdisk_id='',reservation_id='r-rx863he8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1200701507',owner_user_name='tempest-AttachVolumeMultiAttachTest-1200701507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:10Z,user_data=None,user_id='5e2709eb59eb45f88196956b2298d596',uuid=b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:03:18.776046 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converting VIF {"id": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "address": "fa:16:3e:13:bb:6e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd078f7f6-78", "ovs_interfaceid": "d078f7f6-7893-4f9a-a3f0-9e468c77c312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:18.776046 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=d078f7f6-7893-4f9a-a3f0-9e468c77c312,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd078f7f6-78') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:18.776356 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=d078f7f6-7893-4f9a-a3f0-9e468c77c312,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd078f7f6-78') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:03:18.776548 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.776781 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:18.776984 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:03:18.777906 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.778108 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56d054e5-c1e9-5452-b174-a5e8d76dfd52', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:18.779251 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.780058 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:18.783726 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:18.783903 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] Acquiring lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:18.784089 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:18.784283 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:18.784452 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] No waiting events found dispatching network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:18.784704 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-unplugged-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:18.784704 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Received event network-vif-deleted-d873a2d1-0f5a-4dc4-96df-c2cdf7c82151 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:18.784843 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Neutron deleted interface d873a2d1-0f5a-4dc4-96df-c2cdf7c82151; detaching it from the instance and deleting it from the info cache Jun 27 02:03:18.784999 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.786692 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fda0aa40-ad49-47fc-91fe-8425e0758b89 req-e457587a-141c-440e-8597-f9406b3fcb9a service nova] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Detach interface failed, port_id=d873a2d1-0f5a-4dc4-96df-c2cdf7c82151, reason: Instance ea1483cd-9799-4aa0-b0c3-540d9ec1835e could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:03:18.788959 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.789236 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd078f7f6-78, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:18.789574 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd078f7f6-78, col_values=(('qos', UUID('00a84838-b833-4145-8f2d-8256cba71030')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:18.789758 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd078f7f6-78, col_values=(('external_ids', {'iface-id': 'd078f7f6-7893-4f9a-a3f0-9e468c77c312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:bb:6e', 'vm-uuid': 'b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:18.790771 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.792008 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:18.792438 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:18.799207 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:18.800538 np0000003818 nova-compute[98971]: INFO os_vif [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=d078f7f6-7893-4f9a-a3f0-9e468c77c312,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd078f7f6-78') Jun 27 02:03:19.000011 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Detaching volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:19.027087 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:03:19.027699 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:03:19.027886 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:19.028279 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:19.056580 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Attempting to driver detach volume 7287b79f-a4fd-49f3-ad04-917cf6a7096b from mountpoint /dev/vdb Jun 27 02:03:19.060643 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Found disk vdb by alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:03:19.062529 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Found disk vdb by alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:03:19.062692 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Attempting to detach device vdb from instance 502e62b6-a346-41c3-917c-758e2d30274d from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] detach device xml: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]:
Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: Jun 27 02:03:19.063077 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:03:19.070055 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully detached device vdb from instance 502e62b6-a346-41c3-917c-758e2d30274d from the persistent domain config. Jun 27 02:03:19.070238 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] (1/8): Attempting to detach device vdb with device alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b from instance 502e62b6-a346-41c3-917c-758e2d30274d from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] detach device xml: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: 7287b79f-a4fd-49f3-ad04-917cf6a7096b Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]:
Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: Jun 27 02:03:19.070514 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:03:19.140839 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48172c20aca946a5b61e2dee61b95de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6450727e8a4a3dbb864e0616d363d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:03:19.294659 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Took 1.44 seconds to deallocate network for instance. Jun 27 02:03:19.532639 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:03:19.671934 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Successfully created port: cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:19.808767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:19.809065 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:20.038687 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:03:20.327168 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:20.327240 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:20.327656 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No VIF found with MAC fa:16:3e:13:bb:6e, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:20.327870 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Using config drive Jun 27 02:03:20.436720 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Successfully updated port: cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:20.465485 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:20.465757 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:20.510854 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-changed-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:20.511863 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Refreshing instance network info cache due to event network-changed-cd685529-e10d-45ec-a49c-2f642db01ee4. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:20.512582 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] Acquiring lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:20.512749 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] Acquired lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:20.513103 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Refreshing network info cache for port cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:20.544115 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Booting with blank volume at /dev/vda Jun 27 02:03:20.834693 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:20.940789 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:20.970300 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:21.016768 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:21.049062 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Creating config drive at /opt/stack/data/nova/instances/b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb/disk.config Jun 27 02:03:21.054273 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3p66h3d2 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:21.115250 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3p66h3d2" returned: 0 in 0.061s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:21.148056 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:21.269008 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:03:21.274471 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7287b79f-a4fd-49f3-ad04-917cf6a7096b for instance 502e62b6-a346-41c3-917c-758e2d30274d {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:03:21.281599 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully detached device vdb from instance 502e62b6-a346-41c3-917c-758e2d30274d from the live domain config. Jun 27 02:03:21.332676 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:03:21.334956 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:21.334956 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:21.334956 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:21.335496 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7287b79f-a4fd-49f3-ad04-917cf6a7096b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:03:21.335736 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:03:21.374725 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:21.377863 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:21.378474 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '38')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:03:21.378474 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', '36')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:03:21.380005 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b', '35')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:03:21.380620 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Resulting device map defaultdict(. at 0x7decc82423e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'): ({'sdb'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:03:21.380869 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Removing multipathed devices sdb, sdc {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:03:21.381460 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Flush multipath device 33000000099f9e8d5 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:03:21.420057 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:03:21.481159 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.670s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:21.482685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:03:21.532318 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:03:21.532581 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:03:21.533451 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:03:21.547211 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:03:21.547436 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:03:21.554063 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Deleted allocations for instance ea1483cd-9799-4aa0-b0c3-540d9ec1835e Jun 27 02:03:21.567463 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:21.596081 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.40.100,3260] Jun 27 02:03:21.596081 np0000003818 nova-compute[98971]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.40.100,3260] successful. Jun 27 02:03:21.596081 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:21.611466 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:21.625100 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:21.635652 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:21.661932 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.50.100,3260] Jun 27 02:03:21.661932 np0000003818 nova-compute[98971]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-7287b79f-a4fd-49f3-ad04-917cf6a7096b, portal: 192.168.50.100,3260] successful. Jun 27 02:03:21.661932 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:21.669367 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:21.678361 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:21.682792 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:21.682792 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:21.682792 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] <== disconnect_volume: return (348ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:21.682792 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:03:21.780989 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:21.880407 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-8c1286dc-e3d6-4ba8-9235-c6907e086969 req-780e47af-9b00-4a10-8d06-ad651d2c6d0f service nova] Releasing lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:21.881022 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquired lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:21.881439 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:22.096614 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:22.100093 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:22.131003 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:22.266500 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'flavor' on Instance uuid 502e62b6-a346-41c3-917c-758e2d30274d {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:22.344837 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:22.479650 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:22.565165 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4d36777a-6ea2-43f9-a154-96674cf40de0 tempest-ServerRescueNegativeTestJSON-438392507 tempest-ServerRescueNegativeTestJSON-438392507-project-member] Lock "ea1483cd-9799-4aa0-b0c3-540d9ec1835e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.607s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Received event network-vif-plugged-d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] Acquiring lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Processing event network-vif-plugged-d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Received event network-vif-plugged-d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] Acquiring lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] No waiting events found dispatching network-vif-plugged-d078f7f6-7893-4f9a-a3f0-9e468c77c312 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:22.606371 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-fcfbd939-d205-4b0d-9e07-e5af8f97e908 req-4d151e4c-4d16-4607-bffc-183d737c95ba service nova] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Received unexpected event network-vif-plugged-d078f7f6-7893-4f9a-a3f0-9e468c77c312 for instance with vm_state building and task_state spawning. Jun 27 02:03:22.717244 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:22.789268 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:03:22.790028 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:22.790300 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] VM Started (Lifecycle Event) Jun 27 02:03:22.793857 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:03:22.802575 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Instance spawned successfully. Jun 27 02:03:22.803245 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:03:22.885232 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Updating instance_info_cache with network_info: [{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:23.275481 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-20b0abfd-5c43-470c-86a6-e3611713892e tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.781s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:23.295380 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:23.300052 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:23.324041 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:23.325046 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:23.325669 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:23.326392 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:23.326617 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:23.327803 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:23.388255 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Releasing lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:23.388255 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance network_info: |[{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:03:23.798190 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:23.805842 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:03:23.805842 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:23.805842 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] VM Paused (Lifecycle Event) Jun 27 02:03:23.838815 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Took 11.24 seconds to spawn the instance on the hypervisor. Jun 27 02:03:23.838815 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:23.970800 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:23.972027 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:23.972027 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:23.972027 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:23.973843 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:23.980252 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Terminating instance Jun 27 02:03:24.096393 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:24.096496 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:24.096758 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:24.097551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:24.097551 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:24.102059 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Terminating instance Jun 27 02:03:24.132202 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009810019998894859 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:24.132532 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:24.132812 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] VM Stopped (Lifecycle Event) Jun 27 02:03:24.135353 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:24.135353 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.670976927999845 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:24.135353 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.670755375999988 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:24.183705 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:24.199160 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:03:24.230193 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:24.276118 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:03:24.276684 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:03:24.288676 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:03:24.292331 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe04:7956', 'fe80::50a9:bfff:fe5b:aead', 'fe80::fc16:3eff:feef:b815', 'fe80::fc16:3eff:fec8:dd54', 'fe80::b05b:b3ff:feb5:fb37', 'fe80::fc16:3eff:fe87:9ee6', 'fe80::b8bb:79ff:fef8:7cc8', 'fe80::fc16:3eff:fe0f:9a13', 'fe80::3c5f:2aff:fe42:e4a2', 'fe80::fc16:3eff:fe75:71dd', 'fe80::c13:9cff:febe:6408', 'fe80::fc16:3eff:fe13:bb6e', 'fe80::14f4:d5ff:fe2f:6a47'] Jun 27 02:03:24.293806 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:03:24.293806 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:03:24.293806 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:24.293806 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Updating existing volume attachment record: aaa05000-41f5-4fce-b1d6-9fd934971575 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:03:24.313655 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:24.316301 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:24.316478 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] VM Resumed (Lifecycle Event) Jun 27 02:03:24.351670 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Took 18.87 seconds to build instance. Jun 27 02:03:24.487911 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:03:24.522597 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.551896 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.608028 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:03:24.636811 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 2a3c8563-52c1-48ac-b1e5-2a3ba54f4770] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:24.646231 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.680911 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.755827 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.772475 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.797295 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.819892 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:24.825811 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:24.840394 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:24.857388 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-2a15634a-ab1c-4c07-b446-f6a099955db7 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.390s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:24.924867 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7c1efa18-2099-44da-893e-0f1ed72c172f req-6c77779a-742d-4531-98f2-6e1794ea4ce9 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:24.925074 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7c1efa18-2099-44da-893e-0f1ed72c172f req-6c77779a-742d-4531-98f2-6e1794ea4ce9 service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:24.925444 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7c1efa18-2099-44da-893e-0f1ed72c172f req-6c77779a-742d-4531-98f2-6e1794ea4ce9 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:24.929527 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7c1efa18-2099-44da-893e-0f1ed72c172f req-6c77779a-742d-4531-98f2-6e1794ea4ce9 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:24.929993 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7c1efa18-2099-44da-893e-0f1ed72c172f req-6c77779a-742d-4531-98f2-6e1794ea4ce9 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:24.930150 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7c1efa18-2099-44da-893e-0f1ed72c172f req-6c77779a-742d-4531-98f2-6e1794ea4ce9 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:24.986318 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.021720 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Instance destroyed successfully. Jun 27 02:03:25.029671 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.035438 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'resources' on Instance uuid b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:25.042770 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-215e1976-6b43-415e-8e13-fb7b347288f0 req-900ceaff-d43d-4eb6-8c54-a42c48d3aef6 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-unplugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:25.043059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-215e1976-6b43-415e-8e13-fb7b347288f0 req-900ceaff-d43d-4eb6-8c54-a42c48d3aef6 service nova] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:25.044185 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-215e1976-6b43-415e-8e13-fb7b347288f0 req-900ceaff-d43d-4eb6-8c54-a42c48d3aef6 service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:25.044185 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-215e1976-6b43-415e-8e13-fb7b347288f0 req-900ceaff-d43d-4eb6-8c54-a42c48d3aef6 service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:25.044185 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-215e1976-6b43-415e-8e13-fb7b347288f0 req-900ceaff-d43d-4eb6-8c54-a42c48d3aef6 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] No waiting events found dispatching network-vif-unplugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:25.044185 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-215e1976-6b43-415e-8e13-fb7b347288f0 req-900ceaff-d43d-4eb6-8c54-a42c48d3aef6 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-unplugged-d3c30573-faba-4d86-a21a-731096280755 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:25.045598 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Instance destroyed successfully. Jun 27 02:03:25.046657 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lazy-loading 'resources' on Instance uuid 502e62b6-a346-41c3-917c-758e2d30274d {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:25.128726 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.135382 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.178020 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.329269 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999651151999842 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:25.329837 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999831619000133 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:25.492913 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.509285 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.513659 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.550382 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-395301706-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-testmultiattachvolumeswap-server-395301706-1',id=12,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaqSefSzTm8DXg/yRns6r1nitn0rB0dyv3+j3FQ3EhGRvrToPIf6C079yqdJZL+t8wJ2FskHzY3MTkox7eQFUQTGCH1uJeh+oNr0x7m7uEQKRBruBsjjwxU2e7BJh7lIg==',key_name='tempest-keypair-1735265842',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:09Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='0bb5b970bc7a4e3cb52f7a98dff98715',ramdisk_id='',reservation_id='r-s6gt121q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-204905735',owner_user_name='tempest-TestMultiAttachVolumeSwap-204905735-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d14d8ca1a02c49228bf2cf5e40d96286',uuid=b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:03:25.550780 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converting VIF {"id": "d3c30573-faba-4d86-a21a-731096280755", "address": "fa:16:3e:04:79:56", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c30573-fa", "ovs_interfaceid": "d3c30573-faba-4d86-a21a-731096280755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:25.551595 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:25.551909 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:03:25.558511 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.561308 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-395301706-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-testmultiattachvolumeswap-server-395301706-2',id=13,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaqSefSzTm8DXg/yRns6r1nitn0rB0dyv3+j3FQ3EhGRvrToPIf6C079yqdJZL+t8wJ2FskHzY3MTkox7eQFUQTGCH1uJeh+oNr0x7m7uEQKRBruBsjjwxU2e7BJh7lIg==',key_name='tempest-keypair-1735265842',keypairs=,launch_index=1,launched_at=2026-06-27T02:02:12Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='0bb5b970bc7a4e3cb52f7a98dff98715',ramdisk_id='',reservation_id='r-s6gt121q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-204905735',owner_user_name='tempest-TestMultiAttachVolumeSwap-204905735-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d14d8ca1a02c49228bf2cf5e40d96286',uuid=502e62b6-a346-41c3-917c-758e2d30274d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:03:25.563737 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converting VIF {"id": "14c670f2-d304-4427-9bcf-58d43a34dc40", "address": "fa:16:3e:ef:b8:15", "network": {"id": "fa90cca3-8b96-4f11-8642-a8788a70f5a5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-945323646-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0bb5b970bc7a4e3cb52f7a98dff98715", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c670f2-d3", "ovs_interfaceid": "14c670f2-d304-4427-9bcf-58d43a34dc40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:25.564728 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:25.565428 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:03:25.565947 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.567354 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3c30573-fa, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:25.573844 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:25.584336 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.585992 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.585992 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14c670f2-d3, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:25.590748 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:25.591177 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.591398 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a75598dd-2783-49a6-8b3c-0ec1cd41028e) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:25.593116 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.594371 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:25.596265 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.596516 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d00f1a8e-60b7-4942-bd8e-ab8a6608c320) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:25.597407 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.598043 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:25.599766 np0000003818 nova-compute[98971]: INFO os_vif [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:79:56,bridge_name='br-int',has_traffic_filtering=True,id=d3c30573-faba-4d86-a21a-731096280755,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c30573-fa') Jun 27 02:03:25.600228 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Deleting instance files /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c_del Jun 27 02:03:25.601275 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Deletion of /opt/stack/data/nova/instances/b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c_del complete Jun 27 02:03:25.603949 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.614045 np0000003818 nova-compute[98971]: INFO os_vif [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b8:15,bridge_name='br-int',has_traffic_filtering=True,id=14c670f2-d304-4427-9bcf-58d43a34dc40,network=Network(fa90cca3-8b96-4f11-8642-a8788a70f5a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c670f2-d3') Jun 27 02:03:25.614045 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Deleting instance files /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d_del Jun 27 02:03:25.614045 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Deletion of /opt/stack/data/nova/instances/502e62b6-a346-41c3-917c-758e2d30274d_del complete Jun 27 02:03:25.744316 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.831894 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.838530 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:25.859793 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:26.116658 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Took 1.63 seconds to destroy the instance on the hypervisor. Jun 27 02:03:26.117539 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:03:26.117775 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:03:26.117963 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:03:26.118343 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:26.127344 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Took 1.52 seconds to destroy the instance on the hypervisor. Jun 27 02:03:26.133456 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:03:26.133854 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:03:26.134157 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:03:26.134873 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:26.222632 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:26.267208 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:26.506922 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:03:26.507921 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:03:26.508411 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Creating image(s) Jun 27 02:03:26.508829 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Did not create local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 27 02:03:26.509129 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Ensure instance console log exists: /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:03:26.509354 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:26.509562 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:26.509671 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:26.510487 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Start _get_guest_xml network_info=[{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0659eeb0-028e-4fe2-9a53-a93ac045cf30', 'attached_at': '', 'detached_at': '', 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'serial': '40592cc8-a5cf-45d8-823f-dac19e643b2d'}, 'attachment_id': 'aaa05000-41f5-4fce-b1d6-9fd934971575', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:03:26.516568 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:03:26.519564 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1067226247', uuid='0659eeb0-028e-4fe2-9a53-a93ac045cf30'), owner=OwnerMeta(userid='48172c20aca946a5b61e2dee61b95de7', username='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member', projectid='fb6450727e8a4a3dbb864e0616d363d4', projectname='tempest-ServerBootFromVolumeStableRescueTest-1593948765'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525806.5188067) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:03:26.522567 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:03:26.523156 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:03:26.525963 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:03:26.525963 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:03:26.527642 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:03:26.528445 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:03:26.528723 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:03:26.528948 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:03:26.528948 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:03:26.529179 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:03:26.529179 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:03:26.529366 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:03:26.529475 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:03:26.529567 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:03:26.529812 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:03:26.533344 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:03:26.558567 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:03:26.558933 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:26.559194 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:26.560491 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:26.560491 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:03:26.579278 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:26.582584 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:26.583886 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:26.585202 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:26.585508 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:26.585904 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:26.603752 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:03:26.603752 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:26.606241 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:03:26.606241 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d] added Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:26.625649 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:26.626215 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:03:26.626276 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.042(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:03:26.626833 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d] added Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:26.628882 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:26.629154 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:03:26.629294 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0437(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:03:26.630183 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:03:27.018020 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.018207 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:27.018716 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:27.019546 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:27.020350 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:27.020635 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:27.020808 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.020886 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:27.021167 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:27.021256 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:27.022268 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:27.022268 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received unexpected event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with vm_state active and task_state deleting. Jun 27 02:03:27.022475 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.022747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:27.022747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:27.022923 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:27.023000 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:27.023249 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received unexpected event network-vif-plugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with vm_state active and task_state deleting. Jun 27 02:03:27.023379 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.023529 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:27.023715 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:27.023869 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:27.024002 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:27.025323 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:27.025323 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.025632 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Acquiring lock "502e62b6-a346-41c3-917c-758e2d30274d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:27.025691 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:27.025899 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] Lock "502e62b6-a346-41c3-917c-758e2d30274d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:27.030799 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] No waiting events found dispatching network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:27.031074 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-532563b8-bee4-47bb-a95d-536df4f3971c req-a0fe3630-d260-4dc8-88de-b50c8eb2c4e3 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-unplugged-14c670f2-d304-4427-9bcf-58d43a34dc40 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:27.157594 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-unplugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.157594 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] Acquiring lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:27.157594 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:27.157594 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:27.158059 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] No waiting events found dispatching network-vif-unplugged-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:27.158738 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-unplugged-d3c30573-faba-4d86-a21a-731096280755 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:03:27.158931 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Received event network-vif-deleted-14c670f2-d304-4427-9bcf-58d43a34dc40 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:27.159240 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Neutron deleted interface 14c670f2-d304-4427-9bcf-58d43a34dc40; detaching it from the instance and deleting it from the info cache Jun 27 02:03:27.164060 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ac53ac1b-4487-42d2-aa2c-23cdcc46fcc7 req-4e7c2224-901b-4a2b-adb0-955cfa96edc1 service nova] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Detach interface failed, port_id=14c670f2-d304-4427-9bcf-58d43a34dc40, reason: Instance 502e62b6-a346-41c3-917c-758e2d30274d could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:03:27.237299 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:27.349132 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:27.626967 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:27.630224 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:27.642902 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:27.653542 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:27.671089 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:27.671089 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:27.678001 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:27.682078 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.682078 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.682078 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:27.682078 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.682078 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.682078 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:27.691169 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.691169 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.691169 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:27.691169 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.691169 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.691169 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:27.735718 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d, portal: 192.168.40.100,3260] Jun 27 02:03:27.735718 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d, portal: 192.168.40.100,3260] successful. Jun 27 02:03:27.735718 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:27.739669 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Took 1.61 seconds to deallocate network for instance. Jun 27 02:03:27.750015 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:27.764111 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:27.764628 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:27.764628 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:27.765222 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] HCTL ('8', '-', '-', 0) found on session 40 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:27.765369 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:27.787225 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching for a device in session 40 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:27.787414 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:28.172758 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Took 2.05 seconds to deallocate network for instance. Jun 27 02:03:28.247847 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:28.248214 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:28.685191 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:28.734118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d, portal: 192.168.50.100,3260] Jun 27 02:03:28.734118 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d, portal: 192.168.50.100,3260] successful. Jun 27 02:03:28.734118 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:28.748511 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.181s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] HCTL ('7', '-', '-', 0) found on session 39 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:28.765663 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:28.789157 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching for a device in session 39 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:28.789157 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:28.832688 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:28.833145 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:29.127083 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1eba3dcd-2d09-4be8-b657-4f7a433fce1b req-e2335c5f-18b7-44a6-8c56-e33845f430c1 service nova] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Received event network-vif-deleted-d3c30573-faba-4d86-a21a-731096280755 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:29.337446 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:29.617290 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:03:29.845918 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.598s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:29.847771 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.168s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:29.883422 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:29.883847 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:30.054358 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Deleted allocations for instance 502e62b6-a346-41c3-917c-758e2d30274d Jun 27 02:03:30.386695 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:03:30.559422 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:30.559422 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:30.598328 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:30.639274 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798961 for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:03:30.640842 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.080s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:30.640842 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] <== connect_volume: return (4081ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798961', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798961'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:30.640842 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798961', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798961'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:03:30.986355 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:31.067509 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:31.076308 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-654d0e14-d902-4dc5-90db-b5cb23cc3d6f tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "502e62b6-a346-41c3-917c-758e2d30274d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.980s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:31.151090 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1067226247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverbootfromvolumestablerescuetest-server-1067226247',id=19,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb6450727e8a4a3dbb864e0616d363d4',ramdisk_id='',reservation_id='r-pzobb9zb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:20Z,user_data=None,user_id='48172c20aca946a5b61e2dee61b95de7',uuid=0659eeb0-028e-4fe2-9a53-a93ac045cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:03:31.151090 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converting VIF {"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:31.151090 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:80,bridge_name='br-int',has_traffic_filtering=True,id=cd685529-e10d-45ec-a49c-2f642db01ee4,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd685529-e1') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:31.151090 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'pci_devices' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:31.579573 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.731s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:31.582789 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.597s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:31.612814 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:03:31.612814 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Claim successful on node np0000003818 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] End _get_guest_xml xml= Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 0659eeb0-028e-4fe2-9a53-a93ac045cf30 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: instance-00000013 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 196608 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-server-1067226247 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 2026-06-27 02:03:26 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 192 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: True Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: bare Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-1593948765 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 0659eeb0-028e-4fe2-9a53-a93ac045cf30 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 0659eeb0-028e-4fe2-9a53-a93ac045cf30 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: hvm Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 128 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: 40592cc8-a5cf-45d8-823f-dac19e643b2d Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: Jun 27 02:03:31.655941 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Preparing to wait for external event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1067226247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverbootfromvolumestablerescuetest-server-1067226247',id=19,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb6450727e8a4a3dbb864e0616d363d4',ramdisk_id='',reservation_id='r-pzobb9zb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:20Z,user_data=None,user_id='48172c20aca946a5b61e2dee61b95de7',uuid=0659eeb0-028e-4fe2-9a53-a93ac045cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converting VIF {"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:80,bridge_name='br-int',has_traffic_filtering=True,id=cd685529-e10d-45ec-a49c-2f642db01ee4,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd685529-e1') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:31.662452 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:80,bridge_name='br-int',has_traffic_filtering=True,id=cd685529-e10d-45ec-a49c-2f642db01ee4,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd685529-e1') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:03:31.663164 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:31.663739 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:31.664021 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:03:31.665095 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:31.665367 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fb94665-ec13-5174-9386-15cf7a3d17c6', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:31.666272 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:31.668697 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:31.676574 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:31.676574 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd685529-e1, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:31.676574 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd685529-e1, col_values=(('qos', UUID('5dd96361-8c2b-4cc3-bca3-447e2506631f')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:31.676574 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd685529-e1, col_values=(('external_ids', {'iface-id': 'cd685529-e10d-45ec-a49c-2f642db01ee4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:15:80', 'vm-uuid': '0659eeb0-028e-4fe2-9a53-a93ac045cf30'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:31.679399 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:31.681323 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:31.685221 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:31.686672 np0000003818 nova-compute[98971]: INFO os_vif [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:80,bridge_name='br-int',has_traffic_filtering=True,id=cd685529-e10d-45ec-a49c-2f642db01ee4,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd685529-e1') Jun 27 02:03:31.806628 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004685260000769631 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:31.806915 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:31.807517 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:31.807584 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.521251849999999 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:31.807726 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.521099928000012 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:31.809157 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] VM Stopped (Lifecycle Event) Jun 27 02:03:31.821907 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Deleted allocations for instance b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c Jun 27 02:03:32.311077 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: ea1483cd-9799-4aa0-b0c3-540d9ec1835e] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:32.350956 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:32.825938 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7e8e8b1c-9a64-439a-85c6-494e13d7f28c tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Lock "b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.854s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:33.173851 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:33.174209 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:33.233891 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:33.234063 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:33.237004 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No VIF found with MAC fa:16:3e:22:15:80, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:33.237004 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Using config drive Jun 27 02:03:33.678999 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:33.743651 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:33.908915 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Creating config drive at /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config Jun 27 02:03:33.933999 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm7atn1hk {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:33.998036 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm7atn1hk" returned: 0 in 0.067s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:34.192466 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.609s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:34.193593 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:03:34.539748 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:34.582192 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:34.582192 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:34.708414 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:03:34.709693 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:03:34.710322 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:34.711341 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:34.718130 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:34.809267 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:34.852138 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e2709eb59eb45f88196956b2298d596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5794cf82ab843adab5363e39a368501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:03:34.877347 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-445d0f3d-ef72-42c1-ab15-69616e768a20 req-93cf7936-96f1-49d3-b7e5-bbbac4f358d8 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:34.877347 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-445d0f3d-ef72-42c1-ab15-69616e768a20 req-93cf7936-96f1-49d3-b7e5-bbbac4f358d8 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:34.877347 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-445d0f3d-ef72-42c1-ab15-69616e768a20 req-93cf7936-96f1-49d3-b7e5-bbbac4f358d8 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:34.877347 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-445d0f3d-ef72-42c1-ab15-69616e768a20 req-93cf7936-96f1-49d3-b7e5-bbbac4f358d8 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:34.877347 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-445d0f3d-ef72-42c1-ab15-69616e768a20 req-93cf7936-96f1-49d3-b7e5-bbbac4f358d8 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Processing event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:03:35.212074 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:03:35.720686 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:03:35.840199 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Successfully created port: 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:36.258207 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:03:36.258901 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:36.259309 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Started (Lifecycle Event) Jun 27 02:03:36.268379 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:03:36.273152 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance spawned successfully. Jun 27 02:03:36.273301 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:03:36.677769 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:36.736509 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:03:36.737708 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:03:36.738248 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Creating image(s) Jun 27 02:03:36.739040 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:36.739221 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "/opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:36.743048 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "/opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:36.743841 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:36.748735 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:36.750403 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:36.775303 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:36.783016 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:36.788180 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:36.788180 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:36.788642 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:36.789177 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:36.790489 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:36.790489 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:36.826859 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Successfully updated port: 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:36.869059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.115s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:36.869059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:36.869059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:36.869059 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:36.874965 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:36.878530 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:36.899318 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Received event network-changed-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:36.899496 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Refreshing instance network info cache due to event network-changed-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:36.899864 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] Acquiring lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:36.900036 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] Acquired lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:36.900224 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Refreshing network info cache for port 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:36.961177 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.085s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:36.961719 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:36.984300 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-99cad920-1624-4e8b-b4c7-798b329ea9c7 req-49e8958b-8598-4a32-9c45-20906cfa485d service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:36.984761 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-99cad920-1624-4e8b-b4c7-798b329ea9c7 req-49e8958b-8598-4a32-9c45-20906cfa485d service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:36.985234 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-99cad920-1624-4e8b-b4c7-798b329ea9c7 req-49e8958b-8598-4a32-9c45-20906cfa485d service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:36.985444 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-99cad920-1624-4e8b-b4c7-798b329ea9c7 req-49e8958b-8598-4a32-9c45-20906cfa485d service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:36.985858 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-99cad920-1624-4e8b-b4c7-798b329ea9c7 req-49e8958b-8598-4a32-9c45-20906cfa485d service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:36.986107 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-99cad920-1624-4e8b-b4c7-798b329ea9c7 req-49e8958b-8598-4a32-9c45-20906cfa485d service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state building and task_state spawning. Jun 27 02:03:37.023601 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk 1073741824" returned: 0 in 0.062s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:37.025281 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.158s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:37.025464 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:37.146475 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.121s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:37.147074 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:03:37.147517 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:37.250588 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:37.251256 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Cannot resize image /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:03:37.251749 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:03:37.252079 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Ensure instance console log exists: /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:03:37.252400 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:37.252654 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:37.252860 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:37.286997 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:03:37.286997 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:37.286997 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Paused (Lifecycle Event) Jun 27 02:03:37.297991 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Took 10.79 seconds to spawn the instance on the hypervisor. Jun 27 02:03:37.298467 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:37.319072 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:37.353378 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:37.406300 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:37.509467 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:37.735243 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:37.789801 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:37.801042 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:37.801217 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Resumed (Lifecycle Event) Jun 27 02:03:37.814465 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Took 22.07 seconds to build instance. Jun 27 02:03:38.239447 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3e387b96-e021-4b7e-bb49-3a28d55449d5 req-ed7f6149-f434-4304-b901-4b1ad05107d1 service nova] Releasing lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:38.240171 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquired lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:38.240451 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:38.304000 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:38.305695 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:38.317244 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.584s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:38.747016 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:38.747769 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.005s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:38.863050 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:38.902683 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:39.106060 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:39.254793 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lazy-loading 'flavor' on Instance uuid e71ace91-8cd6-4723-8c23-58ac2e0101dc {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:39.400170 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updating instance_info_cache with network_info: [{"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:39.758750 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Ignoring supplied device name: /dev/vdb Jun 27 02:03:39.817612 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Rescuing Jun 27 02:03:39.817929 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:39.818123 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquired lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:39.818303 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Releasing lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Instance network_info: |[{"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Start _get_guest_xml network_info=[{"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='4eb34ff8-b41d-47ea-ae36-a583b5bc32ad'), owner=OwnerMeta(userid='5e2709eb59eb45f88196956b2298d596', username='tempest-AttachVolumeMultiAttachTest-1200701507-project-member', projectid='a5794cf82ab843adab5363e39a368501', projectname='tempest-AttachVolumeMultiAttachTest-1200701507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525819.9100542) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:03:39.939666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:03:39.964156 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='multiattach-server-0',id=20,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl3GQnnd3WW2gRHiVxQWMFGNfe/yctQr6Z+QvmmVT0l/tOK5WbrYGrI49O0USeM4fwDg1N74DvUaqSqYL/LeIlc7oWDyFebhBQP+lduF3aGoDiQ6DLoM0v7QDzerDxXjw==',key_name='tempest-keypair-386126037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5794cf82ab843adab5363e39a368501',ramdisk_id='',reservation_id='r-t3e4qm2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1200701507',owner_user_name='tempest-AttachVolumeMultiAttachTest-1200701507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2709eb59eb45f88196956b2298d596',uuid=4eb34ff8-b41d-47ea-ae36-a583b5bc32ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:03:39.964156 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converting VIF {"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:39.964156 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:8e,bridge_name='br-int',has_traffic_filtering=True,id=4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2dbe66-a7') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:39.964156 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:40.261459 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:40.321049 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:40.329618 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007025350000731123 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:40.329766 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:40.329917 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-0.0006066049998025846 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:40.330119 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000805994999836912 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:40.330207 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:40.330751 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:40.331306 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] VM Stopped (Lifecycle Event) Jun 27 02:03:40.332306 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:40.332475 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] VM Stopped (Lifecycle Event) Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] End _get_guest_xml xml= Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: instance-00000014 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 196608 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: multiattach-server-0 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 2026-06-27 02:03:39 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 192 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: True Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: bare Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-1200701507-project-member Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-1200701507 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: hvm Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 128 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: Jun 27 02:03:40.438412 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Preparing to wait for external event network-vif-plugged-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='multiattach-server-0',id=20,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl3GQnnd3WW2gRHiVxQWMFGNfe/yctQr6Z+QvmmVT0l/tOK5WbrYGrI49O0USeM4fwDg1N74DvUaqSqYL/LeIlc7oWDyFebhBQP+lduF3aGoDiQ6DLoM0v7QDzerDxXjw==',key_name='tempest-keypair-386126037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5794cf82ab843adab5363e39a368501',ramdisk_id='',reservation_id='r-t3e4qm2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1200701507',owner_user_name='tempest-AttachVolumeMultiAttachTest-1200701507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2709eb59eb45f88196956b2298d596',uuid=4eb34ff8-b41d-47ea-ae36-a583b5bc32ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converting VIF {"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:8e,bridge_name='br-int',has_traffic_filtering=True,id=4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2dbe66-a7') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:8e,bridge_name='br-int',has_traffic_filtering=True,id=4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2dbe66-a7') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:40.442475 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:03:40.443591 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.444155 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f82bd55-47fb-5349-aa0e-60cc2c9064e6', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:40.445176 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.446128 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:40.448612 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.451447 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.451692 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c2dbe66-a7, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:40.452101 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c2dbe66-a7, col_values=(('qos', UUID('48935f6d-bf15-45a9-a2d9-3553e1f65415')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:40.452278 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c2dbe66-a7, col_values=(('external_ids', {'iface-id': '4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:a6:8e', 'vm-uuid': '4eb34ff8-b41d-47ea-ae36-a583b5bc32ad'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:40.453663 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.455129 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:40.460172 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:40.461272 np0000003818 nova-compute[98971]: INFO os_vif [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:a6:8e,bridge_name='br-int',has_traffic_filtering=True,id=4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2dbe66-a7') Jun 27 02:03:40.783441 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:40.835674 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-36764f1c-d937-4f10-9d29-0a7fa4913b69 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: b04eb722-f1c1-4d18-90b8-b71eb3ae9e6c] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:40.839664 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-d13ee6b1-9d79-408c-b2e7-6f1e3b316f49 None None] [instance: 502e62b6-a346-41c3-917c-758e2d30274d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:41.016149 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Updating instance_info_cache with network_info: [{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Attaching volume db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 to /dev/vdb Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Releasing lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:41.542244 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fec8:dd54', 'fe80::b05b:b3ff:feb5:fb37', 'fe80::fc16:3eff:fe87:9ee6', 'fe80::b8bb:79ff:fef8:7cc8', 'fe80::fc16:3eff:fe0f:9a13', 'fe80::3c5f:2aff:fe42:e4a2', 'fe80::fc16:3eff:fe75:71dd', 'fe80::c13:9cff:febe:6408', 'fe80::fc16:3eff:fe13:bb6e', 'fe80::14f4:d5ff:fe2f:6a47', 'fe80::fc16:3eff:fe22:1580'] Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:03:41.576543 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:41.576993 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Updating existing volume attachment record: f542463c-dcba-4d74-92e2-52fa44c07e29 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:03:42.026243 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:42.026243 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:42.026243 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No VIF found with MAC fa:16:3e:a8:a6:8e, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:42.026998 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Using config drive Jun 27 02:03:42.177531 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:03:42.178253 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:42.178680 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:42.179192 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:42.179700 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:03:42.197490 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:42.197490 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:42.197490 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:42.198524 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:42.198524 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:42.198681 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:42.215449 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:03:42.215449 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:42.224013 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:03:42.224013 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3] added Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:42.236276 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:42.236638 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:03:42.236893 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:03:42.237202 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3] added Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:03:42.242678 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:42.243024 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:03:42.243078 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0445(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:03:42.243288 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:03:42.355336 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:42.543460 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:42.553553 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:42.725092 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Creating config drive at /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk.config Jun 27 02:03:42.737012 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpquab32du {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:42.802958 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpquab32du" returned: 0 in 0.065s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:43.238560 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:43.244235 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:43.263782 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:43.278696 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.290038 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.292682 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.294763 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.307731 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.329156 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.329156 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.329156 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.329156 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.329156 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:43.329452 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.329452 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.329452 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.329452 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.329452 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:43.341727 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.348180 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:43.403642 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.50.100,3260] Jun 27 02:03:43.403642 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.50.100,3260] successful. Jun 27 02:03:43.403642 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.415684 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.40.100,3260] Jun 27 02:03:43.415684 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.40.100,3260] successful. Jun 27 02:03:43.415684 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.416813 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.420365 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.442583 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:43.453417 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.256s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:43.454110 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:43.454406 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] HCTL ('11', '-', '-', 0) found on session 41 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:43.454546 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:43.458573 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.467982 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.476601 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.279s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:43.477444 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:43.479851 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] HCTL ('12', '-', '-', 0) found on session 42 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:43.479851 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:43.496377 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Searching for a device in session 41 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:43.496701 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:43.525129 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Searching for a device in session 42 and hctl ['12', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:43.579413 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.601251 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.619611 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.771185 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-978e8b47-2392-4ae1-aa6f-81a91a76e425 req-58be8ab9-7e00-4005-b52b-30e7efd81e20 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:43.782595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-978e8b47-2392-4ae1-aa6f-81a91a76e425 req-58be8ab9-7e00-4005-b52b-30e7efd81e20 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:43.782595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-978e8b47-2392-4ae1-aa6f-81a91a76e425 req-58be8ab9-7e00-4005-b52b-30e7efd81e20 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:43.782595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-978e8b47-2392-4ae1-aa6f-81a91a76e425 req-58be8ab9-7e00-4005-b52b-30e7efd81e20 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:43.782595 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-978e8b47-2392-4ae1-aa6f-81a91a76e425 req-58be8ab9-7e00-4005-b52b-30e7efd81e20 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:43.782595 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-978e8b47-2392-4ae1-aa6f-81a91a76e425 req-58be8ab9-7e00-4005-b52b-30e7efd81e20 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state rescuing. Jun 27 02:03:43.804696 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999524688000065 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:43.804696 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999198442000079 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:43.804696 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999054926000099 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:43.820247 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance destroyed successfully. Jun 27 02:03:43.820952 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'numa_topology' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:43.961497 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:43.971356 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:44.328677 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Attempting a stable device rescue Jun 27 02:03:44.469814 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 27 02:03:44.481132 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance directory exists: not creating {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 27 02:03:44.481653 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Creating image(s) Jun 27 02:03:44.482526 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "/opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:44.482708 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:44.484242 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:44.484512 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:44.524178 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Searching for a device in session 42 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:44.524368 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:44.920314 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:44.920649 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] VM Started (Lifecycle Event) Jun 27 02:03:44.986751 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:44.987192 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "c4384ac4031ba9ddce5920f0e220dabc1d750ac3" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:44.987679 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "c4384ac4031ba9ddce5920f0e220dabc1d750ac3" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:45.219098 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Found WWN 330000000be2ceaa7 for multipath device dm-4 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:03:45.220406 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:45.220406 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000be2ceaa7', 'path': '/dev/dm-4', 'multipath_id': '330000000be2ceaa7'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:45.221648 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be2ceaa7', 'path': '/dev/dm-4', 'multipath_id': '330000000be2ceaa7'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:03:45.233473 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lazy-loading 'flavor' on Instance uuid e71ace91-8cd6-4723-8c23-58ac2e0101dc {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:45.427877 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:45.442770 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:45.442770 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] VM Paused (Lifecycle Event) Jun 27 02:03:45.455685 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:45.743915 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Attempting to attach volume db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] attach device xml: Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: Jun 27 02:03:45.748757 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:03:45.889903 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:45.889903 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:45.889903 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:45.889903 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:45.893965 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:45.895023 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state rescuing. Jun 27 02:03:45.895023 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Received event network-vif-plugged-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:45.895415 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Acquiring lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:45.895415 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:45.895415 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:45.895622 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Processing event network-vif-plugged-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:03:45.895797 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Received event network-vif-plugged-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:45.895991 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Acquiring lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:45.896212 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:45.896424 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:45.896754 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] No waiting events found dispatching network-vif-plugged-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:45.897273 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-23da3b8c-ea67-46a3-9b74-825c5e5af668 req-b2ad6633-2ef1-4c3d-851b-9738ccefec64 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Received unexpected event network-vif-plugged-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 for instance with vm_state building and task_state spawning. Jun 27 02:03:45.898467 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:03:45.903874 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:03:45.912937 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Instance spawned successfully. Jun 27 02:03:45.913925 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:03:45.951082 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:45.954848 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:45.955211 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] VM Resumed (Lifecycle Event) Jun 27 02:03:45.967339 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:46.097212 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:46.102412 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:46.103019 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.part --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:46.219107 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.part --force-share --output=json" returned: 0 in 0.116s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:46.221277 np0000003818 nova-compute[98971]: DEBUG nova.virt.images [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] 41192f39-0aa5-42c5-bdbe-33773b99c735 was qcow2, converting to raw {{(pid=98971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 27 02:03:46.223343 np0000003818 nova-compute[98971]: DEBUG nova.privsep.utils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 27 02:03:46.223343 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.part /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.converted {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:46.358919 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.part /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.converted" returned: 0 in 0.133s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:46.366764 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.converted --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:46.431338 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:46.432197 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:46.433445 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:46.433445 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:46.434370 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:46.434687 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:03:46.458815 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:46.463271 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:46.502359 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:46.503790 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "c4384ac4031ba9ddce5920f0e220dabc1d750ac3" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.515s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:46.503790 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:46.509064 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:46.511089 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "c4384ac4031ba9ddce5920f0e220dabc1d750ac3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:46.513035 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "c4384ac4031ba9ddce5920f0e220dabc1d750ac3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:46.514271 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:46.519712 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:46.519712 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3 --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:46.645287 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3 --force-share --output=json" returned: 0 in 0.125s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:46.646563 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3,backing_fmt=raw /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.rescue {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:46.721161 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c4384ac4031ba9ddce5920f0e220dabc1d750ac3,backing_fmt=raw /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.rescue" returned: 0 in 0.075s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:46.722892 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "c4384ac4031ba9ddce5920f0e220dabc1d750ac3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.209s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:46.722892 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'migration_context' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:46.948149 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Took 10.21 seconds to spawn the instance on the hypervisor. Jun 27 02:03:46.948916 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:46.964604 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:03:47.225043 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:47.225784 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:03:47.226379 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Start _get_guest_xml network_info=[{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "vif_mac": "fa:16:3e:22:15:80"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue={'image_id': '41192f39-0aa5-42c5-bdbe-33773b99c735', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '0659eeb0-028e-4fe2-9a53-a93ac045cf30', 'attached_at': '', 'detached_at': '', 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'serial': '40592cc8-a5cf-45d8-823f-dac19e643b2d'}, 'attachment_id': 'aaa05000-41f5-4fce-b1d6-9fd934971575', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:03:47.226615 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'resources' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:47.357721 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:47.463655 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Took 16.57 seconds to build instance. Jun 27 02:03:47.501671 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:47.502458 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:47.502670 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:47.503375 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No VIF found with MAC fa:16:3e:c8:dd:54, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:47.735739 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:47.738756 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:03:47.740400 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1067226247', uuid='0659eeb0-028e-4fe2-9a53-a93ac045cf30'), owner=OwnerMeta(userid='48172c20aca946a5b61e2dee61b95de7', username='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member', projectid='fb6450727e8a4a3dbb864e0616d363d4', projectname='tempest-ServerBootFromVolumeStableRescueTest-1593948765'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "vif_mac": "fa:16:3e:22:15:80"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525827.7399168) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:03:47.743249 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:03:47.743828 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:03:47.745059 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:03:47.745366 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:03:47.747090 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:03:47.747769 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:03:47.748485 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:03:47.748485 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:03:47.748485 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:03:47.748485 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:03:47.752159 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:47.965310 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-7b3113d3-2f49-45ca-85ce-b4eeddc7f631 tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.081s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:48.253037 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:48.270794 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:48.383266 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config --force-share --output=json" returned: 0 in 0.112s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:48.384110 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "/opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:48.384371 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:48.385237 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:48.385766 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:03:48.386227 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:48.386369 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:48.386747 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:48.387080 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:03:48.400336 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:48.400595 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:48.401268 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:48.401672 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:03:48.401914 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:48.402519 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.startup = automatic Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.scan = manual Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:48.421067 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.startup = automatic Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.scan = manual Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:03:48.428480 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:48.440670 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:48.447716 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.462607 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:48.463218 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:48.463218 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:48.463843 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] HCTL ('8', '0', '0', 0) found on session 40 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:48.464375 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] HCTL ('7', '0', '0', 0) found on session 39 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:03:48.471908 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:03:48.482730 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching for a device in session 39 and hctl ('7', '0', '0', 0) yield: sdc {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:48.482730 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:48.483063 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching for a device in session 40 and hctl ('8', '0', '0', 0) yield: sdb {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:03:48.483277 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40592cc8-a5cf-45d8-823f-dac19e643b2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:03:48.578666 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Received event network-changed-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:48.580475 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Refreshing instance network info cache due to event network-changed-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:48.580822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] Acquiring lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:48.580822 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] Acquired lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:48.581216 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Refreshing network info cache for port 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:49.086939 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:49.096294 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:49.104370 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-964b44d6-7e93-4695-ac53-a846eca0ab8b tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.718s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:49.392447 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "interface-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:49.392646 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "interface-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:49.392949 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'flavor' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:49.402517 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:03:49.505890 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:49.699184 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updated VIF entry in instance network info cache for port 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:03:49.699529 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updating instance_info_cache with network_info: [{"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:49.896592 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:50.126275 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'pci_requests' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:50.203069 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ab3638cf-7a05-40c3-bbdf-396f27a597bc req-31adeeac-34cb-4d77-b015-2437c07259ed service nova] Releasing lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:50.307241 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:50.308204 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:50.428243 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Found WWN 33000000056741792 for multipath device dm-0 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:03:50.428675 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:50.428873 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] <== connect_volume: return (2042ms) {'type': 'block', 'scsi_wwn': '33000000056741792', 'path': '/dev/dm-0', 'multipath_id': '33000000056741792'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:50.429094 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000056741792', 'path': '/dev/dm-0', 'multipath_id': '33000000056741792'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:03:50.454698 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "d67139dd-a223-46a9-a4da-78945aeb97fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:50.455054 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:50.459445 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:50.628307 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Object Instance<07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed> lazy-loaded attributes: flavor,pci_requests {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:50.628850 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:03:50.628850 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:50.629009 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:50.739167 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94e5a9e97c5a4c659945037d5b76976a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d7587a1e784250a212e256570f1622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:03:50.810581 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:03:50.937238 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1067226247',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverbootfromvolumestablerescuetest-server-1067226247',id=19,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:03:37Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='fb6450727e8a4a3dbb864e0616d363d4',ramdisk_id='',reservation_id='r-pzobb9zb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:37Z,user_data=None,user_id='48172c20aca946a5b61e2dee61b95de7',uuid=0659eeb0-028e-4fe2-9a53-a93ac045cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "vif_mac": "fa:16:3e:22:15:80"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:03:50.937543 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converting VIF {"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "vif_mac": "fa:16:3e:22:15:80"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:50.938430 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:15:80,bridge_name='br-int',has_traffic_filtering=True,id=cd685529-e10d-45ec-a49c-2f642db01ee4,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd685529-e1') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:50.943681 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'pci_devices' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:50.957839 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:03:51.369002 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Successfully created port: 4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:51.375663 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:51.375942 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:51.379370 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:03:51.379540 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Claim successful on node np0000003818 Jun 27 02:03:51.446701 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] End _get_guest_xml xml= Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 0659eeb0-028e-4fe2-9a53-a93ac045cf30 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: instance-00000013 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 196608 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-server-1067226247 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 2026-06-27 02:03:47 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 192 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: True Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: bare Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: ide Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: pc Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: tempest-ServerBootFromVolumeStableRescueTest-1593948765 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 0659eeb0-028e-4fe2-9a53-a93ac045cf30 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 0659eeb0-028e-4fe2-9a53-a93ac045cf30 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: hvm Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 128 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: 40592cc8-a5cf-45d8-823f-dac19e643b2d Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: Jun 27 02:03:51.448436 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:03:51.454733 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance destroyed successfully. Jun 27 02:03:51.512909 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:52.113621 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:52.126213 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Successfully updated port: 4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:52.181604 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-changed-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:52.181719 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Refreshing instance network info cache due to event network-changed-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:52.184281 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] Acquiring lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:52.184281 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] Acquired lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:52.184281 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Refreshing network info cache for port 4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:52.359909 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:52.630367 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:52.635122 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:52.636248 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:03:52.684750 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:52.976549 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:52.976820 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:52.977106 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:52.977181 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] No VIF found with MAC fa:16:3e:22:15:80, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:52.977819 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Using config drive Jun 27 02:03:52.980127 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:52.980473 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:53.138415 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:53.318073 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Added VIF to instance network info cache for port 4f4b4d71-ef20-4372-a86b-caff1ca3dfb9. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3531}} Jun 27 02:03:53.318073 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updating instance_info_cache with network_info: [{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:53.483303 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:53.486284 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:53.542530 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:53.637436 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager.update_available_resource {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:03:53.820720 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-f3d171e4-3c4c-46e4-b58c-bcf06f7a5072 req-4e80571b-63b3-46ca-9391-4f1e09d7915f service nova] Releasing lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:53.821793 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquired lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:53.823266 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:53.997959 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.622s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:54.001676 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:54.002042 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.486s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:54.002342 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:03:54.008715 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'keypairs' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:03:54.014666 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:03:54.015366 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Claim successful on node np0000003818 Jun 27 02:03:54.143415 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:54.352502 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2aaa574f-ed07-4007-ba43-ff1544aaac86 req-3e666c1b-13e2-419c-9dd4-75270010bb9d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-vif-unplugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:54.353193 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2aaa574f-ed07-4007-ba43-ff1544aaac86 req-3e666c1b-13e2-419c-9dd4-75270010bb9d service nova] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:54.353193 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2aaa574f-ed07-4007-ba43-ff1544aaac86 req-3e666c1b-13e2-419c-9dd4-75270010bb9d service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:54.353193 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-2aaa574f-ed07-4007-ba43-ff1544aaac86 req-3e666c1b-13e2-419c-9dd4-75270010bb9d service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:54.353193 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-2aaa574f-ed07-4007-ba43-ff1544aaac86 req-3e666c1b-13e2-419c-9dd4-75270010bb9d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] No waiting events found dispatching network-vif-unplugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:54.353739 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-2aaa574f-ed07-4007-ba43-ff1544aaac86 req-3e666c1b-13e2-419c-9dd4-75270010bb9d service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received unexpected event network-vif-unplugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 for instance with vm_state active and task_state None. Jun 27 02:03:54.442326 np0000003818 nova-compute[98971]: WARNING nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] dc38af2b-7bf6-4066-80b9-546607721753 already exists in list: networks containing: ['dc38af2b-7bf6-4066-80b9-546607721753']. ignoring it Jun 27 02:03:54.442326 np0000003818 nova-compute[98971]: WARNING nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] 4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 already exists in list: port_ids containing: ['4f4b4d71-ef20-4372-a86b-caff1ca3dfb9']. ignoring it Jun 27 02:03:54.512240 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:03:54.513335 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:03:54.513335 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:54.513916 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:54.519329 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:03:54.527865 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:54.691311 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e2709eb59eb45f88196956b2298d596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5794cf82ab843adab5363e39a368501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:03:54.745711 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:54.788192 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Creating config drive at /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config.rescue Jun 27 02:03:54.797886 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9s5ccwnq {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:54.862836 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9s5ccwnq" returned: 0 in 0.065s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:55.036964 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:03:55.247933 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:55.436232 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:55.462329 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:55.469586 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:55.474052 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:55.547191 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:03:55.558443 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updating instance_info_cache with network_info: [{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:55.592628 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:55.710231 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:55.721192 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:55.721192 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:55.887512 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:55.887512 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:56.065801 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Releasing lock "refresh_cache-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:56.075788 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.077614 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941528237',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1941528237',id=17,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkk4dOZVr0+BM/0KtiDI6oSfuPXm6h98+GtKifjjg2AZMju3/O9U4l3soWxnLKttK1cYfyvIg1QjrPmuFx8pjgqWwRPddThD60rOsZ1BMJK0QAJ+8IQ5v38e4beY0VUYg==',key_name='tempest-keypair-698885557',keypairs=,launch_index=0,launched_at=2026-06-27T02:03:10Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83d7587a1e784250a212e256570f1622',ramdisk_id='',reservation_id='r-esxvfb7h',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1290144613',owner_user_name='tempest-TaggedAttachmentsTest-1290144613-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94e5a9e97c5a4c659945037d5b76976a',uuid=07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:03:56.077614 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converting VIF {"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:56.079824 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=4f4b4d71-ef20-4372-a86b-caff1ca3dfb9,network=Network(dc38af2b-7bf6-4066-80b9-546607721753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f4b4d71-ef') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:56.080111 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=4f4b4d71-ef20-4372-a86b-caff1ca3dfb9,network=Network(dc38af2b-7bf6-4066-80b9-546607721753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f4b4d71-ef') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:03:56.086401 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.086841 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:56.087179 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:03:56.089662 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.090076 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b6e6673-d0ca-5499-9985-a677fd360217', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:56.093820 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.096837 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:56.102739 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.103108 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f4b4d71-ef, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:56.103944 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f4b4d71-ef, col_values=(('qos', UUID('ba8e2cf9-f3ce-4f22-9547-2348dfbdb0aa')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:56.103944 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f4b4d71-ef, col_values=(('external_ids', {'iface-id': '4f4b4d71-ef20-4372-a86b-caff1ca3dfb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:f9:9d', 'vm-uuid': '07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:03:56.107823 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.109941 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:03:56.118698 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.121237 np0000003818 nova-compute[98971]: INFO os_vif [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=4f4b4d71-ef20-4372-a86b-caff1ca3dfb9,network=Network(dc38af2b-7bf6-4066-80b9-546607721753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f4b4d71-ef') Jun 27 02:03:56.122275 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941528237',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1941528237',id=17,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkk4dOZVr0+BM/0KtiDI6oSfuPXm6h98+GtKifjjg2AZMju3/O9U4l3soWxnLKttK1cYfyvIg1QjrPmuFx8pjgqWwRPddThD60rOsZ1BMJK0QAJ+8IQ5v38e4beY0VUYg==',key_name='tempest-keypair-698885557',keypairs=,launch_index=0,launched_at=2026-06-27T02:03:10Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83d7587a1e784250a212e256570f1622',ramdisk_id='',reservation_id='r-esxvfb7h',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1290144613',owner_user_name='tempest-TaggedAttachmentsTest-1290144613-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94e5a9e97c5a4c659945037d5b76976a',uuid=07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:03:56.124874 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converting VIF {"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:03:56.124874 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=4f4b4d71-ef20-4372-a86b-caff1ca3dfb9,network=Network(dc38af2b-7bf6-4066-80b9-546607721753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f4b4d71-ef') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] attach device xml: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: Jun 27 02:03:56.127000 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:03:56.141963 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.175666 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Successfully created port: 8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:56.222380 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.230936 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:03:56.346712 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.393186 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:56.577742 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:56.579007 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:56.580886 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:03:56.582308 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:03:56.582539 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Creating image(s) Jun 27 02:03:56.583002 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:56.583158 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "/opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:56.583584 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "/opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:56.585375 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:56.597803 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:56.601645 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:56.640882 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.650048 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.678083 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.679579 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:56.718953 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.118s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:56.720532 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:56.721239 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:56.721885 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:56.728233 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:56.728642 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:56.757794 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:56.832100 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:56.832450 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:56.856332 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:56.896860 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk 1073741824" returned: 0 in 0.064s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:56.897591 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.176s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:56.897670 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:56.923728 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for 0659eeb0-028e-4fe2-9a53-a93ac045cf30 due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:03:56.924134 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:56.924363 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Resumed (Lifecycle Event) Jun 27 02:03:56.937607 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.939s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:56.938458 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:03:56.946984 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.803s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:56.947271 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:56.947917 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Auditing locally available compute resources for np0000003818 (node: np0000003818) {{(pid=98971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 27 02:03:56.950154 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.095s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:56.959901 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:03:56.962577 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Claim successful on node np0000003818 Jun 27 02:03:56.965626 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c6531f91-265b-4305-9020-45f52066811c tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:57.027061 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.128s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:57.027613 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:03:57.028556 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:57.101284 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Detaching volume db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 Jun 27 02:03:57.166125 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Attempting to driver detach volume db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 from mountpoint /dev/vdb Jun 27 02:03:57.168547 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:57.170076 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Cannot resize image /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:03:57.170537 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:03:57.170882 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Ensure instance console log exists: /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:03:57.171567 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:57.171567 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:57.171812 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:57.174296 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Found disk vdb by alias ua-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:03:57.178506 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Found disk vdb by alias ua-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:03:57.178506 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Attempting to detach device vdb from instance e71ace91-8cd6-4723-8c23-58ac2e0101dc from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] detach device xml: Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]:
Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: Jun 27 02:03:57.179350 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:03:57.190852 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Successfully detached device vdb from instance e71ace91-8cd6-4723-8c23-58ac2e0101dc from the persistent domain config. Jun 27 02:03:57.191089 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] (1/8): Attempting to detach device vdb with device alias ua-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 from instance e71ace91-8cd6-4723-8c23-58ac2e0101dc from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] detach device xml: Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]:
Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: Jun 27 02:03:57.191519 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:03:57.363507 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:03:57.436929 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:57.442749 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:57.463350 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:03:57.463350 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:03:57.463969 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:57.463969 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:57.534254 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Successfully updated port: 8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:57.614578 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Received event network-changed-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:57.615098 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Refreshing instance network info cache due to event network-changed-8573d035-eddd-4d58-8de1-5154aed06703. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:03:57.615387 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] Acquiring lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:57.615462 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] Acquired lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:57.615734 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Refreshing network info cache for port 8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:03:57.620831 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59e076ee8a5642f288724654a145b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30ec721e042b98cd1456baeea0208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:03:57.895515 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:57.895669 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:03:57.896449 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No VIF found with MAC fa:16:3e:75:71:dd, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:03:57.907288 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 for instance e71ace91-8cd6-4723-8c23-58ac2e0101dc {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:03:57.947142 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:03:57.947142 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Started (Lifecycle Event) Jun 27 02:03:57.968906 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:03:58.041682 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:03:58.094033 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.132860 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:03:58.212953 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.213950 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.264148 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:03:58.293193 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Successfully created port: 1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:03:58.326279 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.331253 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.412186 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1941528237', uuid='07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed'), owner=OwnerMeta(userid='94e5a9e97c5a4c659945037d5b76976a', username='tempest-TaggedAttachmentsTest-1290144613-project-member', projectid='83d7587a1e784250a212e256570f1622', projectname='tempest-TaggedAttachmentsTest-1290144613'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f579f943-1d22-4d13-8bbf-48081110ed26", "address": "fa:16:3e:75:71:dd", "network": {"id": "adc23d27-59ec-4784-a58d-f239e38d9ad4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-999048705-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf579f943-1d", "ovs_interfaceid": "f579f943-1d22-4d13-8bbf-48081110ed26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525838.4074078) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] set metadata xml: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: tempest-device-tagging-server-1941528237 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 2026-06-27 02:03:58 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 192 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: True Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: bare Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 1 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: 0 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: ide Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: pc Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: virtio Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: tempest-TaggedAttachmentsTest-1290144613-project-member Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: tempest-TaggedAttachmentsTest-1290144613 Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: Jun 27 02:03:58.421472 np0000003818 nova-compute[98971]: {{(pid=98971) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jun 27 02:03:58.450047 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:03:58.451230 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.451230 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.487466 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:03:58.492993 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:03:58.569327 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb34ff8-b41d-47ea-ae36-a583b5bc32ad/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.574893 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:03:58.578880 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 27 02:03:58.579521 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.692508 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.rescue --force-share --output=json" returned: 0 in 0.112s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.695171 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.rescue --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.781480 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:03:58.806932 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0016078199998901255 future=) was cancelled during its delay period, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:58.806932 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:03:58.833938 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0659eeb0-028e-4fe2-9a53-a93ac045cf30/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.838763 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:58.932155 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-1fc4e8ea-6eaf-4a77-ae24-9f6d221c6413 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "interface-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 9.539s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:58.959137 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:58.960318 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:59.007146 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:03:59.024676 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:03:59.024997 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:03:59.044112 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Successfully detached device vdb from instance e71ace91-8cd6-4723-8c23-58ac2e0101dc from the live domain config. Jun 27 02:03:59.047739 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:03:59.048291 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:03:59.048679 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:03:59.051023 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:03:59.051023 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:03:59.051023 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:03:59.064355 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:59.077798 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:59.114565 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3 (non-flash) Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', '42')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:03:59.116314 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', '42')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:03:59.120195 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', '41')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:03:59.121421 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Resulting device map defaultdict(. at 0x7decc0315300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'): ({'sdf'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:03:59.123120 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Removing multipathed devices sdf, sdg {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:03:59.124659 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Flush multipath device 330000000be2ceaa7 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:03:59.185087 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:03:59.217489 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:59.218730 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:59.246895 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:03:59.286011 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b598ea92-12c7-4ddd-bbdc-282c16eb96c1 req-5ff8304a-2986-4956-957f-f17631a5903b service nova] Releasing lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:03:59.288183 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquired lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:03:59.288183 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:03:59.301425 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:03:59.302355 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:03:59.304490 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:03:59.316765 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:03:59.317130 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:03:59.332423 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:59.341690 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Successfully updated port: 1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:03:59.351821 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24314451-30b5-4e28-a144-5dc2c9ceb1ca/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:59.356595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:59.384411 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.40.100,3260] Jun 27 02:03:59.384411 np0000003818 nova-compute[98971]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.40.100,3260] successful. Jun 27 02:03:59.384411 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:59.404696 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:59.423719 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:59.456237 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c8cad944-e42b-4ed1-9a0a-48d353b11e6e req-a0954c10-aa93-47d1-aeb9-eebdbb0fdef1 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:03:59.459068 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c8cad944-e42b-4ed1-9a0a-48d353b11e6e req-a0954c10-aa93-47d1-aeb9-eebdbb0fdef1 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:59.459754 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:03:59.463075 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c8cad944-e42b-4ed1-9a0a-48d353b11e6e req-a0954c10-aa93-47d1-aeb9-eebdbb0fdef1 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:59.464372 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:03:59.483389 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-c8cad944-e42b-4ed1-9a0a-48d353b11e6e req-a0954c10-aa93-47d1-aeb9-eebdbb0fdef1 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:59.483389 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-c8cad944-e42b-4ed1-9a0a-48d353b11e6e req-a0954c10-aa93-47d1-aeb9-eebdbb0fdef1 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:03:59.483389 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-c8cad944-e42b-4ed1-9a0a-48d353b11e6e req-a0954c10-aa93-47d1-aeb9-eebdbb0fdef1 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:03:59.485631 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.50.100,3260] Jun 27 02:03:59.485631 np0000003818 nova-compute[98971]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, portal: 192.168.50.100,3260] successful. Jun 27 02:03:59.485631 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:59.511826 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:03:59.511826 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:03:59.511826 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] <== disconnect_volume: return (462ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:03:59.511826 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:03:59.540682 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:03:59.542540 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:03:59.542540 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Creating image(s) Jun 27 02:03:59.543259 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "/opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:03:59.544270 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "/opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:03:59.544270 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "/opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:03:59.546923 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:59.557550 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:03:59.557550 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:03:59.578431 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Unrescuing Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquired lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba18d1c-6f32-4dd9-8d18-30492aafea37/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Hypervisor/Node resource view: name=np0000003818 free_ram=50352MB free_disk=73.96474075317383GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.131s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received event network-changed-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Refreshing instance network info cache due to event network-changed-1b03f020-91d2-47a4-bab8-1434e42eaa12. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] Acquiring lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] Acquired lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:00.347152 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Refreshing network info cache for port 1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.123s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk 1073741824" returned: 0 in 0.090s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.225s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.114s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.142s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.403s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Cannot resize image /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Ensure instance console log exists: /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lazy-loading 'flavor' on Instance uuid e71ace91-8cd6-4723-8c23-58ac2e0101dc {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:00.350144 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:00.394168 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:00.418643 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:00.613768 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:04:00.615428 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:04:00.622096 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:00.622096 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:00.726578 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Updating instance_info_cache with network_info: [{"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:00.779499 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'flavor' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:00.791094 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:00.798962 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:00.935062 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '419cd4dbc6e740dfbc01f17626fc1de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e414b5eb7f924ed78df62a5e770d9cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:04:01.095779 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Updating instance_info_cache with network_info: [{"id": "cd685529-e10d-45ec-a49c-2f642db01ee4", "address": "fa:16:3e:22:15:80", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd685529-e1", "ovs_interfaceid": "cd685529-e10d-45ec-a49c-2f642db01ee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:01.108321 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.128354 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:04:01.202596 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance e71ace91-8cd6-4723-8c23-58ac2e0101dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.202836 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 24314451-30b5-4e28-a144-5dc2c9ceb1ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.203590 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 5ba18d1c-6f32-4dd9-8d18-30492aafea37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.203590 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.203590 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance b7527d95-c6ec-4fa4-bfbd-1c0caa3f04eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 0659eeb0-028e-4fe2-9a53-a93ac045cf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 6a779d38-7dc5-4cfb-b2bc-788a72f4544d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance d67139dd-a223-46a9-a4da-78945aeb97fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Instance 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 27 02:04:01.205642 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Final resource view: name=np0000003818 phys_ram=64301MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:03:59 up 32 min, 2 users, load average: 11.55, 8.16, 4.06\n', 'num_instances': '10', 'num_vm_active': '6', 'num_task_deleting': '1', 'num_os_type_None': '10', 'num_proj_9df8f123bc7c456c8acd8f2c8eb3897b': '1', 'io_workload': '3', 'num_task_None': '6', 'num_proj_fb6450727e8a4a3dbb864e0616d363d4': '2', 'num_proj_11a30ec721e042b98cd1456baeea0208': '2', 'num_proj_83d7587a1e784250a212e256570f1622': '1', 'num_proj_a5794cf82ab843adab5363e39a368501': '3', 'num_vm_rescued': '1', 'num_task_unrescuing': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_e414b5eb7f924ed78df62a5e770d9cad': '1'} {{(pid=98971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 27 02:04:01.207854 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-ff271f19-8132-457d-9fa7-3870a61feb38 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.629s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:01.211134 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 4.451s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:01.212297 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:01.212297 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:01.212297 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:01.218778 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Terminating instance Jun 27 02:04:01.232008 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Releasing lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:01.232008 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Instance network_info: |[{"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:04:01.233416 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Start _get_guest_xml network_info=[{"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:04:01.239519 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:04:01.242713 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='6a779d38-7dc5-4cfb-b2bc-788a72f4544d'), owner=OwnerMeta(userid='5e2709eb59eb45f88196956b2298d596', username='tempest-AttachVolumeMultiAttachTest-1200701507-project-member', projectid='a5794cf82ab843adab5363e39a368501', projectname='tempest-AttachVolumeMultiAttachTest-1200701507'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525841.2405655) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:04:01.248858 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:04:01.248858 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:04:01.252233 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:04:01.252427 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:04:01.254061 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:04:01.254215 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:04:01.255524 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:04:01.255524 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:04:01.255524 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:04:01.255524 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:04:01.255524 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:04:01.255802 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:04:01.255802 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:04:01.255802 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:04:01.255930 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:04:01.258089 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:04:01.292031 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='multiattach-server-1',id=21,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl3GQnnd3WW2gRHiVxQWMFGNfe/yctQr6Z+QvmmVT0l/tOK5WbrYGrI49O0USeM4fwDg1N74DvUaqSqYL/LeIlc7oWDyFebhBQP+lduF3aGoDiQ6DLoM0v7QDzerDxXjw==',key_name='tempest-keypair-386126037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5794cf82ab843adab5363e39a368501',ramdisk_id='',reservation_id='r-qniych8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1200701507',owner_user_name='tempest-AttachVolumeMultiAttachTest-1200701507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2709eb59eb45f88196956b2298d596',uuid=6a779d38-7dc5-4cfb-b2bc-788a72f4544d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:04:01.299647 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converting VIF {"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:01.299647 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:3c:4c,bridge_name='br-int',has_traffic_filtering=True,id=8573d035-eddd-4d58-8de1-5154aed06703,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8573d035-ed') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:01.299950 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a779d38-7dc5-4cfb-b2bc-788a72f4544d {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:01.301917 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-4a0836ff-526e-47e3-aa01-c7e5fe0d83ac req-4320ef02-d808-496d-b1c6-5d3cc7def396 service nova] Releasing lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:01.304881 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquired lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:01.304881 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:04:01.584908 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-28aa83b8-2a40-44a9-9e99-0773f1ed5687 req-e245bf39-f9ca-4085-b173-923aa8087b57 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:01.585750 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-28aa83b8-2a40-44a9-9e99-0773f1ed5687 req-e245bf39-f9ca-4085-b173-923aa8087b57 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:01.586239 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-28aa83b8-2a40-44a9-9e99-0773f1ed5687 req-e245bf39-f9ca-4085-b173-923aa8087b57 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:01.586502 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-28aa83b8-2a40-44a9-9e99-0773f1ed5687 req-e245bf39-f9ca-4085-b173-923aa8087b57 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:01.587098 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-28aa83b8-2a40-44a9-9e99-0773f1ed5687 req-e245bf39-f9ca-4085-b173-923aa8087b57 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:01.587098 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-28aa83b8-2a40-44a9-9e99-0773f1ed5687 req-e245bf39-f9ca-4085-b173-923aa8087b57 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state rescued and task_state unrescuing. Jun 27 02:04:01.597712 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Releasing lock "refresh_cache-0659eeb0-028e-4fe2-9a53-a93ac045cf30" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:01.599086 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'flavor' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:01.641538 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:04:01.725685 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:04:01.771935 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.786914 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.786914 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Successfully created port: 78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:04:01.803312 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.531s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:01.810587 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] End _get_guest_xml xml= Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: instance-00000015 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 196608 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: multiattach-server-1 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 2026-06-27 02:04:01 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 192 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: True Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: bare Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-1200701507-project-member Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: tempest-AttachVolumeMultiAttachTest-1200701507 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: hvm Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 128 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: Jun 27 02:04:01.820376 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Preparing to wait for external event network-vif-plugged-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='multiattach-server-1',id=21,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl3GQnnd3WW2gRHiVxQWMFGNfe/yctQr6Z+QvmmVT0l/tOK5WbrYGrI49O0USeM4fwDg1N74DvUaqSqYL/LeIlc7oWDyFebhBQP+lduF3aGoDiQ6DLoM0v7QDzerDxXjw==',key_name='tempest-keypair-386126037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5794cf82ab843adab5363e39a368501',ramdisk_id='',reservation_id='r-qniych8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1200701507',owner_user_name='tempest-AttachVolumeMultiAttachTest-1200701507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e2709eb59eb45f88196956b2298d596',uuid=6a779d38-7dc5-4cfb-b2bc-788a72f4544d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converting VIF {"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:3c:4c,bridge_name='br-int',has_traffic_filtering=True,id=8573d035-eddd-4d58-8de1-5154aed06703,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8573d035-ed') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:3c:4c,bridge_name='br-int',has_traffic_filtering=True,id=8573d035-eddd-4d58-8de1-5154aed06703,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8573d035-ed') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.826405 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3217a298-1d45-5111-a3ec-a1a7668d6342', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:01.828384 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.829326 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:01.837611 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.846216 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.846216 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8573d035-ed, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:01.846216 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8573d035-ed, col_values=(('qos', UUID('35c7ee1f-1d06-4b9c-80d4-8e4e45e85cc1')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:01.846395 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8573d035-ed, col_values=(('external_ids', {'iface-id': '8573d035-eddd-4d58-8de1-5154aed06703', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:3c:4c', 'vm-uuid': '6a779d38-7dc5-4cfb-b2bc-788a72f4544d'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:01.851037 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:01.865832 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:01.871211 np0000003818 nova-compute[98971]: INFO os_vif [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:3c:4c,bridge_name='br-int',has_traffic_filtering=True,id=8573d035-eddd-4d58-8de1-5154aed06703,network=Network(b046f79f-84e9-405a-b1c3-c3d9b3a28a76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8573d035-ed') Jun 27 02:04:01.906777 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.028121 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:02.062539 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:04:02.062539 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:04:02.074368 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.093328 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.104557 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999509829999852 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:02.105041 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999059634999867 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:02.105117 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99888007200002 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:02.107525 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Instance destroyed successfully. Jun 27 02:04:02.108095 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lazy-loading 'resources' on Instance uuid e71ace91-8cd6-4723-8c23-58ac2e0101dc {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:02.164677 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.167760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.193915 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.354102 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.379644 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.470763 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.489602 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.999694944000112 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:02.494828 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Instance destroyed successfully. Jun 27 02:04:02.495429 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'numa_topology' on Instance uuid 0659eeb0-028e-4fe2-9a53-a93ac045cf30 {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:02.518726 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.564700 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:04:02.612092 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-383563192',display_name='tempest-VolumesSnapshotTestJSON-instance-383563192',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumessnapshottestjson-instance-383563192',id=14,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs+oNWgWobyekuuFjBsQyk6D8N+jaRsxsYoUGaW6mmd2sVA1tr/DduodEseHg5nzwYJ0jMPNYlDaI+8zSGVj5IMpNxjEhzZoB0Q1shG6RYNuBuo0QtyhsM9pLU2FbhFQw==',key_name='tempest-keypair-1182090929',keypairs=,launch_index=0,launched_at=2026-06-27T02:02:59Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9df8f123bc7c456c8acd8f2c8eb3897b',ramdisk_id='',reservation_id='r-lvix3pnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1671669051',owner_user_name='tempest-VolumesSnapshotTestJSON-1671669051-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4788dadfeb774abf9fee57347b923c89',uuid=e71ace91-8cd6-4723-8c23-58ac2e0101dc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:04:02.612378 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Converting VIF {"id": "21ce8e42-2991-4b03-b851-02161a45c5e5", "address": "fa:16:3e:c8:dd:54", "network": {"id": "8d5e1bb1-c12c-411b-b573-cc32f686487f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-224696104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9df8f123bc7c456c8acd8f2c8eb3897b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce8e42-29", "ovs_interfaceid": "21ce8e42-2991-4b03-b851-02161a45c5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:02.614099 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:02.614099 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:04:02.617370 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.632372 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21ce8e42-29, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:02.632372 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.632372 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:02.639550 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.642174 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.642509 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.643081 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9219a68e-bdc7-4ef0-83ba-a9f770f0248d) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:02.643455 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.645154 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:02.652148 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:04:02.653159 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:04:02.653159 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Creating image(s) Jun 27 02:04:02.655281 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:02.655281 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "/opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:02.655752 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "/opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:02.656231 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:02.660558 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:02.662683 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:02.679140 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.689017 np0000003818 nova-compute[98971]: INFO os_vif [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:dd:54,bridge_name='br-int',has_traffic_filtering=True,id=21ce8e42-2991-4b03-b851-02161a45c5e5,network=Network(8d5e1bb1-c12c-411b-b573-cc32f686487f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce8e42-29') Jun 27 02:04:02.696312 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:04:02.697228 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:04:02.697857 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:02.698321 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:02.698881 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:04:02.699166 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:04:02.721094 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Successfully updated port: 78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:04:02.722745 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.734273 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:02.734273 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:02.734273 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:02.734273 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:02.734273 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:02.734628 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:02.734628 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:02.734628 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:02.734628 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:02.734628 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:02.734715 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', '40')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:04:02.734793 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, 0): [] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:04:02.736119 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3') {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 27 02:04:02.736119 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3, 0): [] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:04:02.736119 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db5d6170-eadc-4cec-9c3a-94cce7f0b8b3') {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 27 02:04:02.736119 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Resulting device map defaultdict(. at 0x7decc82423e0>, {}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:04:02.736119 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Disconnecting from: [] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:04:02.736425 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.038s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:02.736425 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] <== disconnect_volume: return (38ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:04:02.736960 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:04:02.737172 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Deleting instance files /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc_del Jun 27 02:04:02.739239 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:02.760881 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Deletion of /opt/stack/data/nova/instances/e71ace91-8cd6-4723-8c23-58ac2e0101dc_del complete Jun 27 02:04:02.780363 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.117s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:02.780943 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:02.781961 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:02.782529 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:02.790295 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:02.790760 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:02.837369 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-changed-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:02.837719 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Refreshing instance network info cache due to event network-changed-78731939-6ca9-4d4e-993e-9f82727687dd. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:04:02.839630 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] Acquiring lock "refresh_cache-6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:02.839782 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] Acquired lock "refresh_cache-6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:02.840324 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Refreshing network info cache for port 78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:04:02.890049 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.099s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:02.891276 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:02.938159 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-000ea98c-878d-4574-8da4-f9338bd514ae req-5bdf28df-6cee-4929-be8d-0f8083d39472 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-vif-plugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:02.938795 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-000ea98c-878d-4574-8da4-f9338bd514ae req-5bdf28df-6cee-4929-be8d-0f8083d39472 service nova] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:02.939670 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-000ea98c-878d-4574-8da4-f9338bd514ae req-5bdf28df-6cee-4929-be8d-0f8083d39472 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:02.939929 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-000ea98c-878d-4574-8da4-f9338bd514ae req-5bdf28df-6cee-4929-be8d-0f8083d39472 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:02.940261 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-000ea98c-878d-4574-8da4-f9338bd514ae req-5bdf28df-6cee-4929-be8d-0f8083d39472 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] No waiting events found dispatching network-vif-plugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:02.940535 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-000ea98c-878d-4574-8da4-f9338bd514ae req-5bdf28df-6cee-4929-be8d-0f8083d39472 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received unexpected event network-vif-plugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 for instance with vm_state active and task_state None. Jun 27 02:04:02.954306 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:02.980924 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:02.980924 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:02.981146 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Attaching volume eafac743-0e39-4886-8ccb-1eccf0a05414 to /dev/vdb Jun 27 02:04:02.988817 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.000040 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk 1073741824" returned: 0 in 0.102s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:03.000040 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.211s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:03.000040 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:03.029803 np0000003818 nova-compute[98971]: DEBUG nova.objects.base [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Object Instance<0659eeb0-028e-4fe2-9a53-a93ac045cf30> lazy-loaded attributes: flavor,numa_topology {{(pid=98971) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 27 02:04:03.047779 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.076558 np0000003818 nova-compute[98971]: DEBUG nova.compute.resource_tracker [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Compute_service record updated for np0000003818:np0000003818 {{(pid=98971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 27 02:04:03.076893 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.975s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:03.077853 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:04:03.114484 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:04:03.120140 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.126s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:03.122874 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:04:03.126172 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:03.159161 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:04:03.199914 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:03.229595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "refresh_cache-6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:03.244942 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:03.245485 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Cannot resize image /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:04:03.246134 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:04:03.246346 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Ensure instance console log exists: /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:04:03.246701 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:03.246918 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:03.247124 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:03.258837 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:04:03.259366 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:04:03.267943 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Took 1.54 seconds to destroy the instance on the hypervisor. Jun 27 02:04:03.269227 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:04:03.269923 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:04:03.270408 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:04:03.271066 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:03.274230 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:04:03.276007 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe87:9ee6', 'fe80::b8bb:79ff:fef8:7cc8', 'fe80::fc16:3eff:fe0f:9a13', 'fe80::3c5f:2aff:fe42:e4a2', 'fe80::fc16:3eff:fe75:71dd', 'fe80::c13:9cff:febe:6408', 'fe80::fc16:3eff:fe13:bb6e', 'fe80::14f4:d5ff:fe2f:6a47', 'fe80::fc16:3eff:fea8:a68e', 'fe80::fc16:3eff:fe1f:f99d', 'fe80::e44f:3aff:fe85:19ee'] Jun 27 02:04:03.277558 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:04:03.277558 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:04:03.280455 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:04:03.280759 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Updating existing volume attachment record: 6f86d9bd-b662-491a-822b-af3c2ef4f2f2 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:04:03.343761 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:03.390896 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Updating instance_info_cache with network_info: [{"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:03.439638 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:03.439638 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:03.439638 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] No VIF found with MAC fa:16:3e:bc:3c:4c, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:04:03.439875 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Using config drive Jun 27 02:04:03.471724 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:03.562153 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:03.620562 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.660918 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.662965 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.714392 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:03.742241 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.839803 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.849397 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:03.889233 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:04:03.889804 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafac743-0e39-4886-8ccb-1eccf0a05414', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:04:03.890076 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:03.890592 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:03.891051 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafac743-0e39-4886-8ccb-1eccf0a05414', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:04:03.900017 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Releasing lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:03.900017 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Instance network_info: |[{"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:04:03.900017 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Start _get_guest_xml network_info=[{"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:04:03.903624 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:04:03.905158 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-85112167', uuid='d67139dd-a223-46a9-a4da-78945aeb97fa'), owner=OwnerMeta(userid='59e076ee8a5642f288724654a145b455', username='tempest-ServerActionsTestOtherA-2022980580-project-member', projectid='11a30ec721e042b98cd1456baeea0208', projectname='tempest-ServerActionsTestOtherA-2022980580'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525843.9047568) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:04:03.906532 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:04:03.907691 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:03.907886 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:04:03.908618 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:03.909379 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:03.909379 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:04:03.909379 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:03.909379 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:04:03.909379 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:04:03.911832 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:04:03.913012 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:04:03.913360 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:04:03.913544 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:04:03.913669 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:04:03.916134 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:04:03.929305 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:04:03.929305 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:03.930864 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:04:03.930864 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:03.935408 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-85112167',display_name='tempest-tempest.common.compute-instance-85112167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-tempest-common-compute-instance-85112167',id=22,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApbLWclcHrj7n7yvnQdOCHo+EKCb36KCEqCGT5L/suiDfj+cWOg9UjpT0eIkW4kRGHx1zI1HqJ8XmbwRkOeCOzMnpiapgNRb20l851gP4dL0TSucn5e7bQUkij0xCVsoA==',key_name='tempest-keypair-518710627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30ec721e042b98cd1456baeea0208',ramdisk_id='',reservation_id='r-6h30pvgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2022980580',owner_user_name='tempest-ServerActionsTestOtherA-2022980580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e076ee8a5642f288724654a145b455',uuid=d67139dd-a223-46a9-a4da-78945aeb97fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:04:03.935408 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converting VIF {"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:03.937262 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ac:f4,bridge_name='br-int',has_traffic_filtering=True,id=1b03f020-91d2-47a4-bab8-1434e42eaa12,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b03f020-91') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:03.937262 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lazy-loading 'pci_devices' on Instance uuid d67139dd-a223-46a9-a4da-78945aeb97fa {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:03.955903 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414] added Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:03.960223 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:04:03.963677 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0528(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:04:03.964142 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414] added Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:03.964723 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:03.964953 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:04:03.965637 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0544(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:04:03.965637 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:04:04.077798 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:04:04.078612 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:04:04.079324 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:04:04.079618 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:04:04.088486 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:04:04.089340 np0000003818 nova-compute[98971]: DEBUG oslo_service.periodic_task [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 02:04:04.090223 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 27 02:04:04.090223 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._threading.loopingcall [None req-0f78058c-aa4e-4d5b-882d-ac46a887241c None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.56 seconds {{(pid=98971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 27 02:04:04.185996 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Creating config drive at /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk.config Jun 27 02:04:04.190856 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvt_efh7x {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:04.223376 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-debf570e-0f5c-4e4b-b3a7-9f7603ebf859 req-f148f8fd-941c-4865-8eca-f60cdbb90536 service nova] Releasing lock "refresh_cache-6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:04.225751 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquired lock "refresh_cache-6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:04.229706 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:04:04.270684 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a779d38-7dc5-4cfb-b2bc-788a72f4544d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvt_efh7x" returned: 0 in 0.080s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] End _get_guest_xml xml= Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: d67139dd-a223-46a9-a4da-78945aeb97fa Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: instance-00000016 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 196608 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: tempest-tempest.common.compute-instance-85112167 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 2026-06-27 02:04:03 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 192 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: True Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: bare Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherA-2022980580-project-member Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: tempest-ServerActionsTestOtherA-2022980580 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: d67139dd-a223-46a9-a4da-78945aeb97fa Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: d67139dd-a223-46a9-a4da-78945aeb97fa Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: hvm Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 128 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: Jun 27 02:04:04.441927 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Preparing to wait for external event network-vif-plugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Acquiring lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-85112167',display_name='tempest-tempest.common.compute-instance-85112167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-tempest-common-compute-instance-85112167',id=22,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApbLWclcHrj7n7yvnQdOCHo+EKCb36KCEqCGT5L/suiDfj+cWOg9UjpT0eIkW4kRGHx1zI1HqJ8XmbwRkOeCOzMnpiapgNRb20l851gP4dL0TSucn5e7bQUkij0xCVsoA==',key_name='tempest-keypair-518710627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a30ec721e042b98cd1456baeea0208',ramdisk_id='',reservation_id='r-6h30pvgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2022980580',owner_user_name='tempest-ServerActionsTestOtherA-2022980580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e076ee8a5642f288724654a145b455',uuid=d67139dd-a223-46a9-a4da-78945aeb97fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converting VIF {"id": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "address": "fa:16:3e:fb:ac:f4", "network": {"id": "3e14621d-8a20-4408-a5c4-88defa29c2c2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-420343261-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11a30ec721e042b98cd1456baeea0208", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b03f020-91", "ovs_interfaceid": "1b03f020-91d2-47a4-bab8-1434e42eaa12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ac:f4,bridge_name='br-int',has_traffic_filtering=True,id=1b03f020-91d2-47a4-bab8-1434e42eaa12,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b03f020-91') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ac:f4,bridge_name='br-int',has_traffic_filtering=True,id=1b03f020-91d2-47a4-bab8-1434e42eaa12,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b03f020-91') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.448747 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:04.449377 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:04:04.450382 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.451202 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53fd8c3a-2da8-5523-886b-982599d23162', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:04.452126 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.453067 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:04.462648 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.467962 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.468293 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b03f020-91, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:04.469750 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b03f020-91, col_values=(('qos', UUID('0e02c0c6-5b20-4de9-b2d2-0b2a4599b589')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:04.469750 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b03f020-91, col_values=(('external_ids', {'iface-id': '1b03f020-91d2-47a4-bab8-1434e42eaa12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:ac:f4', 'vm-uuid': 'd67139dd-a223-46a9-a4da-78945aeb97fa'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:04.470452 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.472077 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:04.491591 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.493452 np0000003818 nova-compute[98971]: INFO os_vif [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ac:f4,bridge_name='br-int',has_traffic_filtering=True,id=1b03f020-91d2-47a4-bab8-1434e42eaa12,network=Network(3e14621d-8a20-4408-a5c4-88defa29c2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b03f020-91') Jun 27 02:04:04.878712 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:04.896188 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.899867 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b28aca55-13c3-443a-8776-fe2891206be4 req-dc0e315f-5070-48cf-a1d6-9c3a9ebaf66a service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-vif-deleted-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:04.900144 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-b28aca55-13c3-443a-8776-fe2891206be4 req-dc0e315f-5070-48cf-a1d6-9c3a9ebaf66a service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Neutron deleted interface 21ce8e42-2991-4b03-b851-02161a45c5e5; detaching it from the instance and deleting it from the info cache Jun 27 02:04:04.903752 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b28aca55-13c3-443a-8776-fe2891206be4 req-dc0e315f-5070-48cf-a1d6-9c3a9ebaf66a service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Detach interface failed, port_id=21ce8e42-2991-4b03-b851-02161a45c5e5, reason: Instance e71ace91-8cd6-4723-8c23-58ac2e0101dc could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:04:04.936244 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.942042 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:04.965107 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:04:04.967334 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:04:04.984198 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:04:04.993558 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.004148 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.020773 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.032554 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:05.050530 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.050530 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.050530 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.050530 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.050530 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:05.050748 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.050748 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.050748 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.050748 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.050748 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:05.054798 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:05.074606 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received event network-vif-plugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:05.076858 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:05.076858 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:05.076858 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:05.076858 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] No waiting events found dispatching network-vif-plugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:05.077487 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Received unexpected event network-vif-plugged-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9 for instance with vm_state active and task_state None. Jun 27 02:04:05.077939 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received event network-vif-unplugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:05.078532 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Acquiring lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] No event matching network-vif-unplugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 in dict_keys([('network-vif-plugged', '1b03f020-91d2-47a4-bab8-1434e42eaa12')]) {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received unexpected event network-vif-unplugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 for instance with vm_state building and task_state spawning. Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-vif-unplugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Acquiring lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] No waiting events found dispatching network-vif-unplugged-21ce8e42-2991-4b03-b851-02161a45c5e5 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:05.083768 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-157b46dc-ccf0-487f-9249-99faab5d376e req-a03f66a2-4554-40f1-b28f-5b81648e4228 service nova] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Received event network-vif-unplugged-21ce8e42-2991-4b03-b851-02161a45c5e5 for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:04:05.107601 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.40.100,3260] Jun 27 02:04:05.107601 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.40.100,3260] successful. Jun 27 02:04:05.107601 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.118383 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.50.100,3260] Jun 27 02:04:05.118383 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.50.100,3260] successful. Jun 27 02:04:05.118383 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.128346 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.141809 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:05.151612 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.153084 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:05.153492 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.244s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:05.155837 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:04:05.155837 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] HCTL ('11', '-', '-', 0) found on session 43 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:04:05.155837 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:04:05.162092 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.260s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] HCTL ('12', '-', '-', 0) found on session 44 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:04:05.176823 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:04:05.191254 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Searching for a device in session 43 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:04:05.191254 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafac743-0e39-4886-8ccb-1eccf0a05414', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:04:05.203904 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Searching for a device in session 44 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:04:05.204483 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eafac743-0e39-4886-8ccb-1eccf0a05414', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:04:05.231201 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:05.260832 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Removed pending STOPPED event for 0659eeb0-028e-4fe2-9a53-a93ac045cf30 due to new event Resumed> {{(pid=98971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 27 02:04:05.260832 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:05.260832 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Resumed (Lifecycle Event) Jun 27 02:04:05.266271 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-8cc63901-7b18-4cb0-9fc5-4d36ea7212ce tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:05.337119 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:05.504770 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-20cd629e-6ccd-47ce-8813-fded96aaefa0 req-07c59232-ce28-454e-a106-2371cd84ce34 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Received event network-vif-plugged-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:05.504770 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-20cd629e-6ccd-47ce-8813-fded96aaefa0 req-07c59232-ce28-454e-a106-2371cd84ce34 service nova] Acquiring lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:05.504770 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-20cd629e-6ccd-47ce-8813-fded96aaefa0 req-07c59232-ce28-454e-a106-2371cd84ce34 service nova] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:05.504770 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-20cd629e-6ccd-47ce-8813-fded96aaefa0 req-07c59232-ce28-454e-a106-2371cd84ce34 service nova] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:05.506066 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-20cd629e-6ccd-47ce-8813-fded96aaefa0 req-07c59232-ce28-454e-a106-2371cd84ce34 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Processing event network-vif-plugged-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:04:05.529476 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Updating instance_info_cache with network_info: [{"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:05.757757 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:05.761722 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:05.841652 np0000003818 nova-compute[98971]: INFO nova.compute.manager [-] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Took 2.57 seconds to deallocate network for instance. Jun 27 02:04:05.860695 np0000003818 nova-compute[98971]: WARNING nova.volume.cinder [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Attachment f542463c-dcba-4d74-92e2-52fa44c07e29 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f542463c-dcba-4d74-92e2-52fa44c07e29. (HTTP 404) (Request-ID: req-22093e04-56cd-4657-9a4e-b44d3ff189be) Jun 27 02:04:05.861024 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Took 0.02 seconds to detach 1 volumes for instance. Jun 27 02:04:05.912178 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 27 02:04:06.031897 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Releasing lock "refresh_cache-6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:06.032373 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Instance network_info: |[{"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:04:06.034864 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Start _get_guest_xml network_info=[{"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:04:06.038662 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:04:06.039922 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1172526546', uuid='6a12e231-ff1a-48d6-b4f5-61b5c3d3414a'), owner=OwnerMeta(userid='419cd4dbc6e740dfbc01f17626fc1de8', username='tempest-VolumesActionsTest-598582693-project-member', projectid='e414b5eb7f924ed78df62a5e770d9cad', projectname='tempest-VolumesActionsTest-598582693'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525846.0395632) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:04:06.040959 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:04:06.041417 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:04:06.043425 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:06.043643 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:06.043810 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] No VIF found with MAC fa:16:3e:fb:ac:f4, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:04:06.044414 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Using config drive Jun 27 02:04:06.046698 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:04:06.047000 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:04:06.048160 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:04:06.048514 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:04:06.048699 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:04:06.048699 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:04:06.049143 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:04:06.049143 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:04:06.049143 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:04:06.049308 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:04:06.049308 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:04:06.049380 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:04:06.049542 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:04:06.049669 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:04:06.066051 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1172526546',display_name='tempest-VolumesActionsTest-instance-1172526546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesactionstest-instance-1172526546',id=23,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e414b5eb7f924ed78df62a5e770d9cad',ramdisk_id='',reservation_id='r-zi8ze6av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-598582693',owner_user_name='tempest-VolumesActionsTest-598582693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:04:02Z,user_data=None,user_id='419cd4dbc6e740dfbc01f17626fc1de8',uuid=6a12e231-ff1a-48d6-b4f5-61b5c3d3414a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:04:06.066332 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Converting VIF {"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:06.067086 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:06.068137 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:06.183157 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:04:06.186859 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:04:06.190719 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Instance spawned successfully. Jun 27 02:04:06.191258 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:04:06.265501 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:06.265774 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] VM Started (Lifecycle Event) Jun 27 02:04:06.368003 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:06.368252 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:06.552231 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] End _get_guest_xml xml= Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: instance-00000017 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 196608 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: tempest-VolumesActionsTest-instance-1172526546 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 2026-06-27 02:04:06 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 192 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: True Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: bare Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: tempest-VolumesActionsTest-598582693-project-member Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: tempest-VolumesActionsTest-598582693 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: hvm Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 128 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: /dev/urandom Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: Jun 27 02:04:06.573542 np0000003818 nova-compute[98971]: {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 27 02:04:06.576122 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Preparing to wait for external event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 27 02:04:06.576122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:06.576122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:06.576122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:06.576122 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1172526546',display_name='tempest-VolumesActionsTest-instance-1172526546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesactionstest-instance-1172526546',id=23,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e414b5eb7f924ed78df62a5e770d9cad',ramdisk_id='',reservation_id='r-zi8ze6av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-598582693',owner_user_name='tempest-VolumesActionsTest-598582693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:04:02Z,user_data=None,user_id='419cd4dbc6e740dfbc01f17626fc1de8',uuid=6a12e231-ff1a-48d6-b4f5-61b5c3d3414a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 27 02:04:06.576508 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Converting VIF {"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:06.576820 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:06.577176 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') {{(pid=98971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 27 02:04:06.578424 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.578586 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:06.578725 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 27 02:04:06.580014 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.580305 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '764f173b-ae2e-55d8-9f4b-8b3925406fb7', '_type': 'linux-noop'}}, row=False) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:06.584527 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.585355 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:06.588904 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.593350 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.594454 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78731939-6c, may_exist=True, interface_attrs={}) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:06.594454 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78731939-6c, col_values=(('qos', UUID('4c4d0a01-10c9-43ca-9fee-410f61bac8b0')),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:06.596277 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78731939-6c, col_values=(('external_ids', {'iface-id': '78731939-6ca9-4d4e-993e-9f82727687dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:34:bb', 'vm-uuid': '6a12e231-ff1a-48d6-b4f5-61b5c3d3414a'}),), if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:06.597541 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.599283 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:06.612610 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.614670 np0000003818 nova-compute[98971]: INFO os_vif [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') Jun 27 02:04:06.698168 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:06.698379 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:06.698872 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:06.699232 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:06.699410 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:06.699704 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:06.718456 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Creating config drive at /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk.config Jun 27 02:04:06.726752 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo03e6p3l {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:06.773520 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:06.786003 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:06.786305 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d67139dd-a223-46a9-a4da-78945aeb97fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo03e6p3l" returned: 0 in 0.060s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:06.922038 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:06.932408 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Found WWN 330000000ceabb262 for multipath device dm-4 {{(pid=98971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 27 02:04:06.933363 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:06.933363 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000ceabb262', 'path': '/dev/dm-4', 'multipath_id': '330000000ceabb262'} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:04:06.934297 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ceabb262', 'path': '/dev/dm-4', 'multipath_id': '330000000ceabb262'} {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 27 02:04:06.937742 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'flavor' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:07.058690 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:04:07.058690 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:04:07.206911 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Took 10.63 seconds to spawn the instance on the hypervisor. Jun 27 02:04:07.207027 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:07.288591 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:07.288840 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] VM Started (Lifecycle Event) Jun 27 02:04:07.303255 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:07.350447 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:07.381403 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:07.446917 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Attempting to attach volume eafac743-0e39-4886-8ccb-1eccf0a05414 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 27 02:04:07.447160 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] attach device xml: Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: eafac743-0e39-4886-8ccb-1eccf0a05414 Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: Jun 27 02:04:07.452403 np0000003818 nova-compute[98971]: {{(pid=98971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 27 02:04:07.542033 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:07.546939 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:07.567658 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:04:07.608337 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-da308e9a-1786-4397-9565-5f66a0b20f5e req-af3c9c5e-558c-4a62-8b6b-ed7901dae4b2 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Received event network-vif-plugged-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:07.608603 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-da308e9a-1786-4397-9565-5f66a0b20f5e req-af3c9c5e-558c-4a62-8b6b-ed7901dae4b2 service nova] Acquiring lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:07.608778 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-da308e9a-1786-4397-9565-5f66a0b20f5e req-af3c9c5e-558c-4a62-8b6b-ed7901dae4b2 service nova] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:07.609533 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-da308e9a-1786-4397-9565-5f66a0b20f5e req-af3c9c5e-558c-4a62-8b6b-ed7901dae4b2 service nova] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:07.609533 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-da308e9a-1786-4397-9565-5f66a0b20f5e req-af3c9c5e-558c-4a62-8b6b-ed7901dae4b2 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] No waiting events found dispatching network-vif-plugged-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:07.609533 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-da308e9a-1786-4397-9565-5f66a0b20f5e req-af3c9c5e-558c-4a62-8b6b-ed7901dae4b2 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Received unexpected event network-vif-plugged-8573d035-eddd-4d58-8de1-5154aed06703 for instance with vm_state active and task_state None. Jun 27 02:04:07.720142 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Took 16.40 seconds to build instance. Jun 27 02:04:07.793104 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:07.795741 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:07.987901 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "96b639c6-8661-411d-888a-5886d246fb6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:07.988374 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "96b639c6-8661-411d-888a-5886d246fb6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:08.081895 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.713s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:08.151662 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:08.152042 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:08.152236 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] No VIF found with MAC fa:16:3e:9d:34:bb, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:04:08.152813 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Using config drive Jun 27 02:04:08.172117 np0000003818 nova-compute[98971]: INFO nova.scheduler.client.report [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Deleted allocations for instance e71ace91-8cd6-4723-8c23-58ac2e0101dc Jun 27 02:04:08.224401 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c350cf68-ac7d-46fd-9b44-c2f18dbd9bba tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "6a779d38-7dc5-4cfb-b2bc-788a72f4544d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.915s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:08.300315 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:08.300315 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] VM Paused (Lifecycle Event) Jun 27 02:04:08.332912 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:08.490093 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:04:08.662237 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:08.804772 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:08.807582 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:08.807582 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] VM Resumed (Lifecycle Event) Jun 27 02:04:08.891095 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Creating config drive at /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk.config Jun 27 02:04:08.902181 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpocgd5n2w {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:08.971030 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpocgd5n2w" returned: 0 in 0.068s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:09.072844 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:09.073312 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:09.077689 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:04:09.077689 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Claim successful on node np0000003818 Jun 27 02:04:09.162163 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No BDM found with device name vda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:09.162163 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No BDM found with device name hda, not building metadata. {{(pid=98971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 27 02:04:09.162163 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] No VIF found with MAC fa:16:3e:75:71:dd, not building metadata {{(pid=98971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 27 02:04:09.183429 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-744c1d4e-fe4b-480a-a3c8-98518a62ff62 tempest-VolumesSnapshotTestJSON-1671669051 tempest-VolumesSnapshotTestJSON-1671669051-project-member] Lock "e71ace91-8cd6-4723-8c23-58ac2e0101dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.974s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:09.315654 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:09.318787 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:09.522760 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:09.567409 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:09.693660 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:09.822302 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:09.823736 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] VM Started (Lifecycle Event) Jun 27 02:04:09.938113 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Received event network-changed-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:09.938686 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Refreshing instance network info cache due to event network-changed-4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:04:09.939157 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] Acquiring lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:09.939595 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] Acquired lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:09.939595 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Refreshing network info cache for port 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:04:09.988471 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:09.994486 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b2c14271-0094-4aba-a92f-690b5025bb64 req-777c6ec9-80bf-45b9-8ef9-8f0163ca0606 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:09.994695 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b2c14271-0094-4aba-a92f-690b5025bb64 req-777c6ec9-80bf-45b9-8ef9-8f0163ca0606 service nova] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:09.994695 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b2c14271-0094-4aba-a92f-690b5025bb64 req-777c6ec9-80bf-45b9-8ef9-8f0163ca0606 service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:09.995000 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-b2c14271-0094-4aba-a92f-690b5025bb64 req-777c6ec9-80bf-45b9-8ef9-8f0163ca0606 service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:09.995129 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-b2c14271-0094-4aba-a92f-690b5025bb64 req-777c6ec9-80bf-45b9-8ef9-8f0163ca0606 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Processing event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:04:10.027003 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:10.029753 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:10.033576 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:10.058902 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:10.330580 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:10.339675 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:10.339675 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] VM Paused (Lifecycle Event) Jun 27 02:04:10.444581 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:10.789182 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-d00af694-e30e-4eff-94ba-61c92670c209 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.808s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:10.797851 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:04:10.803764 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:04:10.807108 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Instance spawned successfully. Jun 27 02:04:10.807777 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:04:10.841943 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:10.847361 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:10.891681 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:04:10.892135 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:04:10.971800 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:11.009036 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:11.253619 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updated VIF entry in instance network info cache for port 4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:04:11.255284 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updating instance_info_cache with network_info: [{"id": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "address": "fa:16:3e:a8:a6:8e", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2dbe66-a7", "ovs_interfaceid": "4c2dbe66-a7f9-42af-98ea-cf4fc5ffc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:11.319344 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:11.321253 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:11.321933 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:11.322429 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:11.323927 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:11.324729 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:11.348006 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:04:11.348731 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Started> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:11.348777 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] VM Started (Lifecycle Event) Jun 27 02:04:11.398491 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:04:11.598881 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:11.756721 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7f439c81-7e7e-4c0a-9b11-cca0c275feed req-406dc1b0-c4aa-4f54-9526-3fac5ff5ad72 service nova] Releasing lock "refresh_cache-4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:11.833189 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Took 9.18 seconds to spawn the instance on the hypervisor. Jun 27 02:04:11.833608 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:11.852275 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:11.858648 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:11.910550 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.837s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:11.911509 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:04:12.067206 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Received event network-changed-8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:12.067526 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Refreshing instance network info cache due to event network-changed-8573d035-eddd-4d58-8de1-5154aed06703. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:04:12.068441 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Acquiring lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:12.069863 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Acquired lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:12.070219 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Refreshing network info cache for port 8573d035-eddd-4d58-8de1-5154aed06703 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:04:12.093036 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1296d04a-c27d-40e3-a710-37591e7d5e6e req-3fef867b-df44-49ba-bb16-d037bad3626e service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:12.094400 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1296d04a-c27d-40e3-a710-37591e7d5e6e req-3fef867b-df44-49ba-bb16-d037bad3626e service nova] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:12.094400 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1296d04a-c27d-40e3-a710-37591e7d5e6e req-3fef867b-df44-49ba-bb16-d037bad3626e service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:12.095553 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-1296d04a-c27d-40e3-a710-37591e7d5e6e req-3fef867b-df44-49ba-bb16-d037bad3626e service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:12.096271 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-1296d04a-c27d-40e3-a710-37591e7d5e6e req-3fef867b-df44-49ba-bb16-d037bad3626e service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] No waiting events found dispatching network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:12.098276 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-1296d04a-c27d-40e3-a710-37591e7d5e6e req-3fef867b-df44-49ba-bb16-d037bad3626e service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received unexpected event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd for instance with vm_state active and task_state None. Jun 27 02:04:12.179905 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:12.180221 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:12.410588 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] During sync_power_state the instance has a pending task (spawning). Skip. Jun 27 02:04:12.411900 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Paused> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:12.411900 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] VM Paused (Lifecycle Event) Jun 27 02:04:12.413051 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:12.449243 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Allocating IP information in the background. {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 27 02:04:12.449243 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] allocate_for_instance() {{(pid=98971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 27 02:04:12.449243 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:12.449243 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:12.450811 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Took 15.70 seconds to build instance. Jun 27 02:04:12.577571 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:12.612354 np0000003818 nova-compute[98971]: DEBUG nova.policy [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48172c20aca946a5b61e2dee61b95de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6450727e8a4a3dbb864e0616d363d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98971) authorize /opt/stack/nova/nova/policy.py:192}} Jun 27 02:04:12.686752 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lazy-loading 'flavor' on Instance uuid 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:12.762742 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fc66ab87-40ce-4f60-9767-c43d3b02c617 req-d13f42e5-6d49-42fb-b752-f93e08286ef4 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received event network-vif-plugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:12.763131 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fc66ab87-40ce-4f60-9767-c43d3b02c617 req-d13f42e5-6d49-42fb-b752-f93e08286ef4 service nova] Acquiring lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:12.763660 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fc66ab87-40ce-4f60-9767-c43d3b02c617 req-d13f42e5-6d49-42fb-b752-f93e08286ef4 service nova] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:12.763660 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-fc66ab87-40ce-4f60-9767-c43d3b02c617 req-d13f42e5-6d49-42fb-b752-f93e08286ef4 service nova] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:12.764092 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-fc66ab87-40ce-4f60-9767-c43d3b02c617 req-d13f42e5-6d49-42fb-b752-f93e08286ef4 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Processing event network-vif-plugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 27 02:04:12.765078 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 27 02:04:12.777927 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Guest created on hypervisor {{(pid=98971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 27 02:04:12.785686 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Instance spawned successfully. Jun 27 02:04:12.786206 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 27 02:04:12.951170 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 27 02:04:12.954951 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-c5386e1d-6489-4231-a1f4-0c0ad77f72b5 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.234s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:12.956570 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:12.959668 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:12.959909 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] VM Resumed (Lifecycle Event) Jun 27 02:04:13.298119 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Found default for hw_cdrom_bus of ide {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:13.298119 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Found default for hw_disk_bus of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:13.298738 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Found default for hw_input_bus of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:13.299260 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Found default for hw_pointer_model of None {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:13.299260 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Found default for hw_video_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:13.299724 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Found default for hw_vif_model of virtio {{(pid=98971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 27 02:04:13.342731 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:13.458502 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Start building block device mappings for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 27 02:04:13.483192 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:13.499478 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:13.514120 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Successfully created port: 28ea2f75-b978-477c-b200-c4c82e65e87c {{(pid=98971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 27 02:04:13.688441 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Updated VIF entry in instance network info cache for port 8573d035-eddd-4d58-8de1-5154aed06703. {{(pid=98971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jun 27 02:04:13.688723 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 6a779d38-7dc5-4cfb-b2bc-788a72f4544d] Updating instance_info_cache with network_info: [{"id": "8573d035-eddd-4d58-8de1-5154aed06703", "address": "fa:16:3e:bc:3c:4c", "network": {"id": "b046f79f-84e9-405a-b1c3-c3d9b3a28a76", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1949463314-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5794cf82ab843adab5363e39a368501", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8573d035-ed", "ovs_interfaceid": "8573d035-eddd-4d58-8de1-5154aed06703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:13.705591 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.525s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:13.811956 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Took 14.27 seconds to spawn the instance on the hypervisor. Jun 27 02:04:13.811956 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:13.846825 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:13.847146 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:13.874502 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Acquiring lock "f6d905d7-ae24-4751-934f-d6864589731e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:13.874502 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Lock "f6d905d7-ae24-4751-934f-d6864589731e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.003842 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Emitting event Resumed> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:14.004082 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] VM Resumed (Lifecycle Event) Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.161773 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-ca81f8fc-f6e9-40ef-9e83-c12266d2e95d req-565193f1-053a-48fa-9e86-b7ed8c08693e service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.192342 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Releasing lock "refresh_cache-6a779d38-7dc5-4cfb-b2bc-788a72f4544d" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:14.192576 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.192784 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.192943 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.193126 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.193248 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.193377 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.193482 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.193608 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.193764 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.193868 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.193983 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.194118 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-unplugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.194226 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.194348 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.194473 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.194571 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.194681 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.194788 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-7a8080a4-23f5-47cd-86a1-94d3386b5b9b req-907de67d-ecbb-4c90-bb6f-cdb176767f16 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:14.336180 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Took 22.87 seconds to build instance. Jun 27 02:04:14.352949 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Detaching volume eafac743-0e39-4886-8ccb-1eccf0a05414 Jun 27 02:04:14.377132 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] [instance: f6d905d7-ae24-4751-934f-d6864589731e] Starting instance... {{(pid=98971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 27 02:04:14.432936 np0000003818 nova-compute[98971]: INFO nova.virt.block_device [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Attempting to driver detach volume eafac743-0e39-4886-8ccb-1eccf0a05414 from mountpoint /dev/vdb Jun 27 02:04:14.438900 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Found disk vdb by alias ua-eafac743-0e39-4886-8ccb-1eccf0a05414 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:04:14.440764 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Found disk vdb by alias ua-eafac743-0e39-4886-8ccb-1eccf0a05414 {{(pid=98971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 27 02:04:14.441031 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Attempting to detach device vdb from instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] detach device xml: Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: eafac743-0e39-4886-8ccb-1eccf0a05414 Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]:
Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: Jun 27 02:04:14.441325 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Successfully detached device vdb from instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed from the persistent domain config. Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] (1/8): Attempting to detach device vdb with device alias ua-eafac743-0e39-4886-8ccb-1eccf0a05414 from instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed from the live domain config. {{(pid=98971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] detach device xml: Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: eafac743-0e39-4886-8ccb-1eccf0a05414 Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]:
Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: Jun 27 02:04:14.462202 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:04:14.488404 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Start spawning the instance on the hypervisor. {{(pid=98971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 27 02:04:14.492881 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Creating instance directory {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 27 02:04:14.492881 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Creating image(s) Jun 27 02:04:14.493234 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "/opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.495946 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.495946 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "/opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.495946 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:14.499273 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:14.502479 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:14.526429 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:14.537602 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 27 02:04:14.622122 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.121s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:14.622606 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.623127 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.623597 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:14.627180 np0000003818 nova-compute[98971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 27 02:04:14.628137 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:14.749698 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.121s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:14.750240 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk 1073741824 {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:14.773893 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Successfully updated port: 28ea2f75-b978-477c-b200-c4c82e65e87c {{(pid=98971) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 27 02:04:14.828241 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf,backing_fmt=raw /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk 1073741824" returned: 0 in 0.078s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:14.830586 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "8caed26c38286e087f7c3aa12e0882fdf4c778bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.207s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.831171 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:14.853184 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-40f060a5-f354-4c53-9240-ff9278b3a7cc tempest-ServerActionsTestOtherA-2022980580 tempest-ServerActionsTestOtherA-2022980580-project-member] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.396s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.863232 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Received event network-changed-28ea2f75-b978-477c-b200-c4c82e65e87c {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.865110 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Refreshing instance network info cache due to event network-changed-28ea2f75-b978-477c-b200-c4c82e65e87c. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:04:14.865110 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] Acquiring lock "refresh_cache-96b639c6-8661-411d-888a-5886d246fb6a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:14.865110 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] Acquired lock "refresh_cache-96b639c6-8661-411d-888a-5886d246fb6a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:14.865110 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Refreshing network info cache for port 28ea2f75-b978-477c-b200-c4c82e65e87c {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:04:14.870349 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-13d88aa7-b602-4655-8fa2-23aa060a92f7 req-0938d05d-37c8-42bb-8b88-19aadc954b13 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received event network-vif-plugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:14.870871 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-13d88aa7-b602-4655-8fa2-23aa060a92f7 req-0938d05d-37c8-42bb-8b88-19aadc954b13 service nova] Acquiring lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.876561 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-13d88aa7-b602-4655-8fa2-23aa060a92f7 req-0938d05d-37c8-42bb-8b88-19aadc954b13 service nova] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.876561 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-13d88aa7-b602-4655-8fa2-23aa060a92f7 req-0938d05d-37c8-42bb-8b88-19aadc954b13 service nova] Lock "d67139dd-a223-46a9-a4da-78945aeb97fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:14.876561 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-13d88aa7-b602-4655-8fa2-23aa060a92f7 req-0938d05d-37c8-42bb-8b88-19aadc954b13 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] No waiting events found dispatching network-vif-plugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:14.876561 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-13d88aa7-b602-4655-8fa2-23aa060a92f7 req-0938d05d-37c8-42bb-8b88-19aadc954b13 service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received unexpected event network-vif-plugged-1b03f020-91d2-47a4-bab8-1434e42eaa12 for instance with vm_state active and task_state None. Jun 27 02:04:14.903894 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:14.903894 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "4eb34ff8-b41d-47ea-ae36-a583b5bc32ad" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:14.914474 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Attaching volume 0afc60c1-210f-41a7-9eaf-c44226e2a67c to /dev/vdb Jun 27 02:04:14.999240 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8caed26c38286e087f7c3aa12e0882fdf4c778bf --force-share --output=json" returned: 0 in 0.167s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:15.002724 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:15.002724 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:15.003193 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk. size=1073741824 {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 27 02:04:15.004943 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk --force-share --output=json {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:15.004943 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.032524 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 27 02:04:15.032791 np0000003818 nova-compute[98971]: INFO nova.compute.claims [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] [instance: f6d905d7-ae24-4751-934f-d6864589731e] Claim successful on node np0000003818 Jun 27 02:04:15.047267 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.40', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003818', 'execute': None}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:04:15.073236 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.scaleio [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 27 02:04:15.081767 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:15.082101 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.002s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:15.082657 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:15.082657 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:15.082813 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:15.086712 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Terminating instance Jun 27 02:04:15.114129 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Running cmd (subprocess): nvme version {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 02:04:15.129476 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 02:04:15.131514 np0000003818 nova-compute[98971]: DEBUG nova.virt.disk.api [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Cannot resize image /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/disk to a smaller size. {{(pid=98971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 27 02:04:15.132204 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Created local disks {{(pid=98971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 27 02:04:15.133111 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Ensure instance console log exists: /opt/stack/data/nova/instances/96b639c6-8661-411d-888a-5886d246fb6a/console.log {{(pid=98971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 27 02:04:15.133111 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:15.133335 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:15.133704 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:15.157215 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.processutils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 02:04:15.158368 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] nvme not present on system {{(pid=98971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 27 02:04:15.179008 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 27 02:04:15.179747 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.lightos [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Current host hostNQN and IP(s) are ['10.4.3.40', 'fe80::f816:3eff:fe47:e017', '192.168.40.6', 'fe80::f816:3eff:fe19:10c0', '192.168.50.6', 'fe80::f816:3eff:fe14:b9a6', '192.168.10.6', 'fe80::f816:3eff:feb2:4e9', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::7c6f:f6ff:fe69:8042', 'fe80::fc16:3eff:fe87:9ee6', 'fe80::b8bb:79ff:fef8:7cc8', 'fe80::fc16:3eff:fe0f:9a13', 'fe80::3c5f:2aff:fe42:e4a2', 'fe80::fc16:3eff:fe75:71dd', 'fe80::c13:9cff:febe:6408', 'fe80::fc16:3eff:fe13:bb6e', 'fe80::14f4:d5ff:fe2f:6a47', 'fe80::fc16:3eff:fea8:a68e', 'fe80::fc16:3eff:fe1f:f99d', 'fe80::e44f:3aff:fe85:19ee', 'fe80::fc16:3eff:fe22:1580', 'fe80::fc16:3eff:febc:3c4c', 'fe80::fc16:3eff:fefb:acf4', 'fe80::fc16:3eff:fe9d:34bb', 'fe80::8861:2cff:fe2a:fe3f'] Jun 27 02:04:15.179874 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 27 02:04:15.179931 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.lightos [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] LIGHTOS: no hostnqn found. {{(pid=98971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 27 02:04:15.180139 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.40', 'host': 'np0000003818', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:478aa5cd803e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'fee9c062-a71f-432f-96c4-918503668fcf', 'nvme_native_multipath': False} {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:04:15.180338 np0000003818 nova-compute[98971]: DEBUG nova.virt.block_device [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Updating existing volume attachment record: d8c6e4d8-f43b-4bb1-b116-a15e2e7e5c43 {{(pid=98971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 27 02:04:15.268379 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Received event ua-eafac743-0e39-4886-8ccb-1eccf0a05414> from libvirt while the driver is waiting for it; dispatched. {{(pid=98971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 27 02:04:15.270239 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-eafac743-0e39-4886-8ccb-1eccf0a05414 for instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 27 02:04:15.281619 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Successfully detached device vdb from instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed from the live domain config. Jun 27 02:04:15.282395 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquiring lock "refresh_cache-96b639c6-8661-411d-888a-5886d246fb6a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:15.286541 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] calling os-brick to detach iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 27 02:04:15.290179 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafac743-0e39-4886-8ccb-1eccf0a05414', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:04:15.290179 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:15.290179 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:15.290470 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eafac743-0e39-4886-8ccb-1eccf0a05414', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 27 02:04:15.290685 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', 0)] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:15.341468 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414 (non-flash) Jun 27 02:04:15.341784 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:15.342148 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', '44')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 27 02:04:15.342148 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', '43')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:04:15.343464 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414', '44')] {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 27 02:04:15.344382 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Resulting device map defaultdict(. at 0x7decc02efa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'): ({'sdg'}, set())}) {{(pid=98971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 27 02:04:15.344643 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Removing multipathed devices sdf, sdg {{(pid=98971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 27 02:04:15.345107 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Flush multipath device 330000000ceabb262 {{(pid=98971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 27 02:04:15.376775 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:04:15.381572 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:15.431666 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 27 02:04:15.476879 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 27 02:04:15.477914 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 27 02:04:15.478948 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 27 02:04:15.492707 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 27 02:04:15.494842 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414')] {{(pid=98971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 27 02:04:15.502431 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:15.506936 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.540328 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.40.100,3260] Jun 27 02:04:15.540328 np0000003818 nova-compute[98971]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.40.100,3260] successful. Jun 27 02:04:15.540328 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.564697 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.582064 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.593755 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Start destroying the instance on the hypervisor. {{(pid=98971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 27 02:04:15.622859 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.50.100,3260] Jun 27 02:04:15.622859 np0000003818 nova-compute[98971]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-eafac743-0e39-4886-8ccb-1eccf0a05414, portal: 192.168.50.100,3260] successful. Jun 27 02:04:15.622859 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.632229 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.637065 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.654714 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.655232 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:15.655232 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] <== disconnect_volume: return (367ms) None {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 27 02:04:15.655232 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] [instance: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed] Disconnected iSCSI Volume {{(pid=98971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 27 02:04:15.670058 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.676638 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.706745 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.707781 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.816937 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] [instance: 4eb34ff8-b41d-47ea-ae36-a583b5bc32ad] Calling os-brick to attach iSCSI Volume {{(pid=98971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 27 02:04:15.816937 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 27 02:04:15.817318 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:15.817625 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:15.818591 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 27 02:04:15.831729 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:15.832614 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 27 02:04:15.835594 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:15.835594 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:04:15.837612 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 27 02:04:15.837612 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:04:15.860186 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:04:15.860186 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.866746 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c] added Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:04:15.875271 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0404(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:04:15.876403 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c] added Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: stderr=iscsiadm: Config file line 363 does not have value Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: iscsiadm: Config file line 363 does not have value Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:15.889230 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 27 02:04:15.889672 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0532(s), this was the 1st time calling it. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 27 02:04:15.889672 np0000003818 nova-compute[98971]: DEBUG os_brick.utils [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 27 02:04:15.916477 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.966509 np0000003818 nova-compute[98971]: DEBUG nova.utils [None req-0176ba36-03eb-48ce-ad63-7ce0d916b42a None None] Queued Task(fn=>, remaining_delay=14.9996467630001 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:15.966509 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.979251 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:15.982408 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [-] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Instance destroyed successfully. Jun 27 02:04:15.985711 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Lazy-loading 'resources' on Instance uuid 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:16.007714 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.212111 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e005c04d-f531-4b70-a9af-da96919a7922 req-1029d325-7519-4d68-9daa-fbfd15d56e34 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-unplugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:16.212364 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e005c04d-f531-4b70-a9af-da96919a7922 req-1029d325-7519-4d68-9daa-fbfd15d56e34 service nova] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:16.212606 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e005c04d-f531-4b70-a9af-da96919a7922 req-1029d325-7519-4d68-9daa-fbfd15d56e34 service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:16.212789 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-e005c04d-f531-4b70-a9af-da96919a7922 req-1029d325-7519-4d68-9daa-fbfd15d56e34 service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:16.213021 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e005c04d-f531-4b70-a9af-da96919a7922 req-1029d325-7519-4d68-9daa-fbfd15d56e34 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] No waiting events found dispatching network-vif-unplugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:16.214550 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-e005c04d-f531-4b70-a9af-da96919a7922 req-1029d325-7519-4d68-9daa-fbfd15d56e34 service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-unplugged-78731939-6ca9-4d4e-993e-9f82727687dd for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:04:16.284112 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3c6e96b9-fa72-4d2e-a7c8-6507579da48d req-cb43f545-62f5-4ec8-8ae5-9a4d8817f1f8 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:16.284592 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3c6e96b9-fa72-4d2e-a7c8-6507579da48d req-cb43f545-62f5-4ec8-8ae5-9a4d8817f1f8 service nova] Acquiring lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:16.284848 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3c6e96b9-fa72-4d2e-a7c8-6507579da48d req-cb43f545-62f5-4ec8-8ae5-9a4d8817f1f8 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:16.288000 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-3c6e96b9-fa72-4d2e-a7c8-6507579da48d req-cb43f545-62f5-4ec8-8ae5-9a4d8817f1f8 service nova] Lock "0659eeb0-028e-4fe2-9a53-a93ac045cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:16.292863 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'flavor' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:16.294269 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-3c6e96b9-fa72-4d2e-a7c8-6507579da48d req-cb43f545-62f5-4ec8-8ae5-9a4d8817f1f8 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] No waiting events found dispatching network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:16.295223 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-3c6e96b9-fa72-4d2e-a7c8-6507579da48d req-cb43f545-62f5-4ec8-8ae5-9a4d8817f1f8 service nova] [instance: 0659eeb0-028e-4fe2-9a53-a93ac045cf30] Received unexpected event network-vif-plugged-cd685529-e10d-45ec-a49c-2f642db01ee4 for instance with vm_state active and task_state None. Jun 27 02:04:16.371316 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-ee9e2f73-d92a-43c5-a03c-82edb0cece4e req-3c5e74c1-ae73-49d4-bdcb-0e34c26a6e25 service nova] Releasing lock "refresh_cache-96b639c6-8661-411d-888a-5886d246fb6a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:16.371316 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Acquired lock "refresh_cache-96b639c6-8661-411d-888a-5886d246fb6a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:16.371316 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Building network info cache for instance {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 27 02:04:16.466250 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.471306 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.480459 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1172526546',display_name='tempest-VolumesActionsTest-instance-1172526546',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-volumesactionstest-instance-1172526546',id=23,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-27T02:04:11Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e414b5eb7f924ed78df62a5e770d9cad',ramdisk_id='',reservation_id='r-zi8ze6av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-598582693',owner_user_name='tempest-VolumesActionsTest-598582693-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:04:12Z,user_data=None,user_id='419cd4dbc6e740dfbc01f17626fc1de8',uuid=6a12e231-ff1a-48d6-b4f5-61b5c3d3414a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Converting VIF {"id": "78731939-6ca9-4d4e-993e-9f82727687dd", "address": "fa:16:3e:9d:34:bb", "network": {"id": "c0d6d9f0-4016-4d04-8935-aa8585a28881", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1892485620-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e414b5eb7f924ed78df62a5e770d9cad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78731939-6c", "ovs_interfaceid": "78731939-6ca9-4d4e-993e-9f82727687dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG os_vif [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') {{(pid=98971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78731939-6c, bridge=br-int, if_exists=True) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.500265 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:16.524933 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.531519 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.531519 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c4d0a01-10c9-43ca-9fee-410f61bac8b0) {{(pid=98971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 27 02:04:16.531519 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.531519 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 27 02:04:16.532758 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.537541 np0000003818 nova-compute[98971]: INFO os_vif [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:34:bb,bridge_name='br-int',has_traffic_filtering=True,id=78731939-6ca9-4d4e-993e-9f82727687dd,network=Network(c0d6d9f0-4016-4d04-8935-aa8585a28881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78731939-6c') Jun 27 02:04:16.538056 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Deleting instance files /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a_del Jun 27 02:04:16.538919 np0000003818 nova-compute[98971]: INFO nova.virt.libvirt.driver [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Deletion of /opt/stack/data/nova/instances/6a12e231-ff1a-48d6-b4f5-61b5c3d3414a_del complete Jun 27 02:04:16.658793 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.694891 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:16.880259 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 27 02:04:16.891340 np0000003818 nova-compute[98971]: INFO os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.40.100 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:04:16.893118 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.name = iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.tpgt = -1 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.startup = manual Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.leading_login = No Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.iscsi_ifacename = default Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.net_ifacename = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.ipaddress = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.prefix_len = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.hwaddress = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.transport_name = tcp Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.initiatorname = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.vlan_id = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.vlan_priority = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.vlan_state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.iface_num = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.mtu = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.port = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.bootproto = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.subnet_mask = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.gateway = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id_state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_alt_client_id = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_dns = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_learn_iqn = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_req_vendor_id_state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id_state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_vendor_id = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.dhcp_slp_da = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.fragmentation = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.gratuitous_arp = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.incoming_forwarding = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tos_state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tos = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.ttl = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.delayed_ack = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tcp_nagle = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tcp_wsf_state = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tcp_wsf = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tcp_timer_scale = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.tcp_timestamp = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.redirect = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.def_task_mgmt_timeout = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.header_digest = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.data_digest = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.immediate_data = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.initial_r2t = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.data_seq_inorder = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.data_pdu_inorder = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.erl = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.max_receive_data_len = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.first_burst_len = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.max_outstanding_r2t = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.max_burst_len = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.chap_auth = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.bidi_chap = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.strict_login_compliance = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.discovery_auth = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: iface.discovery_logout = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.discovery_address = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.discovery_port = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.discovery_type = fw Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.initial_cmdsn = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.initial_login_retry_max = 8 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.xmit_thread_priority = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.cmds_max = 128 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.queue_depth = 32 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.nr_sessions = 1 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.auth.authmethod = None Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.auth.username = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.auth.password = *** Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.auth.username_in = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.auth.password_in = Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.auth.chap_algs = SHA256 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.timeo.replacement_timeout = 120 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.err_timeo.abort_timeout = 15 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.err_timeo.lu_reset_timeout = 30 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.err_timeo.host_reset_timeout = 60 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.FastAbort = Yes Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.InitialR2T = No Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.ImmediateData = Yes Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.FirstBurstLength = 262144 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.MaxBurstLength = 16776192 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Retain = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.DefaultTime2Wait = 2 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.MaxConnections = 1 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.iscsi.ERL = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.scan = auto Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.session.reopen_max = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].address = 192.168.50.100 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].port = 3260 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].startup = manual Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].tcp.window_size = 524288 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].tcp.type_of_service = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].timeo.logout_timeout = 15 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].timeo.login_timeout = 15 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].timeo.auth_timeout = 45 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_interval = 5 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].timeo.noop_out_timeout = 5 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].iscsi.HeaderDigest = None Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].iscsi.DataDigest = None Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].iscsi.IFMarker = No Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: node.conn[0].iscsi.OFMarker = No Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: # END RECORD Jun 27 02:04:16.907701 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:16.917559 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:16.935510 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:16.951120 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.951120 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.951120 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.951120 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.951120 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:16.951312 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.951312 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.951312 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.951312 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.951312 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:16.954277 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.954277 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.954277 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.954277 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.954277 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:16.954528 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.954528 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:16.954528 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.954528 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:16.954528 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:16.996435 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Instance cache missing network info. {{(pid=98971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jun 27 02:04:17.009033 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 27 02:04:17.009033 np0000003818 nova-compute[98971]: DEBUG nova.compute.provider_tree [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Inventory has not changed in ProviderTree for provider: e15e7dcd-705b-4a74-b310-f650a880c622 {{(pid=98971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 27 02:04:17.019117 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c, portal: 192.168.50.100,3260] Jun 27 02:04:17.019117 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c, portal: 192.168.50.100,3260] successful. Jun 27 02:04:17.019117 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:17.026774 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c, portal: 192.168.40.100,3260] Jun 27 02:04:17.026774 np0000003818 nova-compute[98971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c, portal: 192.168.40.100,3260] successful. Jun 27 02:04:17.026774 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:17.037582 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:17.044928 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 27 02:04:17.048436 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Took 1.45 seconds to destroy the instance on the hypervisor. Jun 27 02:04:17.049257 np0000003818 nova-compute[98971]: DEBUG oslo.service.backend._common.loopingcall [None req-4c3f89a8-a7d6-46b8-babd-3fee88072433 tempest-VolumesActionsTest-598582693 tempest-VolumesActionsTest-598582693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 27 02:04:17.050003 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [-] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Deallocating network for instance {{(pid=98971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 27 02:04:17.050202 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] deallocate_for_instance() {{(pid=98971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 27 02:04:17.050471 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:17.060498 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to 192.168.50.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:04:17.061183 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] HCTL ('12', '-', '-', 0) found on session 46 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:04:17.061183 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.074368 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-817d2aee-0075-45e7-aa8d-1ebda3fc52dd (non-flash) Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40592cc8-a5cf-45d8-823f-dac19e643b2d (non-flash) Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c (non-flash) Jun 27 02:04:17.074699 np0000003818 nova-compute[98971]: stderr= {{(pid=98971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 27 02:04:17.076427 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.base [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 27 02:04:17.076427 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to 192.168.40.100:3260 {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 27 02:04:17.076681 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] HCTL ('11', '-', '-', 0) found on session 45 with lun 0 {{(pid=98971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 27 02:04:17.076830 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 27 02:04:17.104522 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 46 and hctl ['12', '*', '*', 0] yield: None {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:04:17.107479 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006035000001247681 future=) submitted to {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.107479 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.107479 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] Emitting event Stopped> {{(pid=98971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 27 02:04:17.107479 np0000003818 nova-compute[98971]: INFO nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] VM Stopped (Lifecycle Event) Jun 27 02:04:17.109079 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.37895866300004855 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.110800 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=0.3781353809999928 future=) was cancelled while queued, skipping {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.110800 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.112647 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=13.855710082000087 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.112647 np0000003818 nova-compute[98971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=13.853830913000138 future=) {{(pid=98971) _log /opt/stack/nova/nova/utils.py:1508}} Jun 27 02:04:17.114596 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 45 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:04:17.114596 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:04:17.232039 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:17.337543 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Acquiring lock "interface-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:17.337543 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "interface-07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed-4f4b4d71-ef20-4372-a86b-caff1ca3dfb9" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:17.351481 np0000003818 nova-compute[98971]: WARNING neutronclient.v2_0.client [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 27 02:04:17.385677 np0000003818 nova-compute[98971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 27 02:04:17.513218 np0000003818 nova-compute[98971]: DEBUG nova.scheduler.client.report [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Inventory has not changed for provider e15e7dcd-705b-4a74-b310-f650a880c622 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 27 02:04:17.613908 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-cbec43e1-3c3c-459a-bc5b-da66986cef54 tempest-TestMultiAttachVolumeSwap-204905735 tempest-TestMultiAttachVolumeSwap-204905735-project-member] [instance: e71ace91-8cd6-4723-8c23-58ac2e0101dc] Checking state {{(pid=98971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 27 02:04:17.641471 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Updating instance_info_cache with network_info: [{"id": "28ea2f75-b978-477c-b200-c4c82e65e87c", "address": "fa:16:3e:d9:83:77", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ea2f75-b9", "ovs_interfaceid": "28ea2f75-b978-477c-b200-c4c82e65e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:17.692937 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-af4a6f62-a2e0-4fd9-900d-8afa7fcf880a req-ebea4139-a123-421b-820b-bc2f3cea83ab service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-deleted-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:17.697564 np0000003818 nova-compute[98971]: INFO nova.compute.manager [req-af4a6f62-a2e0-4fd9-900d-8afa7fcf880a req-ebea4139-a123-421b-820b-bc2f3cea83ab service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Neutron deleted interface 78731939-6ca9-4d4e-993e-9f82727687dd; detaching it from the instance and deleting it from the info cache Jun 27 02:04:17.697856 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-af4a6f62-a2e0-4fd9-900d-8afa7fcf880a req-ebea4139-a123-421b-820b-bc2f3cea83ab service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Detach interface failed, port_id=78731939-6ca9-4d4e-993e-9f82727687dd, reason: Instance 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a could not be found. {{(pid=98971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 27 02:04:17.811059 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-a44fc708-0eb3-4e3c-9810-16d2c57e8fc2 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lock "07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.964s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:17.841767 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Lazy-loading 'flavor' on Instance uuid 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:18.023159 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.021s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:18.023766 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-60048efd-c91d-49e4-b813-34455e41916f tempest-VolumesActionsTest-258270903 tempest-VolumesActionsTest-258270903-project-member] [instance: f6d905d7-ae24-4751-934f-d6864589731e] Start building networks asynchronously for instance. {{(pid=98971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 27 02:04:18.101515 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.linuxscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Searching for a device in session 46 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=98971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 27 02:04:18.101515 np0000003818 nova-compute[98971]: DEBUG os_brick.initiator.connectors.iscsi [None req-541479ef-8421-4ea8-b53d-257ad3883e0b tempest-AttachVolumeMultiAttachTest-1200701507 tempest-AttachVolumeMultiAttachTest-1200701507-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0afc60c1-210f-41a7-9eaf-c44226e2a67c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 27 02:04:18.126405 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [-] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Updating instance_info_cache with network_info: [] {{(pid=98971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 27 02:04:18.146623 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Releasing lock "refresh_cache-96b639c6-8661-411d-888a-5886d246fb6a" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 02:04:18.146906 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Instance network_info: |[{"id": "28ea2f75-b978-477c-b200-c4c82e65e87c", "address": "fa:16:3e:d9:83:77", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ea2f75-b9", "ovs_interfaceid": "28ea2f75-b978-477c-b200-c4c82e65e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 27 02:04:18.149193 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] [instance: 96b639c6-8661-411d-888a-5886d246fb6a] Start _get_guest_xml network_info=[{"id": "28ea2f75-b978-477c-b200-c4c82e65e87c", "address": "fa:16:3e:d9:83:77", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ea2f75-b9", "ovs_interfaceid": "28ea2f75-b978-477c-b200-c4c82e65e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '978bb255-a7d2-43ac-8161-7d19816a5875'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 27 02:04:18.152380 np0000003818 nova-compute[98971]: WARNING nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 27 02:04:18.154022 np0000003818 nova-compute[98971]: DEBUG nova.virt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='978bb255-a7d2-43ac-8161-7d19816a5875', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1402259217', uuid='96b639c6-8661-411d-888a-5886d246fb6a'), owner=OwnerMeta(userid='48172c20aca946a5b61e2dee61b95de7', username='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member', projectid='fb6450727e8a4a3dbb864e0616d363d4', projectname='tempest-ServerBootFromVolumeStableRescueTest-1593948765'), image=ImageMeta(id='978bb255-a7d2-43ac-8161-7d19816a5875', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28ea2f75-b978-477c-b200-c4c82e65e87c", "address": "fa:16:3e:d9:83:77", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ea2f75-b9", "ovs_interfaceid": "28ea2f75-b978-477c-b200-c4c82e65e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782525858.1533096) {{(pid=98971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 27 02:04:18.155093 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V1... {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 27 02:04:18.155439 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller missing on host. {{(pid=98971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 27 02:04:18.157112 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Searching host: 'np0000003818' for CPU controller through CGroups V2... {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 27 02:04:18.159111 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.host [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU controller found on host. {{(pid=98971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 27 02:04:18.159111 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 27 02:04:18.159111 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T01:57:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T01:57:14Z,direct_url=,disk_format='qcow2',id=978bb255-a7d2-43ac-8161-7d19816a5875,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='9721ed39c31446e69c8c653d213c33a5',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-27T01:57:17Z,virtual_size=,visibility=), allow threads: True {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 27 02:04:18.159350 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 27 02:04:18.160061 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image limits 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 27 02:04:18.160061 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Flavor pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 27 02:04:18.160061 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Image pref 0:0:0 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 27 02:04:18.160061 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 27 02:04:18.160061 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 27 02:04:18.160289 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 27 02:04:18.160426 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Got 1 possible topologies {{(pid=98971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 27 02:04:18.160627 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 27 02:04:18.160747 np0000003818 nova-compute[98971]: DEBUG nova.virt.hardware [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 27 02:04:18.176412 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T02:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1402259217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-serverbootfromvolumestablerescuetest-server-1402259217',id=24,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003818',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb6450727e8a4a3dbb864e0616d363d4',ramdisk_id='',reservation_id='r-ne2g7dpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T02:04:14Z,user_data=None,user_id='48172c20aca946a5b61e2dee61b95de7',uuid=96b639c6-8661-411d-888a-5886d246fb6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ea2f75-b978-477c-b200-c4c82e65e87c", "address": "fa:16:3e:d9:83:77", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ea2f75-b9", "ovs_interfaceid": "28ea2f75-b978-477c-b200-c4c82e65e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:04:18.176650 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converting VIF {"id": "28ea2f75-b978-477c-b200-c4c82e65e87c", "address": "fa:16:3e:d9:83:77", "network": {"id": "a3ae1714-ccfa-410c-a313-8512f7a973e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-903797448-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb6450727e8a4a3dbb864e0616d363d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ea2f75-b9", "ovs_interfaceid": "28ea2f75-b978-477c-b200-c4c82e65e87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:18.177762 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:83:77,bridge_name='br-int',has_traffic_filtering=True,id=28ea2f75-b978-477c-b200-c4c82e65e87c,network=Network(a3ae1714-ccfa-410c-a313-8512f7a973e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ea2f75-b9') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:18.178082 np0000003818 nova-compute[98971]: DEBUG nova.objects.instance [None req-e357174f-f323-41b3-8285-9d89c32e6185 tempest-ServerBootFromVolumeStableRescueTest-1593948765 tempest-ServerBootFromVolumeStableRescueTest-1593948765-project-member] Lazy-loading 'pci_devices' on Instance uuid 96b639c6-8661-411d-888a-5886d246fb6a {{(pid=98971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 27 02:04:18.333344 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-unplugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:18.335078 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:18.335404 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:18.335538 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:18.336357 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] No waiting events found dispatching network-vif-unplugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:18.336357 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-unplugged-78731939-6ca9-4d4e-993e-9f82727687dd for instance with task_state deleting. {{(pid=98971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 27 02:04:18.337914 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:18.337914 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Acquiring lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 02:04:18.337914 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 02:04:18.337914 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Lock "6a12e231-ff1a-48d6-b4f5-61b5c3d3414a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 02:04:18.337914 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] No waiting events found dispatching network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd {{(pid=98971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 27 02:04:18.338231 np0000003818 nova-compute[98971]: WARNING nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: 6a12e231-ff1a-48d6-b4f5-61b5c3d3414a] Received unexpected event network-vif-plugged-78731939-6ca9-4d4e-993e-9f82727687dd for instance with vm_state active and task_state deleting. Jun 27 02:04:18.338231 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Received event network-changed-1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 27 02:04:18.338313 np0000003818 nova-compute[98971]: DEBUG nova.compute.manager [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Refreshing instance network info cache due to event network-changed-1b03f020-91d2-47a4-bab8-1434e42eaa12. {{(pid=98971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 27 02:04:18.339273 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Acquiring lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 02:04:18.339273 np0000003818 nova-compute[98971]: DEBUG oslo_concurrency.lockutils [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] Acquired lock "refresh_cache-d67139dd-a223-46a9-a4da-78945aeb97fa" {{(pid=98971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 02:04:18.339273 np0000003818 nova-compute[98971]: DEBUG nova.network.neutron [req-6b75313f-90be-4833-8a6d-a8bd5ad78d8f req-6f1762fe-dc13-4c13-8a09-858ba396addc service nova] [instance: d67139dd-a223-46a9-a4da-78945aeb97fa] Refreshing network info cache for port 1b03f020-91d2-47a4-bab8-1434e42eaa12 {{(pid=98971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 27 02:04:18.344940 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.vif [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T02:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941528237',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003818',hostname='tempest-device-tagging-server-1941528237',id=17,image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkk4dOZVr0+BM/0KtiDI6oSfuPXm6h98+GtKifjjg2AZMju3/O9U4l3soWxnLKttK1cYfyvIg1QjrPmuFx8pjgqWwRPddThD60rOsZ1BMJK0QAJ+8IQ5v38e4beY0VUYg==',key_name='tempest-keypair-698885557',keypairs=,launch_index=0,launched_at=2026-06-27T02:03:10Z,launched_on='np0000003818',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003818',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='83d7587a1e784250a212e256570f1622',ramdisk_id='',reservation_id='r-esxvfb7h',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='978bb255-a7d2-43ac-8161-7d19816a5875',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1290144613',owner_user_name='tempest-TaggedAttachmentsTest-1290144613-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-27T02:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94e5a9e97c5a4c659945037d5b76976a',uuid=07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 27 02:04:18.346177 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converting VIF {"id": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "address": "fa:16:3e:1f:f9:9d", "network": {"id": "dc38af2b-7bf6-4066-80b9-546607721753", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-66136047", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "83d7587a1e784250a212e256570f1622", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f4b4d71-ef", "ovs_interfaceid": "4f4b4d71-ef20-4372-a86b-caff1ca3dfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 27 02:04:18.346177 np0000003818 nova-compute[98971]: DEBUG nova.network.os_vif_util [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=4f4b4d71-ef20-4372-a86b-caff1ca3dfb9,network=Network(dc38af2b-7bf6-4066-80b9-546607721753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f4b4d71-ef') {{(pid=98971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 27 02:04:18.350772 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] looking for interface given config: {{(pid=98971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 27 02:04:18.354800 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] looking for interface given config: {{(pid=98971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 27 02:04:18.356596 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.driver [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] Attempting to detach device tap4f4b4d71-ef from instance 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed from the persistent domain config. {{(pid=98971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] detach device xml: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: Jun 27 02:04:18.356830 np0000003818 nova-compute[98971]: {{(pid=98971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 27 02:04:18.370163 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] looking for interface given config: {{(pid=98971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: DEBUG nova.virt.libvirt.guest [None req-0aac1c0b-3f66-43db-acde-4bc200135498 tempest-TaggedAttachmentsTest-1290144613 tempest-TaggedAttachmentsTest-1290144613-project-member] interface for config: not found in domain: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: instance-00000011 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: tempest-device-tagging-server-1941528237 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 2026-06-27 02:03:58 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 192 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: True Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: bare Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: qcow2 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 0 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: ide Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: pc Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: virtio Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: tempest-TaggedAttachmentsTest-1290144613-project-member Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: tempest-TaggedAttachmentsTest-1290144613 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 196608 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 196608 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 1 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: /machine Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: OpenStack Foundation Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: OpenStack Nova Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 33.1.0 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 07cf8251-4d3d-4c55-a8d8-4e8b5ebd24ed Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Virtual Machine Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: hvm Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: 131072 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Nehalem Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: destroy Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: restart Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: destroy Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: /usr/bin/qemu-system-x86_64 Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]:
Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]:
Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]:
Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]:
Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]:
Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: Jun 27 02:04:18.373069 np0000003818 nova-compute[98971]: